4.6 KiB
4.6 KiB
| 1 | arch | model | mode | raptor_pipeline | pimcomp_pipeline | raptor_functional_validation | pimcomp_functional_validation | raptor_latency_ms | pimcomp_latency_ms | raptor_throughput_samples_s | pimcomp_throughput_samples_s | raptor_power_mw | pimcomp_power_mw | raptor_energy_pj | pimcomp_energy_pj | better_compiler | speedup |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | arch-a | vgg8 | latency | 1 | element | PASS | PASS | 1.51833 | 7.98507 | NA | NA | 321.046 | 200.111 | 4.87455e+08 | 1.5979e+09 | raptor | 5.26 |
| 3 | arch-a | vgg8 | throughput | 2 | batch | PASS | FAIL | 0.626959 | 0.979432 | 1600 | 1020 | 549.693 | 475.032 | 3.44635e+08 | 4.65262e+08 | NA | 1.57 |
| 4 | arch-a | vgg8 | throughput | 4 | batch | PASS | FAIL | 0.626566 | 0.979432 | 1600 | 1020 | 545.888 | 475.032 | 3.42035e+08 | 4.65262e+08 | NA | 1.57 |
| 5 | arch-a | vgg8 | throughput | 8 | batch | PASS | FAIL | 0.812348 | 0.979432 | 1230 | 1020 | 462.83 | 475.032 | 3.75979e+08 | 4.65262e+08 | NA | 1.21 |
| 6 | arch-a | resnet18 | latency | 1 | element | PASS | FAIL | 14.0332 | 58.177 | NA | NA | 455.67 | 238.39 | 6.3945e+09 | 1.38688e+10 | NA | 4.15 |
| 7 | arch-a | resnet18 | throughput | 2 | batch | PASS | FAIL | 11.236 | 13.5135 | 89 | 74 | 530.553 | 480.65 | 5.96127e+09 | 6.49526e+09 | NA | 1.20 |
| 8 | arch-a | resnet18 | throughput | 4 | batch | PASS | FAIL | 12.3457 | 13.5135 | 81 | 74 | 500.766 | 480.65 | 6.1823e+09 | 6.49526e+09 | NA | 1.09 |
| 9 | arch-a | resnet18 | throughput | 8 | batch | PASS | FAIL | 13.8889 | 13.5135 | 72 | 74 | 466.401 | 480.65 | 6.4778e+09 | 6.49526e+09 | NA | 1.03 |
| 10 | arch-a | resnet34 | latency | 1 | element | PASS | FAIL | 29.7186 | 66.7093 | NA | NA | 411.806 | 277.489 | 1.22383e+10 | 1.85111e+10 | NA | 2.24 |
| 11 | arch-a | resnet34 | throughput | 2 | batch | PASS | FAIL | 23.2558 | 23.8095 | 43 | 42 | 499.548 | 515.304 | 1.16174e+10 | 1.22691e+10 | NA | 1.02 |
| 12 | arch-a | resnet34 | throughput | 4 | batch | PASS | FAIL | 19.6078 | 23.8095 | 51 | 42 | 557.984 | 515.304 | 1.09409e+10 | 1.22691e+10 | NA | 1.21 |
| 13 | arch-a | resnet34 | throughput | 8 | batch | PASS | FAIL | 30.303 | 23.8095 | 33 | 42 | 424.785 | 515.304 | 1.28723e+10 | 1.22691e+10 | NA | 1.27 |
| 14 | arch-a | googlenet | latency | 1 | element | PASS | FAIL | 9.77731 | 62.9227 | NA | NA | 563.88 | 231.195 | 5.51323e+09 | 1.45474e+10 | NA | 6.44 |
| 15 | arch-a | googlenet | throughput | 2 | batch | PASS | FAIL | 7.40741 | 18.5185 | 135 | 54 | 692.813 | 433.763 | 5.13195e+09 | 8.03266e+09 | NA | 2.50 |
| 16 | arch-a | googlenet | throughput | 4 | batch | PASS | FAIL | 7.46269 | 18.5185 | 134 | 54 | 692.311 | 433.763 | 5.1665e+09 | 8.03266e+09 | NA | 2.48 |
| 17 | arch-a | googlenet | throughput | 8 | batch | PASS | FAIL | 12.8205 | 18.5185 | 78 | 54 | 477.421 | 433.763 | 6.12078e+09 | 8.03266e+09 | NA | 1.44 |
| 18 | arch-a | yolo11n | latency | 1 | element | PASS | FAIL | 149.46 | NA | NA | NA | 288.579 | NA | 4.31311e+10 | NA | NA | NA |
| 19 | arch-a | yolo11n | throughput | 2 | batch | PASS | FAIL | 111.111 | NA | 9 | NA | 355.474 | NA | 3.94971e+10 | NA | NA | NA |
| 20 | arch-a | yolo11n | throughput | 4 | batch | PASS | FAIL | 100 | NA | 10 | NA | 380.73 | NA | 3.8073e+10 | NA | NA | NA |
| 21 | arch-a | yolo11n | throughput | 8 | batch | PASS | FAIL | 100 | NA | 10 | NA | 385.138 | NA | 3.85138e+10 | NA | NA | NA |
| 22 | arch-b | vgg8 | latency | 1 | element | PASS | PASS | 1.5333 | 7.15212 | NA | NA | 292.559 | 173.769 | 4.48582e+08 | 1.24281e+09 | raptor | 4.66 |
| 23 | arch-b | vgg8 | throughput | 2 | batch | PASS | FAIL | 0.627746 | 1.06383 | 1590 | 940 | 516.239 | 408.479 | 3.24067e+08 | 4.34552e+08 | NA | 1.69 |
| 24 | arch-b | vgg8 | throughput | 4 | batch | PASS | FAIL | 0.627746 | 1.06383 | 1590 | 940 | 519.279 | 408.479 | 3.25976e+08 | 4.34552e+08 | NA | 1.69 |
| 25 | arch-b | vgg8 | throughput | 8 | batch | PASS | FAIL | 0.813008 | 1.06383 | 1230 | 940 | 432.62 | 408.479 | 3.51723e+08 | 4.34552e+08 | NA | 1.31 |
| 26 | arch-b | resnet18 | latency | 1 | element | PASS | FAIL | 15.3758 | 64.3808 | NA | NA | 400.661 | 201.664 | 6.16048e+09 | 1.29833e+10 | NA | 4.19 |
| 27 | arch-b | resnet18 | throughput | 2 | batch | PASS | FAIL | 11.4943 | 13.5135 | 87 | 74 | 491.763 | 483.916 | 5.65245e+09 | 6.53941e+09 | NA | 1.18 |
| 28 | arch-b | resnet18 | throughput | 4 | batch | PASS | FAIL | 11.7647 | 13.5135 | 85 | 74 | 487.946 | 483.916 | 5.74054e+09 | 6.53941e+09 | NA | 1.15 |
| 29 | arch-b | resnet18 | throughput | 8 | batch | PASS | FAIL | 16.129 | 13.5135 | 62 | 74 | 396.088 | 483.916 | 6.38852e+09 | 6.53941e+09 | NA | 1.19 |
| 30 | arch-b | resnet34 | latency | 1 | element | PASS | FAIL | 27.9541 | 107.201 | NA | NA | 397.206 | 206.475 | 1.11035e+10 | 2.21343e+10 | NA | 3.83 |
| 31 | arch-b | resnet34 | throughput | 2 | batch | PASS | FAIL | 24.3902 | 23.2558 | 41 | 43 | 454.795 | 492.806 | 1.10926e+10 | 1.14606e+10 | NA | 1.05 |
| 32 | arch-b | resnet34 | throughput | 4 | batch | PASS | FAIL | 22.7273 | 23.2558 | 44 | 43 | 473.936 | 492.806 | 1.07713e+10 | 1.14606e+10 | NA | 1.02 |
| 33 | arch-b | resnet34 | throughput | 8 | batch | PASS | FAIL | 28.5714 | 23.2558 | 35 | 43 | 414.549 | 492.806 | 1.18443e+10 | 1.14606e+10 | NA | 1.23 |
| 34 | arch-b | googlenet | latency | 1 | element | PASS | FAIL | 11.2209 | 37.9362 | NA | NA | 483.274 | 242.038 | 5.42278e+09 | 9.182e+09 | NA | 3.38 |
| 35 | arch-b | googlenet | throughput | 2 | batch | PASS | FAIL | 7.57576 | 21.7391 | 132 | 46 | 653.673 | 417.304 | 4.95207e+09 | 9.07182e+09 | NA | 2.87 |
| 36 | arch-b | googlenet | throughput | 4 | batch | PASS | FAIL | 7.57576 | 21.7391 | 132 | 46 | 651.226 | 417.304 | 4.93353e+09 | 9.07182e+09 | NA | 2.87 |
| 37 | arch-b | googlenet | throughput | 8 | batch | PASS | FAIL | 10.2041 | 21.7391 | 98 | 46 | 522.741 | 417.304 | 5.3341e+09 | 9.07182e+09 | NA | 2.13 |
| 38 | arch-b | yolo11n | latency | 1 | element | PASS | FAIL | 171.598 | NA | NA | NA | 243.177 | NA | 4.17288e+10 | NA | NA | NA |
| 39 | arch-b | yolo11n | throughput | 2 | batch | PASS | FAIL | 111.111 | NA | 9 | NA | 315.563 | NA | 3.50626e+10 | NA | NA | NA |
| 40 | arch-b | yolo11n | throughput | 4 | batch | PASS | FAIL | 90.9091 | NA | 11 | NA | 349.244 | NA | 3.17494e+10 | NA | NA | NA |
| 41 | arch-b | yolo11n | throughput | 8 | batch | PASS | FAIL | 111.111 | NA | 9 | NA | 332.438 | NA | 3.69376e+10 | NA | NA | NA |