...
governor: performance, PL1=70W, PL2=80W
| framework | Backend | Device | Single | Half | Quant. | Results |
|---|---|---|---|---|---|---|
TensorFlow Lite | CPU | Intel Core Ultra 9 185H | 2174 | 2165 | 1413 | https://browser.geekbench.com/ai/v1/259993 |
ONNX | CPU | Intel Core Ultra 9 185H | 2304 | 716 | 5762 | https://browser.geekbench.com/ai/v1/260000 |
OpenVINO | CPU | Intel Core Ultra 9 185H | 4631 | 4682 | 11063 | https://browser.geekbench.com/ai/v1/260002 |
OpenVINO | GPU | Intel(R) Arc(TM) Graphics (iGPU) | 6196 | 9348 | 13454 | https://browser.geekbench.com/ai/v1/260003 |
| Workload (TF Lite) | Accuracy | Score | Workload (ONNX) | Accuracy | Score | Workload (OpenVINO-CPU) | Accuracy | Score | Workload (OpenVINO-GPU) | Accuracy | Score |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Image Classification (SP) | 100% | 1510 280.9 IPS | Image Classification (SP) | 100% | 1106 205.7 IPS | Image Classification (SP) | 100% | 2587 481.0 IPS | Image Classification (SP) | 100% | 2587 481.0 IPS |
| Image Classification (HP) | 100% | 1428 265.6 IPS | Image Classification (HP) | 100% | 133 24.6 IPS | Image Classification (HP) | 100% | 2716 505.1 IPS | Image Classification (HP) | 100% | 4288 797.5 IPS |
| Image Classification (Q) | 99% | 993 185.1 IPS | Image Classification (Q) | 97% | 4177 779.5 IPS | Image Classification (Q) | 100% | 6637 1.23 KIPS | Image Classification (Q) | 100% | 5112 950.6 IPS |
| Image Segmentation (SP) | 100% | 2253 36.5 IPS | Image Segmentation (SP) | 100% | 1141 18.5 IPS | Image Segmentation (SP) | 100% | 3453 56.0 IPS | Image Segmentation (SP) | 100% | 3131 50.7 IPS |
| Image Segmentation (HP) | 100% | 2243 36.4 IPS | Image Segmentation (HP) | 100% | 209 3.38 IPS | Image Segmentation (HP) | 100% | 3468 56.2 IPS | Image Segmentation (HP) | 100% | 6965 112.9 IPS |
| Image Segmentation (Q) | 98% | 1035 16.8 IPS | Image Segmentation (Q) | 99% | 2658 43.2 IPS | Image Segmentation (Q) | 99% | 6945 112.6 IPS | Image Segmentation (Q) | 99% | 9262 150.6 IPS |
| Pose Estimation (SP) | 100% | 2357 2.75 IPS | Pose Estimation (SP) | 100% | 3668 4.28 IPS | Pose Estimation (SP) | 100% | 5030 5.87 IPS | Pose Estimation (SP) | 100% | 22411 26.1 IPS |
| Pose Estimation (HP) | 100% | 2309 2.69 IPS | Pose Estimation (HP) | 100% | 3007 3.51 IPS | Pose Estimation (HP) | 100% | 5100 5.95 IPS | Pose Estimation (HP) | 99% | 20212 23.7 IPS |
| Pose Estimation (Q) | 96% | 3224 3.78 IPS | Pose Estimation (Q) | 94% | 20021 23.5 IPS | Pose Estimation (Q) | 96% | 18872 22.1 IPS | Pose Estimation (Q) | 97% | 44712 52.3 IPS |
| Object Detection (SP) | 100% | 1654 131.2 IPS | Object Detection (SP) | 100% | 1544 122.5 IPS | Object Detection (SP) | 100% | 2648 210.0 IPS | Object Detection (SP) | 100% | 2429 192.7 IPS |
| Object Detection (HP) | 100% | 1648 130.7 IPS | Object Detection (HP) | 100% | 269 21.3 IPS | Object Detection (HP) | 100% | 2652 210.4 IPS | Object Detection (HP) | 100% | 3775 299.4 IPS |
| Object Detection (Q) | 85% | 1024 82.4 IPS | Object Detection (Q) | 86% | 4605 370.1 IPS | Object Detection (Q) | 88% | 6968 558.5 IPS | Object Detection (Q) | 88% | 6319 506.4 IPS |
| Face Detection (SP) | 100% | 3071 36.5 IPS | Face Detection (SP) | 100% | 2807 33.4 IPS | Face Detection (SP) | 100% | 7234 86.0 IPS | Face Detection (SP) | 100% | 5692 67.6 IPS |
| Face Detection (HP) | 100% | 3060 36.4 IPS | Face Detection (HP) | 100% | 314 3.73 IPS | Face Detection (HP) | 100% | 7248 86.1 IPS | Face Detection (HP) | 100% | 11061 131.4 IPS |
| Face Detection (Q) | 97% | 2278 27.2 IPS | Face Detection (Q) | 97% | 12436 148.3 IPS | Face Detection (Q) | 100% | 14581 173.3 IPS | Face Detection (Q) | 100% | 16836 200.0 IPS |
| Depth Estimation (SP) | 100% | 2317 17.9 IPS | Depth Estimation (SP) | 100% | 4220 32.5 IPS | Depth Estimation (SP) | 100% | 6716 51.7 IPS | Depth Estimation (SP) | 100% | 12001 92.5 IPS |
| Depth Estimation (HP) | 99% | 2507 19.3 IPS | Depth Estimation (HP) | 99% | 1121 8.64 IPS | Depth Estimation (HP) | 99% | 6752 52.0 IPS | Depth Estimation (HP) | 98% | 20362 157.4 IPS |
| Depth Estimation (Q) | 63% | 1964 18.4 IPS | Depth Estimation (Q) | 78% | 13848 110.5 IPS | Depth Estimation (Q) | 89% | 17848 138.8 IPS | Depth Estimation (Q) | 89% | 22566 175.4 IPS |
| Style Transfer (SP) | 100% | 2892 3.72 IPS | Style Transfer (SP) | 100% | 9110 11.7 IPS | Style Transfer (SP) | 100% | 15042 19.3 IPS | Style Transfer (SP) | 100% | 46431 59.7 IPS |
| Style Transfer (HP) | 100% | 2928 3.76 IPS | Style Transfer (HP) | 100% | 7498 9.64 IPS | Style Transfer (HP) | 100% | 14930 19.2 IPS | Style Transfer (HP) | 100% | 62424 80.2 IPS |
| Style Transfer (Q) | 98% | 5650 7.29 IPS | Style Transfer (Q) | 98% | 17976 23.2 IPS | Style Transfer (Q) | 98% | 52607 67.8 IPS | Style Transfer (Q) | 98% | 115671 149.2 IPS |
| Image Super-Resolution (SP) | 100% | 1494 55.2 IPS | Image Super-Resolution (SP) | 100% | 1774 65.5 IPS | Image Super-Resolution (SP) | 100% | 3022 111.6 IPS | Image Super-Resolution (SP) | 100% | 4275 157.9 IPS |
| Image Super-Resolution (HP) | 100% | 1911 70.6 IPS | Image Super-Resolution (HP) | 100% | 1166 43.1 IPS | Image Super-Resolution (HP) | 100% | 3020 111.5 IPS | Image Super-Resolution (HP) | 100% | 11896 439.2 IPS |
| Image Super-Resolution (Q) | 97% | 1463 54.2 IPS | Image Super-Resolution (Q) | 99% | 3013 111.6 IPS | Image Super-Resolution (Q) | 99% | 10997 407.3 IPS | Image Super-Resolution (Q) | 99% | 17460 646.6 IPS |
| Text Classification (SP) | 100% | 1229 1.64 KIPS | Text Classification (SP) | 100% | 1105 1.48 KIPS | Text Classification (SP) | 100% | 2778 3.71 KIPS | Text Classification (SP) | 71% | 1028 1.49 KIPS |
| Text Classification (HP) | 100% | 1105 1.47 KIPS | Text Classification (HP) | 100% | 333 444.7 IPS | Text Classification (HP) | 100% | 2783 3.71 KIPS | Text Classification (HP) | 71% | 1545 2.24 KIPS |
| Text Classification (Q) | 92% | 390 524.3 IPS | Text Classification (Q) | 97% | 1083 1.45 KIPS | Text Classification (Q) | 92% | 4816 6.47 KIPS | Text Classification (Q) | 92% | 1499 2.01 KIPS |
| Machine Translation (SP) | 100% | 1771 30.5 IPS | Machine Translation (SP) | 100% | 1320 22.7 IPS | Machine Translation (SP) | 100% | 4745 81.7 IPS | Machine Translation (SP) | 100% | 1463 25.2 IPS |
| Machine Translation (HP) | 100% | 2135 36.8 IPS | Machine Translation (HP) | 100% | 530 9.14 IPS | Machine Translation (HP) | 100% | 4772 82.2 IPS | Machine Translation (HP) | 96% | 2510 43.4 IPS |
| Machine Translation (Q) | 58% | 520 12.2 IPS | Machine Translation (Q) | 65% | 3117 62.6 IPS | Machine Translation (Q) | 100% | 4756 81.9 IPS | Machine Translation (Q) | 100% | 1814 31.3 IPS |
| Code Block |
|---|
wget https://cdn.geekbench.com/GeekbenchAI-1.3.0-Linux.tar.gz
tar xvf GeekbenchAI-1.3.0-Linux.tar.gz
cd GeekbenchAI-1.3.0-Linux/
./banff
|
before some drivers added
...