Ubuntu 24.04 Linux
With 2x48GB 4800 MT/s CL46 DDR5 RAM
| framework | Backend | Device | Single | Half | Quant. | Results |
|---|---|---|---|---|---|---|
TensorFlow Lite | CPU | Intel Core Ultra 9 185H | 2307 | 2333 | 1711 | https://browser.geekbench.com/ai/v1/398549 |
ONNX | CPU | Intel Core Ultra 9 185H | 1746 | 768 | 7783 | https://browser.geekbench.com/ai/v1/398551 |
OpenVINO | CPU | Intel Core Ultra 9 185H | 4890 | 3493 | 12639 | https://browser.geekbench.com/ai/v1/398552 |
OpenVINO | GPU | Intel(R) Arc(TM) Graphics (iGPU) | 9811 | 24172 | 31771 | https://browser.geekbench.com/ai/v1/398553 |
| Workload (TF CPU) | Accuracy | Score | Workload (ONNX CPU) | Accuracy | Score | Workload (OpenVINO CPU) | Accuracy | Score | Workload (OpenVINO GPU) | Accuracy | Score |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Image Classification (SP) | 100% | 1691 314.5 IPS | Image Classification (SP) | 100% | 871 162.0 IPS | Image Classification (SP) | 100% | 3064 569.7 IPS | Image Classification (SP) | 100% | 7030 1.31 KIPS |
| Image Classification (HP) | 100% | 1698 315.8 IPS | Image Classification (HP) | 100% | 218 40.6 IPS | Image Classification (HP) | 100% | 2242 416.9 IPS | Image Classification (HP) | 100% | 13078 2.43 KIPS |
| Image Classification (Q) | 99% | 1098 204.7 IPS | Image Classification (Q) | 97% | 6563 1.22 KIPS | Image Classification (Q) | 100% | 8177 1.52 KIPS | Image Classification (Q) | 100% | 18867 3.51 KIPS |
| Image Segmentation (SP) | 100% | 2489 40.4 IPS | Image Segmentation (SP) | 100% | 942 15.3 IPS | Image Segmentation (SP) | 100% | 3880 62.9 IPS | Image Segmentation (SP) | 100% | 7184 116.5 IPS |
| Image Segmentation (HP) | 100% | 2651 43.0 IPS | Image Segmentation (HP) | 100% | 355 5.75 IPS | Image Segmentation (HP) | 100% | 1816 29.4 IPS | Image Segmentation (HP) | 100% | 20780 336.9 IPS |
| Image Segmentation (Q) | 98% | 1260 20.5 IPS | Image Segmentation (Q) | 99% | 4007 65.2 IPS | Image Segmentation (Q) | 99% | 9091 147.4 IPS | Image Segmentation (Q) | 99% | 23787 386.7 IPS |
| Pose Estimation (SP) | 100% | 2921 3.41 IPS | Pose Estimation (SP) | 100% | 1967 2.29 IPS | Pose Estimation (SP) | 100% | 5219 6.09 IPS | Pose Estimation (SP) | 100% | 24504 28.6 IPS |
| Pose Estimation (HP) | 100% | 2905 3.39 IPS | Pose Estimation (HP) | 100% | 2491 2.91 IPS | Pose Estimation (HP) | 100% | 3714 4.33 IPS | Pose Estimation (HP) | 100% | 93836 109.5 IPS |
| Pose Estimation (Q) | 96% | 4164 4.88 IPS | Pose Estimation (Q) | 94% | 23096 27.1 IPS | Pose Estimation (Q) | 96% | 18352 21.5 IPS | Pose Estimation (Q) | 97% | 183741 215.1 IPS |
| Object Detection (SP) | 100% | 1775 140.8 IPS | Object Detection (SP) | 100% | 1096 86.9 IPS | Object Detection (SP) | 100% | 2794 221.6 IPS | Object Detection (SP) | 100% | 5184 411.2 IPS |
| Object Detection (HP) | 100% | 1847 146.5 IPS | Object Detection (HP) | 100% | 280 22.2 IPS | Object Detection (HP) | 100% | 2138 169.6 IPS | Object Detection (HP) | 100% | 14307 1.13 KIPS |
| Object Detection (Q) | 85% | 1134 91.3 IPS | Object Detection (Q) | 86% | 5784 464.9 IPS | Object Detection (Q) | 88% | 8565 686.6 IPS | Object Detection (Q) | 88% | 18830 1.51 KIPS |
| Face Detection (SP) | 100% | 3299 39.2 IPS | Face Detection (SP) | 100% | 2568 30.5 IPS | Face Detection (SP) | 100% | 8472 100.7 IPS | Face Detection (SP) | 100% | 10541 125.2 IPS |
| Face Detection (HP) | 100% | 3297 39.2 IPS | Face Detection (HP) | 100% | 438 5.21 IPS | Face Detection (HP) | 100% | 6783 80.6 IPS | Face Detection (HP) | 100% | 26040 309.4 IPS |
| Face Detection (Q) | 97% | 2653 31.6 IPS | Face Detection (Q) | 97% | 17267 205.9 IPS | Face Detection (Q) | 100% | 20345 241.7 IPS | Face Detection (Q) | 100% | 40542 481.7 IPS |
| Depth Estimation (SP) | 100% | 2823 21.7 IPS | Depth Estimation (SP) | 100% | 2791 21.5 IPS | Depth Estimation (SP) | 100% | 6892 53.1 IPS | Depth Estimation (SP) | 100% | 16462 126.8 IPS |
| Depth Estimation (HP) | 99% | 2812 21.7 IPS | Depth Estimation (HP) | 99% | 1125 8.67 IPS | Depth Estimation (HP) | 99% | 4967 38.3 IPS | Depth Estimation (HP) | 99% | 41750 321.7 IPS |
| Depth Estimation (Q) | 63% | 2300 21.6 IPS | Depth Estimation (Q) | 78% | 15204 121.3 IPS | Depth Estimation (Q) | 89% | 20980 163.1 IPS | Depth Estimation (Q) | 89% | 61833 480.6 IPS |
| Style Transfer (SP) | 100% | 3741 4.81 IPS | Style Transfer (SP) | 100% | 5326 6.85 IPS | Style Transfer (SP) | 100% | 14197 18.3 IPS | Style Transfer (SP) | 100% | 59784 76.9 IPS |
| Style Transfer (HP) | 100% | 3748 4.82 IPS | Style Transfer (HP) | 100% | 6217 7.99 IPS | Style Transfer (HP) | 100% | 9987 12.8 IPS | Style Transfer (HP) | 100% | 162811 209.3 IPS |
| Style Transfer (Q) | 98% | 7046 9.09 IPS | Style Transfer (Q) | 98% | 21796 28.1 IPS | Style Transfer (Q) | 98% | 55964 72.2 IPS | Style Transfer (Q) | 98% | 272118 350.9 IPS |
| Image Super-Resolution (SP) | 100% | 2171 80.2 IPS | Image Super-Resolution (SP) | 100% | 1514 55.9 IPS | Image Super-Resolution (SP) | 100% | 3214 118.7 IPS | Image Super-Resolution (SP) | 100% | 10455 386.0 IPS |
| Image Super-Resolution (HP) | 100% | 2169 80.1 IPS | Image Super-Resolution (HP) | 100% | 1200 44.3 IPS | Image Super-Resolution (HP) | 100% | 2327 85.9 IPS | Image Super-Resolution (HP) | 100% | 31170 1.15 KIPS |
| Image Super-Resolution (Q) | 97% | 1893 70.2 IPS | Image Super-Resolution (Q) | 99% | 5370 198.8 IPS | Image Super-Resolution (Q) | 99% | 11796 436.8 IPS | Image Super-Resolution (Q) | 99% | 41548 1.54 KIPS |
| Text Classification (SP) | 100% | 1067 1.42 KIPS | Text Classification (SP) | 100% | 1215 1.62 KIPS | Text Classification (SP) | 100% | 3219 4.30 KIPS | Text Classification (SP) | 100% | 4013 5.36 KIPS |
| Text Classification (HP) | 100% | 1075 1.43 KIPS | Text Classification (HP) | 100% | 525 700.8 IPS | Text Classification (HP) | 100% | 2281 3.04 KIPS | Text Classification (HP) | 100% | 5177 6.91 KIPS |
| Text Classification (Q) | 92% | 638 856.5 IPS | Text Classification (Q) | 97% | 1637 2.19 KIPS | Text Classification (Q) | 92% | 6010 8.07 KIPS | Text Classification (Q) | 92% | 3658 4.91 KIPS |
| Machine Translation (SP) | 100% | 2431 41.9 IPS | Machine Translation (SP) | 100% | 2122 36.5 IPS | Machine Translation (SP) | 100% | 5263 90.7 IPS | Machine Translation (SP) | 100% | 2962 51.0 IPS |
| Machine Translation (HP) | 100% | 2449 42.2 IPS | Machine Translation (HP) | 100% | 687 11.8 IPS | Machine Translation (HP) | 100% | 4692 80.8 IPS | Machine Translation (HP) | 98% | 6535 112.9 IPS |
| Machine Translation (Q) | 58% | 634 14.9 IPS | Machine Translation (Q) | 65% | 4616 92.7 IPS | Machine Translation (Q) | 100% | 5260 90.6 IPS | Machine Translation (Q) | 100% | 6511 112.1 IPS |
wget https://cdn.geekbench.com/GeekbenchAI-1.5.0-Linux.tar.gz tar xvf GeekbenchAI-1.5.0-Linux.tar.gz cd GeekbenchAI-1.5.0-Linux/ ./banff
before some drivers added
root@server7:~/GeekbenchAI-1.5.0-Linux# ./banff --ai-list Geekbench AI 1.5.0 : https://www.geekbench.com/ai/ Geekbench AI requires an active internet connection and automatically uploads benchmark results to the Geekbench Browser. Framework | Backend | Device 1 TensorFlow Lite | 1 CPU | 0 Intel(R) Core(TM) Ultra 9 285H 3 ONNX | 1 CPU | 0 Intel(R) Core(TM) Ultra 9 285H 4 OpenVINO | 1 CPU | 0 Intel(R) Core(TM) Ultra 9 285H 4 OpenVINO | 2 GPU | 1 Intel(R) Arc(TM) Graphics (iGPU)
execution
./banff --ai-list ./banff --ai-framework 1 --ai-backend 1 --ai-device 0 ./banff --ai-framework 3 --ai-backend 1 --ai-device 0 ./banff --ai-framework 4 --ai-backend 1 --ai-device 0 ./banff --ai-framework 4 --ai-backend 2 --ai-device 1
Windows 11
Intel Core Ultra 9 185H, 96GB DDR5
BIOS: Turbo Performance
Windows: Balanced
| Framework | Backend | Single | Half | Quantized | URL |
|---|---|---|---|---|---|
| OpenVino | GPU | ||||
| OpenVINO | CPU | ||||
| ONNX | DirectML | ||||
| ONNX | CPU |
