...
| Workload (TF Lite) | Accuracy | Score | Workload (ONNX) | Accuracy | Score | |||
|---|---|---|---|---|---|---|---|---|
| Image Classification (SP) | 100% | 406 75.5 IPS | Image Classification (SP) | 100% | 522 97.0 IPS | |||
| Image Classification (HP) | 100% | 411 76.5 IPS | Image Classification (HP) | 100% | 97 18.1 IPS | |||
| Image Classification (Q) | 99% | 275 51.2 IPS | Image Classification (Q) | 97% | 1131 211.0 IPS | |||
| Image Segmentation (SP) | 100% | 517 8.38 IPS | Image Segmentation (SP) | 100% | 445 7.22 IPS | |||
| Image Segmentation (HP) | 100% | 515 8.35 IPS | Image Segmentation (HP) | 100% | 146 2.37 IPS | |||
| Image Segmentation (Q) | 98% | 332 5.40 IPS | Image Segmentation (Q) | 99% | 954 15.5 IPS | |||
| Pose Estimation (SP) | 100% | 632 0.74 IPS | Pose Estimation (SP) | 100% | 997 1.16 IPS | |||
| Pose Estimation (HP) | 100% | 649 0.76 IPS | Pose Estimation (HP) | 100% | 753 0.88 IPS | |||
| Pose Estimation (Q) | 96% | 611 0.72 IPS | Pose Estimation (Q) | 94% | 2459 2.88 IPS | |||
| Object Detection (SP) | 100% | 369 29.3 IPS | Object Detection (SP) | 100% | 489 38.8 IPS | |||
| Object Detection (HP) | 100% | 378 30.0 IPS | Object Detection (HP) | 100% | 122 9.68 IPS | |||
| Object Detection (Q) | 85% | 286 23.0 IPS | Object Detection (Q) | 86% | 1114 89.5 IPS | |||
| Face Detection (SP) | 100% | 771 9.16 IPS | Face Detection (SP) | 100% | 1086 12.9 IPS | |||
| Face Detection (HP) | 100% | 870 10.3 IPS | Face Detection (HP) | 100% | 207 2.46 IPS | |||
| Face Detection (Q) | 97% | 719 8.57 IPS | Face Detection (Q) | 97% | 2934 35.0 IPS | |||
| Depth Estimation (SP) | 100% | 724 5.58 IPS | Depth Estimation (SP) | 100% | 1312 10.1 IPS | |||
| Depth Estimation (HP) | 99% | 747 5.76 IPS | Depth Estimation (HP) | 99% | 462 3.56 IPS | |||
| Depth Estimation (Q) | 63% | 549 5.15 IPS | Depth Estimation (Q) | 78% | 2596 20.7 IPS | |||
| Style Transfer (SP) | 100% | 1256 1.61 IPS | Style Transfer (SP) | 100% | 2473 3.18 IPS | |||
| Style Transfer (HP) | 100% | 1264 1.63 IPS | Style Transfer (HP) | 100% | 1993 2.56 IPS | |||
| Style Transfer (Q) | 98% | 1454 1.87 IPS | Style Transfer (Q) | 98% | 4651 6.00 IPS | |||
| Image Super-Resolution (SP) | 100% | 362 13.4 IPS | Image Super-Resolution (SP) | 100% | 588 21.7 IPS | |||
| Image Super-Resolution (HP) | 100% | 338 12.5 IPS | Image Super-Resolution (HP) | 100% | 430 15.9 IPS | |||
| Image Super-Resolution (Q) | 97% | 357 13.2 IPS | Image Super-Resolution (Q) | 99% | 876 32.4 IPS | |||
| Text Classification (SP) | 100% | 612 816.3 IPS | Text Classification (SP) | 100% | 297 397.0 IPS | |||
| Text Classification (HP) | 100% | 614 819.4 IPS | Text Classification (HP) | 100% | 180 240.0 IPS | |||
| Text Classification (Q) | 92% | 266 356.9 IPS | Text Classification (Q) | 97% | 412 552.4 IPS | |||
| Machine Translation (SP) | 100% | 819 14.1 IPS | Machine Translation (SP) | 100% | 875 15.1 IPS | |||
| Machine Translation (HP) | 100% | 833 14.3 IPS | Machine Translation (HP) | 100% | 267 4.60 IPS | |||
| Machine Translation (Q) | 58% | 253 5.95 IPS | Machine Translation (Q) | 65% | 1085 21.8 IPS |
...