Page History

framework	Backend	Device	Single	Half	Quant.	Results
TensorFlow Lite	CPU	Intel Core Ultra 9 185H	1971	2037	1382	https://browser.geekbench.com/ai/v1/259291
ONNX	CPU	Intel Core Ultra 9 185H	2138	643	5634	https://browser.geekbench.com/ai/v1/259319
OpenVINO	CPU	Intel Core Ultra 9 185H	4507	4541	10765	https://browser.geekbench.com/ai/v1/259321
OpenVINO	GPU	Intel(R) Arc(TM) Graphics (iGPU)	4958	8259	11080	https://browser.geekbench.com/ai/v1/259327

HP14282656 HP133246 Q99%9931851 Q97%41777795 Segmentation SP2253365 Segmentation SP114118 Segmentation HP100%2243364 Segmentation HP100%209338 Segmentation 98%1035168 IPS Segmentation 99%2658432 Pose Estimation 2357275 Pose Estimation 3668428 Pose Estimation (HP2309269 Pose Estimation HP3007351 Pose Estimation (Q96%3224378 Pose Estimation Q94%20021235 Object Detection (SP1654131Object Detection SP15441225 Object Detection (HP100%16481307 Object Detection HP100%269213 Object Detection 85%1024824 Object Detection 86%46053701 Face Detection 3071365 Face Detection 2807334 Face Detection (HP3060364 Face Detection HP314373 Face Detection (Q97%227827. IPS Depth Estimation (SP2317179 Depth SP4220325 Depth 2507193 Depth HP99%1121864 Depth 63%1964184 Depth 78%138481105 Style Transfer (SP100%2892.72 Style Transfer 9110117 Style Transfer (HP2928376 Style Transfer HP7498964 Style Transfer (Q98%5650.29 Style Transfer Q98%17976232 Image Super-Resolution (SP1494552 Image Super-Resolution (SP1774655 Image Super-Resolution 1911706 Image Super-Resolution (HP100%1166431 Image Super-Resolution 97% 1105
1HP100%3334447 IPS 1771305 1320227

Workload (TF Lite)	Accuracy	Score	Workload (ONNX)	Accuracy	Score	Workload (OpenVINO-CPU)	Accuracy	Score	Workload (OpenVINO-GPU)	Accuracy	Score
Image Classification (SP)	100%	1510 280.9 IPS	Image Classification (SP)	100%	1106 205.7 IPS	Image Classification (	SP)	100%	2587	481.	0 IPS	Image Classification (	SP)	100%	2587	481.	0 IPS
Image Classification (	HP)	100%	1428	265.	6 IPS	Image Classification (	HP)	100%	133	24.	6 IPS		Image	Classification (	HP)	100%	2716	505.	1 IPS	Image	Classification (	HP)	100%	4288	797.5 IPS
Image	Classification (	Q)	99%	993	185.	1 IPS	Image	Classification (	Q)	97%	4177	779.	5 IPS	Image	Classification (Q)	100%	6637	1.	23 KIPS	Image	Classification (Q)	100%	5112	950.	6 IPS
Image Segmentation (SP)	100%	2253	36.	5 IPS	Image Segmentation (SP)	100%	1141	18.	5 IPS	Image Segmentation (SP)	100%	3453	56.	0 IPS	Image Segmentation (	SP)	100%	3131	50.	7 IPS
Image Segmentation (HP)	100%	2243	36.	4 IPS	Image Segmentation (	HP)	100%	209	3.	38 IPS	Image Segmentation (HP)	100%	3468	56.2 IPS	Image Segmentation (	HP)	100%	6965	112.	9 IPS
Image Segmentation (Q)	98%	1035	16.	8 IPS	Image Segmentation (	Q)	99%	2658	43.	2 IPS	Image Segmentation (Q)	99%	6945	112.	6 IPS	Image Segmentation (Q)	99%	9262	150.	6 IPS
Pose Estimation (SP)	100%	2357	2.	75 IPS	Pose Estimation (SP)	100%	3668	4.	28 IPS	Pose Estimation (SP)	100%	5030	5.	87 IPS	Pose Estimation (	SP)	100%	22411	26.	1 IPS
Pose Estimation (HP)	100%	2309	2	Face Detection (Q)	97%	12436 148.3 IPS	.69 IPS	Pose Estimation (HP	)	100%	3007	3.	51 IPS	Pose Estimation (	HP)	100%	5100	5.	95 IPS	Pose Estimation (HP)	99%	20212	23.	7 IPS
Pose Estimation (	Q)	96%	3224	3.	78 IPS	Pose Estimation (Q)	94%	20021	23.	5 IPS	Pose Estimation (Q)	96%	18872	22.	1 IPS	Pose Estimation (Q)	97%	44712 52.3	IPS
Object Detection (SP)	100%	1654	131.	2 IPS	Object Detection (SP)	100%	1544	122.	5 IPS	Object Detection (	SP)	100%	2648	210.	0 IPS	Object Detection (SP)	100%	2429 192.7	IPS
Object Detection (	HP)	100%	1648	130.	7 IPS	Object Detection (HP)	100%	269	21.	3 IPS	Object Detection (HP)	100%	2652	210.	4 IPS	Object Detection (HP)	100%	3775	299.	4 IPS
Object Detection (Q)	85%	1024	82.	4 IPS	Object Detection (Q)	86%	1463 54.2 IPS	Image Super-Resolution (Q)	99%	3013 111.6 IPS	Text Classification (SP)	100%	1229 1.64 KIPS	Text Classification (SP)	100%	1105 1.48 KIPS	4605 370.1 IPS	Object Detection (Q)	88%	6968 558.5 IPS	Object Detection (Q)	88%	6319 506.4 IPS
Face Detection (SP)	100%	3071 36.5 IPS	Face Detection (SP)	100%	2807 33.4 IPS	Face Detection (SP)	100%	7234 86.0 IPS	Face Detection (SP)	100%	5692 67.6 IPS
Face Detection (HP)	100%	3060 36.4 IPS	Face Detection (HP)	100%	314 3.73 IPS	Face Detection (HP)	100%	7248 86.1 IPS	Face Detection (HP)	100%	11061 131.4 IPS
Face Detection (Q)	97%	2278 27.2 IPS	Face Detection (Q)	97%	12436 148.3 IPS	Face Detection (Q)	100%	14581 173.3 IPS	Face Detection (Q)	100%	16836 200.0 IPS
Depth Estimation (SP)	100%	2317 17.9 IPS	Depth Estimation (SP)	100%	4220 32.5 IPS	Depth Estimation (SP)	100%	6716 51.7 IPS	Depth Estimation (SP)	100%	12001 92.5 IPS
Depth Estimation (HP)	99%	2507 19.3 IPS	Depth Estimation (HP)	99%	1121 8.64 IPS	Depth Estimation (HP)	99%	6752 52.0 IPS	Depth Estimation (HP)	98%	20362 157.4 IPS
Depth Estimation (Q)	63%	1964 18.4 IPS	Depth Estimation (Q)	78%	13848 110.5 IPS	Depth Estimation (Q)	89%	17848 138.8 IPS	Depth Estimation (Q)	89%	22566 175.4 IPS
Style Transfer (SP)	100%	2892 3.72 IPS	Style Transfer (SP)	100%	9110 11.7 IPS	Style Transfer (SP)	100%	15042 19.3 IPS	Style Transfer (SP)	100%	46431 59.7 IPS
Style Transfer (HP)	100%	2928 3.76 IPS	Style Transfer (HP)	100%	7498 9.64 IPS	Style Transfer (HP)	100%	14930 19.2 IPS	Style Transfer (HP)	100%	62424 80.2 IPS
Style Transfer (Q)	98%	5650 7.29 IPS	Style Transfer (Q)	98%	17976 23.2 IPS	Style Transfer (Q)	98%	52607 67.8 IPS	Style Transfer (Q)	98%	115671 149.2 IPS
Image Super-Resolution (SP)	100%	1494 55.2 IPS	Image Super-Resolution (SP)	100%	1774 65.5 IPS	Image Super-Resolution (SP)	100%	3022 111.6 IPS	Image Super-Resolution (SP)	100%	4275 157.9 IPS
Image Super-Resolution (HP)	100%	1911 70.6 IPS	Image Super-Resolution (HP)	100%	1166 43.1 IPS	Image Super-Resolution (HP)	100%	3020 111.5 IPS	Image Super-Resolution (HP)	100%	11896 439.2 IPS
Image Super-Resolution (Q)	97%	1463 54.2 IPS	Image Super-Resolution (Q)	99%	3013 111.6 IPS	Image Super-Resolution (Q)	99%	10997 407.3 IPS	Image Super-Resolution (Q)	99%	17460 646.6 IPS
Text Classification (SP)	100%	1229 1.64 KIPS	Text Classification (SP)	100%	1105 1.48 KIPS	Text Classification (SP)	100%	2778 3.71 KIPS	Text Classification (SP)	71%	1028 1.49 KIPS
Text Classification (HP)	100%	1105 1.47 KIPS	Text Classification (HP)	100%	333 444.7 IPS	Text Classification (HP)	100%	2783 3.71 KIPS	Text Classification (HP)	71%	1545 2.24 KIPS
Text Classification (Q)	92%	390 524.3 IPS	Text Classification (Q)	97%	1083 1.45 KIPS	Text Classification (Q)	92%	4816 6	Text Classification (HP)	100%	.47 KIPS	Text Classification (	Q)	92%	1499	2.	01 KIPS
Machine Translation (SP)	100%	1771 30.5 IPS	Machine Translation (SP)	100%	1320 22.7 IPS	Text Classification (Q)	92%	390 524.3 IPS	Text Classification (Q)	97%	1083 1.45 KIPS		Machine Translation (SP)	100%	4745	81.	7 IPS	Machine Translation (SP)	100%	1463	25.	2 IPS
Machine Translation (HP)	100%	2135 36.8 IPS	Machine Translation (HP)	100%	530 9.14 IPS	Machine Translation (HP)	100%	4772 82.2 IPS		Machine Translation (HP)	96%	2510 43.4 IPS
Machine Translation (Q)	58%	520 12.2 IPS	Machine Translation (Q)	65%	3117 62.6 IPS	Machine Translation (Q)	100%	4756 81.9 IPS	Machine Translation (Q)	100%	1814 31.3 IPS

before some drivers added

...

Page tree

Versions Compared

Old Version 3

New Version 4

Key