...
| Code Block |
|---|
apt install -y unzip php-cli php-xml wget https://github.com/phoronix-test-suite/phoronix-test-suite/archive/refs/heads/master.zip unzip master.zip cd phoronix-test-suite-master/ ./install-sh /usr/bin/phoronix-test-suite |
Test Results
pts/openvino-1.6.0 (OpenVINO 2024.5)
https://openbenchmarking.org/result/2505138-NE-MOREFINES03
| Test | Device | Score (FPS ↑) | Score (ms ↓) |
|---|---|---|---|
| Face Detection FP16 | CPU | 2.16 | 2735.36 |
| Person Detection FP16 | CPU | 22.00 | 272.29 |
| Person Detection FP32 | CPU | 21.84 | 274.21 |
| Vehicle Detection FP16 | CPU | 144.39 | 41.47 |
| Face Detection FP16-INT8 | CPU | 7.95 | 751.10 |
| Face Detection Retail FP16 | CPU | 596.99 | 10.01 |
| Road Segmentation ADAS FP16 | CPU | 64.82 | 92.45 |
| Vehicle Detection FP16-INT8 | CPU | 387.23 | 15.44 |
| Weld Porosity Detection FP16 | CPU | 225.04 | 70.89 |
| Face Detection Retail FP16-INT8 | CPU | 1321.78 | 11.93 |
| Road Segmentation ADAS FP16-INT8 | CPU | 165.55 | 36.15 |
| Machine Translation EN To DE FP16 | CPU | 27.37 | 218.78 |
| Weld Porosity Detection FP16-INT8 | CPU | 837.45 | 18.99 |
| Person Vehicle Bike Detection FP16 | CPU | 310.99 | 19.23 |
| Noise Suppression Poconet-Like FP16 | CPU | 419.29 | 37.90 |
| Handwritten English Recognition FP16 | CPU | 125.88 | 126.94 |
| Person Re-Identification Retail FP16 | CPU | 320.22 | 18.67 |
| Age Gender Recognition Retail 0013 FP16 | CPU | 6972.63 | 2.24 |
| Handwritten English Recognition FP16-INT8 | CPU | 143.45 | 111.37 |
| Age Gender Recognition Retail 0013 FP16-INT | CPU | 16385.56 | 0.92 |
llama-cpp-2.1.1
| Backend | Model | Test | Score |
|---|---|---|---|
| CPU BLAS | Llama-3.1-Tulu-3-8B-Q8_0 | Text Generation 128 | 6.45 |
| CPU BLAS | Llama-3.1-Tulu-3-8B-Q8_0 | Prompt Processing 512 | 22.73 |
| CPU BLAS | Llama-3.1-Tulu-3-8B-Q8_0 | Prompt Processing 1024 | 22.59 |
| CPU BLAS | Mistral-7B-Instruct-v0.3-Q8_0 |
...