Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
apt install -y unzip php-cli php-xml
wget https://github.com/phoronix-test-suite/phoronix-test-suite/archive/refs/heads/master.zip
unzip master.zip
cd phoronix-test-suite-master/
./install-sh
/usr/bin/phoronix-test-suite

/usr/bin/phoronix-test-suite system-info

Test Results

llama-cpp-2.1.1

BackendModelTestScore
CPU BLASLlama-3.1-Tulu-3-8B-Q8_0Text Generation 1286.45
CPU BLASLlama-3.1-Tulu-3-8B-Q8_0Prompt Processing 51222.73
CPU BLASLlama-3.1-Tulu-3-8B-Q8_0Prompt Processing 1024




pts/ffmpeg (7.0.1)

EncoderScenarioScore, FPS
libx264Live298.02
libx265Live143.77
libx264Upload16.32
libx265Upload25.01
libx264Platform63.09
libx265Platform50.43
libx264Video On Demand63.02
libx265Video On Demand50.40

git/aom-av1

TestScore, FPS
AV1 Video Encoding
122



/usr/bin/phoronix-test-suite system-info

Code Block
root@server6:/mnt/phoronix-test-suite-master# /usr/bin/phoronix-test-suite system-info

Phoronix Test Suite v10.8.5
System Information


PROCESSOR:
Code Block
root@server6:/mnt/phoronix-test-suite-master# /usr/bin/phoronix-test-suite system-info

Phoronix Test Suite v10.8.5
System Information


PROCESSOR:                Intel Core Ultra 9 185H @ 4.80GHz
    Core Count:           16
    Thread Count:   Intel Core Ultra 9 185H @ 224.80GHz
    Core ExtensionsCount:           SSE 416
    Thread Count:         22
    Extensions:           SSE 4.2 + AVX2 + AVX + RDRAND + FSGSBASE
    Cache Size:           24 MB
    Microcode:            0x20
    Core Family:          Meteor Lake
    Scaling Driver:       intel_pstate performance (EPP: default)

GRAPHICS:                 Intel Meteor Lake-P [Intel Arc ]
    Monitor:              HD USB
    Screen:               1920x1080

MOTHERBOARD:              Win Element S800
    BIOS Version:         5.32
    Chipset:              Intel Device 7e7f
    Audio:                Conexant SN6140
    Network:              Intel I225-V
                          + Realtek RTL8111/8168/8211/8411
                          + Intel Meteor Lake PCH CNVi WiFi

MEMORY:                   2 x 32 GB DDR5-4800MT/s Kingston KF548S38-32

DISK:                     ShiJi 128GB M.2-NVMe + 8002GB Western Digital WD_BLACK SN850X 8000GB
    File-System:          ext4
    Mount Options:        relatime rw
    Disk Scheduler:       NONE
    Disk Details:         Block Size: 4096

OPERATING SYSTEM:         Ubuntu 24.04
    Kernel:               6.11.0-25-generic (x86_64)
    Compiler:             GCC 13.3.0
    Security:             gather_data_sampling: Not affected
                          + itlb_multihit: Not affected
                          + l1tf: Not affected
                          + mds: Not affected
                          + meltdown: Not affected
                          + mmio_stale_data: Not affected
                          + reg_file_data_sampling: Not affected
                          + retbleed: Not affected
                          + spec_rstack_overflow: Not affected
                          + spec_store_bypass: Mitigation of SSB disabled via prctl
                          + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization
                          + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; RSB filling; PBRSB-eIBRS: Not affected; BHI: BHI_DIS_S
                          + srbds: Not affected
                          + tsx_async_abort: Not affected

...

Code Block
/usr/bin/phoronix-test-suite download-test-files pts/opencl
/usr/bin/phoronix-test-suite download-test-files pts/desktop-graphics
/usr/bin/phoronix-test-suite download-test-files pts/oneapi
/usr/bin/phoronix-test-suite download-test-files pts/disk
/usr/bin/phoronix-test-suite download-test-files pts/internet-speed
/usr/bin/phoronix-test-suite download-test-files pts/vulkan-compute
/usr/bin/phoronix-test-suite download-test-files pts/video-encoding




pts/ffmpeg

Code Block
/usr/bin/phoronix-test-suite run pts/ffmpeg

...

Code Block
root@server6:/mnt/phoronix-test-suite-master# /usr/bin/phoronix-test-suite run git/aom-av1

    [NOTICE] git/aom-av1-1.1.0 is not installed.
    Would you like to stop and install these tests now (Y/n): Y
    Evaluating External Test Dependencies ...............................................................................................................................................................................................

The following dependencies are needed and will be installed:

- p7zip-full
- yasm
- nasm

This process may take several minutes.
Scanning processes...
Scanning processor microcode...
Scanning linux images...
Reading package lists...
Building dependency tree...
Reading state information...
The following packages were automatically installed and are no longer required:
  libclang-cpp14t64 libigc1 libigdfcl1 libllvm14t64 libllvmspirvlib14
  libopencl-clang14
Use 'sudo apt autoremove' to remove them.
The following additional packages will be installed:
  7zip
Suggested packages:
  7zip-standalone 7zip-rar
The following NEW packages will be installed:
  7zip nasm p7zip-full yasm
0 upgraded, 4 newly installed, 0 to remove and 1 not upgraded.
Need to get 2,791 kB of archives.
After this operation, 11.9 MB of additional disk space will be used.
Get:1 http://ua.archive.ubuntu.com/ubuntu noble/universe amd64 7zip amd64 23.01+dfsg-11 [1,846 kB]
Get:2 http://ua.archive.ubuntu.com/ubuntu noble/universe amd64 nasm amd64 2.16.01-1build1 [459 kB]
Get:3 http://ua.archive.ubuntu.com/ubuntu noble/universe amd64 p7zip-full all 16.02+transitional.1 [2,500 B]
Get:4 http://ua.archive.ubuntu.com/ubuntu noble/universe amd64 yasm amd64 1.3.0-4 [483 kB]
Fetched 2,791 kB in 0s (14.4 MB/s)
Selecting previously unselected package 7zip.
(Reading database ... 132227 files and directories currently installed.)
Preparing to unpack .../7zip_23.01+dfsg-11_amd64.deb ...
Unpacking 7zip (23.01+dfsg-11) ...
Selecting previously unselected package nasm.
Preparing to unpack .../nasm_2.16.01-1build1_amd64.deb ...
Unpacking nasm (2.16.01-1build1) ...
Selecting previously unselected package p7zip-full.
Preparing to unpack .../p7zip-full_16.02+transitional.1_all.deb ...
Unpacking p7zip-full (16.02+transitional.1) ...
Selecting previously unselected package yasm.
Preparing to unpack .../yasm_1.3.0-4_amd64.deb ...
Unpacking yasm (1.3.0-4) ...
Setting up 7zip (23.01+dfsg-11) ...
Setting up yasm (1.3.0-4) ...
Setting up nasm (2.16.01-1build1) ...
Setting up p7zip-full (16.02+transitional.1) ...
Processing triggers for man-db (2.12.0-4build2) ...

Running kernel seems to be up-to-date.

The processor microcode seems to be up-to-date.

No services need to be restarted.

No containers need to be restarted.

No user sessions are running outdated binaries.

No VM guests are running outdated hypervisor (qemu) binaries on this host.

Phoronix Test Suite v10.8.5

    To Install:    git/aom-av1-1.1.0

    Determining File Requirements .......................................................................................................................................................................................................
    Searching Download Caches ...........................................................................................................................................................................................................

    1 Test To Install
        1 File In Cache [646MB]
        369MB Of Disk Space Is Needed
        3 Minutes, 40 Seconds Estimated Install Time

    git/aom-av1-1.1.0:
        Test Installation 1 of 1
        1 File Needed [646 MB]
        Copying From Cache: Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z                                                                                                                                                        [646MB]
        Approximate Install Size: 369 MB
        Estimated Test Install Time: 3 Minutes, 40 Seconds
        Installing Test @ 19:10:28


System Information


PROCESSOR:                Intel Core Ultra 9 185H @ 4.80GHz
    Core Count:           16
    Thread Count:         22
    Extensions:           SSE 4.2 + AVX2 + AVX + RDRAND + FSGSBASE
    Cache Size:           24 MB
    Microcode:            0x20
    Core Family:          Meteor Lake
    Scaling Driver:       intel_pstate performance (EPP: default)

GRAPHICS:                 Intel Meteor Lake-P [Intel Arc ]
    Monitor:              HD USB
    Screen:               1920x1080

MOTHERBOARD:              Win Element S800
    BIOS Version:         5.32
    Chipset:              Intel Device 7e7f
    Audio:                Conexant SN6140
    Network:              Intel I225-V
                          + Realtek RTL8111/8168/8211/8411
                          + Intel Meteor Lake PCH CNVi WiFi

MEMORY:                   2 x 32 GB DDR5-4800MT/s Kingston KF548S38-32

DISK:                     ShiJi 128GB M.2-NVMe + 8002GB Western Digital WD_BLACK SN850X 8000GB
    File-System:          ext4
    Mount Options:        relatime rw
    Disk Scheduler:       NONE
    Disk Details:         Block Size: 4096

OPERATING SYSTEM:         Ubuntu 24.04
    Kernel:               6.11.0-25-generic (x86_64)
    Compiler:             GCC 13.3.0
    Security:             gather_data_sampling: Not affected
                          + itlb_multihit: Not affected
                          + l1tf: Not affected
                          + mds: Not affected
                          + meltdown: Not affected
                          + mmio_stale_data: Not affected
                          + reg_file_data_sampling: Not affected
                          + retbleed: Not affected
                          + spec_rstack_overflow: Not affected
                          + spec_store_bypass: Mitigation of SSB disabled via prctl
                          + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization
                          + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; RSB filling; PBRSB-eIBRS: Not affected; BHI: BHI_DIS_S
                          + srbds: Not affected
                          + tsx_async_abort: Not affected

    Would you like to save these test results (Y/n): Y
    Enter a name for the result file: morefine-s800-185h-ddr5-4800-cl38-64gb
    Enter a unique name to describe this test run / configuration: morefine-s800-185h-ddr5-4800-cl38-64gb


If desired, enter a new description below to better describe this result set / system configuration under test.
Press ENTER to proceed without changes.

Current Description: Intel Core Ultra 9 185H testing with a Win Element S800 (5.32 BIOS) and Intel Meteor Lake-P [Intel Arc ] on Ubuntu 24.04 via the Phoronix Test Suite.

New Description:

AOM AV1 Git:
    git/aom-av1-1.1.0 [AV1 Video Encoding]
    Test 1 of 1
    Estimated Trial Run Count:    3
    Estimated Time To Completion: 1 Minute [19:14 UTC]
        Started Run 1 @ 19:13:26
        Started Run 2 @ 19:13:30
        Started Run 3 @ 19:13:34

    AV1 Video Encoding:
        122.25
        121.99
        121.03

    Average: 121.76 Frames Per Second
    Deviation: 0.53%

    Comparison of 49 OpenBenchmarking.org samples since 8 March 2019 to 29 December; median result: 0.08 Frames Per Second. Box plot of samples:
    [#---------------------------------------------------------------------------------------------------------------------*------------------------------------------------------------------------------------*-----------------------|   ]
                                                                                                                                                                             This Result (95th Percentile): 122 ^
                                                                                                        AMD EPYC 7313P: 71 ^

    Do you want to view the text results of the testing (Y/n): Y
morefine-s800-185h-ddr5-4800-cl38-64gb
Intel Core Ultra 9 185H testing with a Win Element S800 (5.32 BIOS) and Intel Meteor Lake-P [Intel Arc ] on Ubuntu 24.04 via the Phoronix Test Suite.


morefine-s800-185h-ddr5-4800-cl38-64gb:

        Processor: Intel Core Ultra 9 185H @ 4.80GHz (16 Cores / 22 Threads), Motherboard: Win Element S800 (5.32 BIOS), Chipset: Intel Device 7e7f, Memory: 2 x 32 GB DDR5-4800MT/s Kingston KF548S38-32, Disk: ShiJi 128GB M.2-NVMe + 8002GB Western Digital WD_BLACK SN850X 8000GB, Graphics: Intel Meteor Lake-P [Intel Arc ], Audio: Conexant SN6140, Monitor: HD USB, Network: Intel I225-V + Realtek RTL8111/8168/8211/8411 + Intel Meteor Lake PCH CNVi WiFi, npu: Intel NPU

        OS: Ubuntu 24.04, Kernel: 6.11.0-25-generic (x86_64), Compiler: GCC 13.3.0, File-System: ext4, Screen Resolution: 1920x1080


    AOM AV1 Git
    AV1 Video Encoding
    Frames Per Second > Higher Is Better
    morefine-s800-185h-ddr5-4800-cl38-64gb . 121.76 |==========================================================================================================================================================================================

    Would you like to upload the results to OpenBenchmarking.org (y/n): y
    Would you like to attach the system logs (lspci, dmesg, lsusb, etc) to the test result (y/n): y

    Results Uploaded To: https://openbenchmarking.org/result/2505123-NE-MOREFINES37=====================

    Would you like to upload the results to OpenBenchmarking.org (y/n): y
    Would you like to attach the system logs (lspci, dmesg, lsusb, etc) to the test result (y/n): y

    Results Uploaded To: https://openbenchmarking.org/result/2505123-NE-MOREFINES37

pts/llama-cpp-2.1.1

Code Block
root@server6:/mnt/phoronix-test-suite-master# /usr/bin/phoronix-test-suite run pts/llama-cpp-2.1.1

    [NOTICE] pts/llama-cpp-2.1.1 is not installed.
    Would you like to stop and install these tests now (Y/n): Y
    Evaluating External Test Dependencies ...............................................................................................................................................................................................
    Evaluating System Dependencies ......................................................................................................................................................................................................

Phoronix Test Suite v10.8.5

    To Install:    pts/llama-cpp-2.1.1

    Determining File Requirements .......................................................................................................................................................................................................
    Searching Download Caches ...........................................................................................................................................................................................................

    1 Test To Install
        4 Files To Download [18938MB]
        58700MB Of Disk Space Is Needed
        2 Minutes, 21 Seconds Estimated Install Time

    pts/llama-cpp-2.1.1:
        Test Installation 1 of 1
        4 Files Needed [18938 MB]
        Downloading: llama.cpp-b4397.tar.gz                                                                                                                                                                                     [19.65MB]
        Downloading .....................................................................................................................................................................................................................
        Downloading: Llama-3.1-Tulu-3-8B-Q8_0.gguf                                                                                                                                                                               [8146MB]
        Estimated Download Time: 28m ....................................................................................................................................................................................................
        Downloading: granite-3.0-3b-a800m-instruct-Q8_0.gguf                                                                                                                                                                     [3427MB]
        Estimated Download Time: 2m .....................................................................................................................................................................................................
        Downloading: Mistral-7B-Instruct-v0.3-Q8_0.gguf                                                                                                                                                                          [7346MB]
        Estimated Download Time: 2m .....................................................................................................................................................................................................
        Approximate Install Size: 58700 MB
        Estimated Test Install Time: 2 Minutes, 21 Seconds
        Installing Test @ 20:28:14



Llama.cpp b4397:
    pts/llama-cpp-2.1.1
    System Test Configuration
        1: Llama-3.1-Tulu-3-8B-Q8_0
        2: granite-3.0-3b-a800m-instruct-Q8_0
        3: Mistral-7B-Instruct-v0.3-Q8_0
        4: Test All Options
        ** Multiple items can be selected, delimit by a comma. **
        Model: 4


        1: Text Generation 128
        2: Prompt Processing 512
        3: Prompt Processing 1024
        4: Prompt Processing 2048
        5: Test All Options
        ** Multiple items can be selected, delimit by a comma. **
        Test: 1,2,3


System Information


PROCESSOR:                Intel Core Ultra 9 185H @ 4.80GHz
    Core Count:           16
    Thread Count:         22
    Extensions:           SSE 4.2 + AVX2 + AVX + RDRAND + FSGSBASE
    Cache Size:           24 MB
    Microcode:            0x20
    Core Family:          Meteor Lake
    Scaling Driver:       intel_pstate performance (EPP: default)

GRAPHICS:                 Intel Meteor Lake-P [Intel Arc ]
    Monitor:              HD USB
    Screen:               1920x1080

MOTHERBOARD:              Win Element S800
    BIOS Version:         5.32
    Chipset:              Intel Device 7e7f
    Audio:                Conexant SN6140
    Network:              Intel I225-V
                          + Realtek RTL8111/8168/8211/8411
                          + Intel Meteor Lake PCH CNVi WiFi

MEMORY:                   2 x 32 GB DDR5-4800MT/s Kingston KF548S38-32

DISK:                     ShiJi 128GB M.2-NVMe + 8002GB Western Digital WD_BLACK SN850X 8000GB
    File-System:          xfs
    Mount Options:        relatime rw
    Disk Scheduler:       NONE
    Disk Details:         Block Size: 4096

OPERATING SYSTEM:         Ubuntu 24.04
    Kernel:               6.11.0-25-generic (x86_64)
    Compiler:             GCC 13.3.0
    Security:             gather_data_sampling: Not affected
                          + itlb_multihit: Not affected
                          + l1tf: Not affected
                          + mds: Not affected
                          + meltdown: Not affected
                          + mmio_stale_data: Not affected
                          + reg_file_data_sampling: Not affected
                          + retbleed: Not affected
                          + spec_rstack_overflow: Not affected
                          + spec_store_bypass: Mitigation of SSB disabled via prctl
                          + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization
                          + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; RSB filling; PBRSB-eIBRS: Not affected; BHI: BHI_DIS_S
                          + srbds: Not affected
                          + tsx_async_abort: Not affected

    Would you like to save these test results (Y/n): Y

    Recently Saved Test Results:
       morefine-s800-185h-ddr5-4800-cl38-64gb-ff   [Today]
       morefine-s800-185h-ddr5-4800-cl38-64gb      [Today]

    Enter a name for the result file: morefine-s800-185h-ddr5-4800-cl38-64gb-llama-cpp
    Enter a unique name to describe this test run / configuration: morefine-s800-185h-ddr5-4800-cl38-64gb


If desired, enter a new description below to better describe this result set / system configuration under test.
Press ENTER to proceed without changes.

Current Description: Intel Core Ultra 9 185H testing with a Win Element S800 (5.32 BIOS) and Intel Meteor Lake-P [Intel Arc ] on Ubuntu 24.04 via the Phoronix Test Suite.

New Description:

Llama.cpp b4397:
    pts/llama-cpp-2.1.1 [Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128]
    Test 1 of 9
    Estimated Trial Run Count:    3
    Estimated Test Run-Time:      6 Minutes
    Estimated Time To Completion: 46 Minutes [21:15 UTC]
        Started Run 1 @ 20:30:26
        Started Run 2 @ 20:32:10
        Started Run 3 @ 20:33:54

    Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128:
        6.46
        6.44
        6.46

    Average: 6.45 Tokens Per Second
    Deviation: 0.18%

    Comparison of 327 OpenBenchmarking.org samples since 6 December; median result: 9.15 Tokens Per Second. Box plot of samples:
    [        |--------------------*--########*!#*####*######################*#----------------------------------------------------------*---*---*---*-------------------*------------------------------------------------|           *      ]
                                  ^ This Result (12th Percentile): 6.45
                                        AMD Ryzen Threadripper 7980X: 15.76 ^                                  2 x AMD EPYC 9684X: 28.9 ^      2 x AMD EPYC 9255: 35.76 ^                                      AMD EPYC 9575F: 49.07 ^
                         Intel Core i9-10980XE: 10.6 ^                                                                         AMD EPYC 9845: 31.57 ^
                   Intel Core Ultra 5 245K: 9.6 ^                                                                     2 x AMD EPYC 9175F: 30.69 ^
               Intel Core Ultra 9 285K: 8.93 ^                                                                         AMD EPYC 9754: 29.65 ^

Llama.cpp b4397:
    pts/llama-cpp-2.1.1 [Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512]
    Test 2 of 9
    Estimated Trial Run Count:    3
    Estimated Test Run-Time:      6 Minutes
    Estimated Time To Completion: 41 Minutes [21:15 UTC]
        Started Run 1 @ 20:35:46
        Started Run 2 @ 20:38:02
        Started Run 3 @ 20:40:22

    Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512:
        23.18
        22.73
        23.08

    Average: 23.00 Tokens Per Second
    Deviation: 1.03%

    Comparison of 307 OpenBenchmarking.org samples since 6 December; median result: 69.72 Tokens Per Second. Box plot of samples:
    [                       |----------*-------*---------##*########*##*#####################*##########*######!*####################*##########----*----------------*-----*-----------------------------*------------|                   * ]
                                       ^ This Result (7th Percentile): 23.00
                                        Intel Core Ultra 5 245K: 43.81 ^          AMD Ryzen 5 9600X: 65 ^                                   AMD Ryzen 9 9950X3D: 105 ^                AMD EPYC 9845: 128 ^         2 x AMD EPYC 9365: 150 ^
                                          AMD Ryzen 7 7840HS: 41.64 ^                                                         AMD Ryzen 9 9950X: 94 ^  AMD EPYC 9655P: 109 ^
                              AMD Ryzen AI 9 HX 370: 35.88 ^           AMD EPYC 4364P: 58.17 ^                 AMD Ryzen 9 9900X: 84 ^
                Intel Core Ultra 7 256V: 27.83 ^                               AMD Ryzen Threadripper 7980X: 70 ^

Llama.cpp b4397:
    pts/llama-cpp-2.1.1 [Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024]
    Test 3 of 9
    Estimated Trial Run Count:    3
    Estimated Test Run-Time:      6 Minutes
    Estimated Time To Completion: 41 Minutes [21:23 UTC]
        Started Run 1 @ 20:42:47
        Started Run 2 @ 20:47:20