Versions Compared

Old Version 2

changes.mady.by.user Oleksandr Liutyi

Saved on

compared with

New Version Current

changes.mady.by.user Oleksandr Liutyi

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

CPU: Intel Core Ultra 9 185H,

RAM: 64GB DDR5 4800,

DISK: WD_BLACK SN850X 8TB (Gen4x4 inserted in Gen4x4 slot), 

OS: Ubuntu 24.04 LTS

Power Limits: ?/? (BIOS: Performance mode)

Disk LBA: 512K 

Table for comparison with other Servers

Disk LBA (bytes): 512 (b - btrfs, e - ext4, x - xfs) and 4096 (b4, e4)



SequentalRandom
Read (MiB/s)Write (MiB/s)Read (MiB/s)Write (MiB/s)
devicedisk typebs = 1Mbs = 4Kbs = 1Mbs = 4Kbs = 1Mbs = 4Kbs = 1Mbs = 4K
R100N
U185H(b)1xNVMe
1302
2964184
123
3442
1047
185
104
3087
1211
172
49.1
3408
1056103R100S1xSSD40557.434749.932120.034148.5N200N1xNVMe129389.91212202125574.01152193I1071N1xNVMe27202782691280246275.02414216I1355N1xNVMe175628916.0 2.5134857.415.92.6DS220+2xHDD17962.716820.918261.51699.6U185H(b)1xNVMe2964184344218530871723408165 U185H(e)1xNVMe        

For disk performance comparison next system were use,

...

165
U185H(b4)1xNVMe2924182342218229701753394187
U185H(e)1xNVMe4521243410437518581274205376
U185H(e4)1xNVMe4894242422337718191284175375
U185H(x)1xNVMe4692244408437617611284192376

Table for comparison with other Servers



SequentalRandom
Read (MiB/s)Write (MiB/s)Read (MiB/s)Write (MiB/s)
devicedisk typebs = 1Mbs = 4Kbs = 1Mbs = 4Kbs = 1Mbs = 4Kbs = 1Mbs = 4K
R100N1xNVMe13021231047104121149.11056103
R100S1xSSD40557.434749.932120.034148.5
N200N1xNVMe129389.91212202125574.01152193
I1071N1xNVMe27202782691280246275.02414216
I1355N1xNVMe175628916.0 2.5134857.415.92.6
DS220+2xHDD17962.716820.918261.51699.6

For disk performance comparison, the next systems were used:

codeHardwareDiskspace used,%Power On, hoursLife Time Remain, %
R100NIntel N100, 16GB DDR4, Ubuntu 24.04, CasaOS, ext4Movespeed YSSDHB-4TN7000 4TB NVMe84822100
R100SIntel N100, 16GB DDR4, Ubuntu 24.04, CasaOS, ext4Transcend SSD230S 4 TB SATA SSD491522100
N200NIntel N200, 32GB DDR5, Ubuntu 24.04, ext4Fanxiang S500PRO 2TB978343100
I1071NIntel Core i7-10710U, 64GB DDR4, Ubuntu 24.0Lexar SSD ARES 4TB741223899
I1355NIntel Core i7-1355U (15W), 96GB DDR5, Ubuntu 24.04XPG GAMMIX S70 BLADE 8TB856823100
DS220+Synology DS220+, J4025, 2GB, RAID1WD Gold Enterprise Class 18 TB 7200 RPM(2 in RAID1)7737877N/A
U185HIntel Core Ultra 9 185H, 64GB DDR5, Ubuntu 24.04, (b)trfs, (e)xt4WD_BLACK SN850X 8000GB0%67100

1 Year is 8766 hours (37877 hours = 4.3 Years)


Commands used to test disk speed

Code Block
cd /mnt/pool/shared/user
# each command executed 3 times
# 1M
fio --ioengine=libaio --direct=1 --name=test --filename=test0 --bs=1M --size=4G --readwrite=write --ramp_time=4 # Col 3
fio --ioengine=libaio --direct=1 --name=test --filename=test0 --bs=1M --size=4G --readwrite=read --ramp_time=4 # Col 1
fio --randrepeat=1 --ioengine=libaio --direct=1 --name=test1 --filename=test2 --bs=1M --size=4G --readwrite=randwrite --ramp_time=4  # Col  7
fio --randrepeat=1 --ioengine=libaio --direct=1 --name=test1 --filename=test2 --bs=1M --size=4G --readwrite=randread --ramp_time=4 # Col 5
# 4K
fio --ioengine=libaio --direct=1 --name=test --filename=test0 --bs=4K --size=4G --readwrite=write --ramp_time=4 # Col 4
fio --ioengine=libaio --direct=1 --name=test --filename=test0 --bs=4K --size=4G --readwrite=read --ramp_time=4 # Col 2
fio --randrepeat=1 --ioengine=libaio --direct=1 --name=test1 --filename=test2 --bs=4k --size=4G --readwrite=randwrite --ramp_time=4 # Col 8
fio --randrepeat=1 --ioengine=libaio --direct=1 --name=test1 --filename=test2 --bs=4k --size=4G --readwrite=randread --ramp_time=4 # Col 6

Smart before tests

Code Block
root@server6:~# smartctl -a /dev/nvme1
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.11.0-25-generic] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Number:                       WD_BLACK SN850X 8000GB
Serial Number:                      2448C94A0B05
Firmware Version:                   638201WD
PCI Vendor/Subsystem ID:            0x15b7
IEEE OUI Identifier:                0x001b44
Total NVM Capacity:                 8,001,563,222,016 [8.00 TB]
Unallocated NVM Capacity:           0
Controller ID:                      1
NVMe Version:                       2.0
Number of Namespaces:               1
Namespace 1 Size/Capacity:          8,001,563,222,016 [8.00 TB]
Namespace 1 Formatted LBA Size:     512
Namespace 1 IEEE EUI-64:            001b44 4a41227a24
Local Time is:                      Mon May 12 11:58:48 2025 UTC
Firmware Updates (0x14):            2 Slots, no Reset required
Optional Admin Commands (0x0017):   Security Format Frmw_DL Self_Test
Optional NVM Commands (0x00df):     Comp Wr_Unc DS_Mngmt Wr_Zero Sav/Sel_Feat Timestmp Verify
Log Page Attributes (0x3e):         Cmd_Eff_Lg Ext_Get_Lg Telmtry_Lg Pers_Ev_Lg Log0_FISE_MI
Maximum Data Transfer Size:         128 Pages
Warning  Comp. Temp. Threshold:     90 Celsius
Critical Comp. Temp. Threshold:     94 Celsius
Namespace 1 Features (0x92):        NA_Fields NP_Fields *Other*

Supported Power States
St Op     Max   Active     Idle   RL RT WL WT  Ent_Lat  Ex_Lat
 0 +     8.25W    8.25W       -    0  0  0  0        0       0
 1 +     4.00W    4.00W       -    0  0  0  0        0       0
 2 +     3.40W    3.40W       -    0  0  0  0        0       0
 3 -   0.0300W       -        -    3  3  3  3     5000   11000
 4 -   0.0035W       -        -    4  4  4  4     6000   52000

Supported LBA Sizes (NSID 0x1)
Id Fmt  Data  Metadt  Rel_Perf
 0 +     512       0         2
 1 -    4096       0         1

=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

SMART/Health Information (NVMe Log 0x02)
Critical Warning:                   0x00
Temperature:                        55 Celsius
Available Spare:                    100%
Available Spare Threshold:          10%
Percentage Used:                    0%
Data Units Read:                    5,663,193 [2.89 TB]
Data Units Written:                 5,674,927 [2.90 TB]
Host Read Commands:                 41,760,032
Host Write Commands:                44,852,550
Controller Busy Time:               32
Power Cycles:                       109
Power On Hours:                     67
Unsafe Shutdowns:                   64
Media and Data Integrity Errors:    0
Error Information Log Entries:      1
Warning  Comp. Temperature Time:    0
Critical Comp. Temperature Time:    0
Temperature Sensor 1:               68 Celsius
Temperature Sensor 2:               48 Celsius
Temperature Sensor 3:               46 Celsius

Error Information (NVMe Log 0x01, 16 of 256 entries)
No Errors Logged

Self-test Log (NVMe Log 0x06)
Self-test status: No self-test in progress
Num  Test_Description  Status                       Power_on_Hours  Failing_LBA  NSID Seg SCT Code
 0   Short             Completed without error                   2            -     -   -   -    -
 1   Extended          Aborted: Self-test command                1            -     -   -   -    -
 2   Short             Completed without error                   0            -     -   -   -    -


Change LBA Format for NVMe

check before

Code Block
root@server6:/mnt# nvme id-ns -H /dev/nvme0n1 | grep "Relative Performance"
LBA Format  0 : Metadata Size: 0   bytes - Data Size: 512 bytes - Relative Performance: 0 Best (in use)

root@server6:/mnt# nvme id-ns -H /dev/nvme1n1 | grep "Relative Performance"
LBA Format  0 : Metadata Size: 0   bytes - Data Size: 512 bytes - Relative Performance: 0x2 Good (in use)
LBA Format  1 : Metadata Size: 0   bytes - Data Size: 4096 bytes - Relative Performance: 0x1 Better

root@server6:/mnt# lsblk -td
NAME    ALIGNMENT MIN-IO OPT-IO PHY-SEC LOG-SEC ROTA SCHED RQ-SIZE  RA WSAME
nvme1n1         0  32768 262144     512     512    0 none     1023 512    0B
nvme0n1         0    512      0     512     512    0 none      255 128    0B

change LBA size

Code Block
nvme format --lbaf=1 /dev/nvme1n1


check after 

Code Block
root@server6:/# lsblk -td
NAME    ALIGNMENT MIN-IO OPT-IO PHY-SEC LOG-SEC ROTA SCHED RQ-SIZE  RA WSAME
nvme1n1         0  32768 262144    4096    4096    0 none     1023 512    0B
nvme0n1         0    512      0     512     512    0 none      255 128    0B

root@server6:/# nvme id-ns -H /dev/nvme1n1 | grep "Relative Performance"
LBA Format  0 : Metadata Size: 0   bytes - Data Size: 512 bytes - Relative Performance: 0x2 Good
LBA Format  1 : Metadata Size: 0   bytes - Data Size: 4096 bytes - Relative Performance: 0x1 Better (in use)
Code Block
root@server6:/# smartctl -a /dev/nvme1n1

1 Year is 8766 hours (37877 hours = 4.3 Years)

Commands used to test disk speed

Code Block
cd /mnt/pool/shared/user
# each command executed 3 times
# 1M
fio --ioengine=libaio --direct=1 --name=test --filename=test0 --bs=1M --size=4G --readwrite=write --ramp_time=4 # Col 3
fio --ioengine=libaio --direct=1 --name=test --filename=test0 --bs=1M --size=4G --readwrite=read --ramp_time=4 # Col 1
fio --randrepeat=1 --ioengine=libaio --direct=1 --name=test1 --filename=test2 --bs=1M --size=4G --readwrite=randwrite --ramp_time=4  # Col  7
fio --randrepeat=1 --ioengine=libaio --direct=1 --name=test1 --filename=test2 --bs=1M --size=4G --readwrite=randread --ramp_time=4 # Col 5
# 4K
fio --ioengine=libaio --direct=1 --name=test --filename=test0 --bs=4K --size=4G --readwrite=write --ramp_time=4 # Col 4
fio --ioengine=libaio --direct=1 --name=test --filename=test0 --bs=4K --size=4G --readwrite=read --ramp_time=4 # Col 2
fio --randrepeat=1 --ioengine=libaio --direct=1 --name=test1 --filename=test2 --bs=4k --size=4G --readwrite=randwrite --ramp_time=4 # Col 8
fio --randrepeat=1 --ioengine=libaio --direct=1 --name=test1 --filename=test2 --bs=4k --size=4G --readwrite=randread --ramp_time=4 # Col 6

Smart before tests

Code Block
root@server6:~# smartctl -a /dev/nvme1
smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.11.0-25-generic] (local build)
Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Number:                       WD_BLACK SN850X 8000GB
Serial Number:                      2448C94A0B05
Firmware Version:                   638201WD
PCI Vendor/Subsystem ID:            0x15b7
IEEE OUI Identifier:                0x001b44
Total NVM Capacity:                 8,001,563,222,016 [8.00 TB]
Unallocated NVM Capacity:           0
Controller ID:                      1
NVMe Version:                       2.0
Number of Namespaces:               1
Namespace 1 Size/Capacity:          8,001,563,222,016 [8.00 TB]
Namespace 1 Formatted LBA Size:     5124096
Namespace 1 IEEE EUI-64:            001b44 4a41227a24
Local Time is:                      Mon May 12 1112:5833:4816 2025 UTC
Firmware Updates (0x14):            2 Slots, no Reset required
Optional Admin Commands (0x0017):   Security Format Frmw_DL Self_Test
Optional NVM Commands (0x00df):     Comp Wr_Unc DS_Mngmt Wr_Zero Sav/Sel_Feat Timestmp Verify
Log Page Attributes (0x3e):         Cmd_Eff_Lg Ext_Get_Lg Telmtry_Lg Pers_Ev_Lg Log0_FISE_MI
Maximum Data Transfer Size:         128 Pages
Warning  Comp. Temp. Threshold:     90 Celsius
Critical Comp. Temp. Threshold:     94 Celsius
Namespace 1 Features (0x92):        NA_Fields NP_Fields *Other*

Supported Power States
St Op     Max   Active     Idle   RL RT WL WT  Ent_Lat  Ex_Lat
 0 +     8.25W    8.25W       -    0  0  0  0        0       0
 1 +     4.00W    4.00W       -    0  0  0  0        0       0
 2 +     3.40W    3.40W       -    0  0  0  0        0       0
 3 -   0.0300W       -        -    3  3  3  3     5000   11000
 4 -   0.0035W       -        -    4  4  4  4     6000   52000

Supported LBA Sizes (NSID 0x1)
Id Fmt  Data  Metadt  Rel_Perf
 0 +-     512       0         2
 1 -+    4096       0         1

=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

SMART/Health Information (NVMe Log 0x02)
Critical Warning:/Health Information (NVMe Log 0x02)
Critical Warning:                   0x00
Temperature:                        56 Celsius
Available Spare:                    0x00
Temperature100%
Available Spare Threshold:          10%
Percentage Used:                   55 Celsius0%
AvailableData Units SpareRead:                    5,856,186  100%
Available Spare Threshold:[2.99 TB]
Data Units Written:             10%
Percentage Used:   5,881,473 [3.01 TB]
Host Read Commands:             0%
Data Units Read:  53,692,552
Host Write Commands:                557,663,193 [2.89 TB]
Data Units Written989,341
Controller Busy Time:               35
Power  5,674,927 [2.90 TB]
Host Read Commands:Cycles:                       41,760,032
Host Write Commands109
Power On Hours:                44,852,550
Controller Busy Time:        67
Unsafe Shutdowns:            32
Power Cycles:      64
Media and Data Integrity Errors:    0
Error Information Log Entries:      1091
PowerWarning On Hours:Comp. Temperature Time:    0
Critical Comp. Temperature Time:    0
Temperature Sensor 1:      67
Unsafe Shutdowns:        69 Celsius
Temperature Sensor 2:        64
Media and Data Integrity Errors:   48 0Celsius
ErrorTemperature InformationSensor Log Entries3:      1
Warning  Comp. Temperature Time:    0
Critical Comp. Temperature Time:    0
Temperature Sensor 1:               68 Celsius
Temperature Sensor 2:               48 Celsius
Temperature Sensor 3:               46 Celsius

Error Information (NVMe Log 0x01, 16 of 256 entries)
No Errors Logged

Self-test Log (NVMe Log 0x06)
Self-test status: No self-test in progress
Num  Test_Description  Status                47 Celsius

Error Information (NVMe Log 0x01, 16 of 256 entries)
No Errors Logged

Read Self-test Log failed: Invalid Field in Command (0x4002)


btrfs format with default settings

Code Block
root@server6:/# mkfs.btrfs /dev/nvme1n1p1
btrfs-progs v6.6.3
See https://btrfs.readthedocs.io for more information.

Performing full device TRIM /dev/nvme1n1p1 (7.28TiB) ...
NOTE: several default settings have changed in version 5.15, please make sure
      this does not affect your deployments:
      - DUP for metadata (-m dup)
      - enabled no-holes (-O no-holes)
      - enabled free-space-tree (-R free-space-tree)

Label:       Power_on_Hours  Failing_LBA  NSID Seg SCT Code
 0(null)
UUID:   Short             Completed without error9f33fe81-41f1-46e3-a334-f06e4f5d4ee9
Node size:          16384
Sector size:        4096
Filesystem 2size:    7.28TiB
Block group profiles:
  Data:    -     -   - single  -    -
 1   Extended  8.00MiB
  Metadata:      Aborted: Self-test command DUP               1.00GiB
  System:           -DUP     -   -   -    -
 28.00MiB
SSD detected:    Short   yes
Zoned device:       no
Incompat features: Completed without error      extref, skinny-metadata, no-holes, free-space-tree
Runtime features:   free-space-tree
Checksum:           crc32c
Number of 0devices:  1
Devices:
   ID       - SIZE  PATH
  -  1 -   - 7.28TiB   -/dev/nvme1n1p1


Table of Contents