HW Setup
Morefine S800
CPU: Intel Core Ultra 9 185H
RAM: 64GB DDR5 4800
DISK: WD_BLACK SN850X 8TB (Gen4x4 inserted in Gen4x4 slot)
OS: Ubuntu 24.04 LTS
Disk LBA (bytes): 512 (b - btrfs, e - ext4, x - xfs) and 4096 (b4, e4)
Table for comparison with other Servers
| Sequental | Random | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Read (MiB/s) | Write (MiB/s) | Read (MiB/s) | Write (MiB/s) | ||||||
| device | disk type | bs = 1M | bs = 4K | bs = 1M | bs = 4K | bs = 1M | bs = 4K | bs = 1M | bs = 4K |
| R100N | 1xNVMe | 1302 | 123 | 1047 | 104 | 1211 | 49.1 | 1056 | 103 |
| R100S | 1xSSD | 405 | 57.4 | 347 | 49.9 | 321 | 20.0 | 341 | 48.5 |
| N200N | 1xNVMe | 1293 | 89.9 | 1212 | 202 | 1255 | 74.0 | 1152 | 193 |
| I1071N | 1xNVMe | 2720 | 278 | 2691 | 280 | 2462 | 75.0 | 2414 | 216 |
| I1355N | 1xNVMe | 1756 | 289 | 16.0 | 2.5 | 1348 | 57.4 | 15.9 | 2.6 |
| DS220+ | 2xHDD | 179 | 62.7 | 168 | 20.9 | 182 | 61.5 | 169 | 9.6 |
| U185H(b) | 1xNVMe | 2964 | 184 | 3442 | 185 | 3087 | 172 | 3408 | 165 |
| U185H(b4) | 1xNVMe | 2924 | 182 | 3422 | 182 | 2970 | 175 | 3394 | 187 |
| U185H(e) | 1xNVMe | 4521 | 243 | 4104 | 375 | 1858 | 127 | 4205 | 376 |
| U185H(e4) | 1xNVMe | 4894 | 242 | 4223 | 377 | 1819 | 128 | 4175 | 375 |
| U185H(x) | 1xNVMe | 4692 | 244 | 4084 | 376 | 1761 | 128 | 4192 | 376 |
For disk performance comparison, the next systems were used:
| code | Hardware | Disk | space used,% | Power On, hours | Life Time Remain, % |
|---|---|---|---|---|---|
| R100N | Intel N100, 16GB DDR4, Ubuntu 24.04, CasaOS, ext4 | Movespeed YSSDHB-4TN7000 4TB NVMe | 8 | 4822 | 100 |
| R100S | Intel N100, 16GB DDR4, Ubuntu 24.04, CasaOS, ext4 | Transcend SSD230S 4 TB SATA SSD | 49 | 1522 | 100 |
| N200N | Intel N200, 32GB DDR5, Ubuntu 24.04, ext4 | Fanxiang S500PRO 2TB | 97 | 8343 | 100 |
| I1071N | Intel Core i7-10710U, 64GB DDR4, Ubuntu 24.0 | Lexar SSD ARES 4TB | 74 | 12238 | 99 |
| I1355N | Intel Core i7-1355U (15W), 96GB DDR5, Ubuntu 24.04 | XPG GAMMIX S70 BLADE 8TB | 85 | 6823 | 100 |
| DS220+ | Synology DS220+, J4025, 2GB, RAID1 | WD Gold Enterprise Class 18 TB 7200 RPM(2 in RAID1) | 77 | 37877 | N/A |
| U185H | Intel Core Ultra 9 185H, 64GB DDR5, Ubuntu 24.04, (b)trfs, (e)xt4 | WD_BLACK SN850X 8000GB | 0% | 67 | 100 |
1 Year is 8766 hours (37877 hours = 4.3 Years)
Commands used to test disk speed
cd /mnt/pool/shared/user # each command executed 3 times # 1M fio --ioengine=libaio --direct=1 --name=test --filename=test0 --bs=1M --size=4G --readwrite=write --ramp_time=4 # Col 3 fio --ioengine=libaio --direct=1 --name=test --filename=test0 --bs=1M --size=4G --readwrite=read --ramp_time=4 # Col 1 fio --randrepeat=1 --ioengine=libaio --direct=1 --name=test1 --filename=test2 --bs=1M --size=4G --readwrite=randwrite --ramp_time=4 # Col 7 fio --randrepeat=1 --ioengine=libaio --direct=1 --name=test1 --filename=test2 --bs=1M --size=4G --readwrite=randread --ramp_time=4 # Col 5 # 4K fio --ioengine=libaio --direct=1 --name=test --filename=test0 --bs=4K --size=4G --readwrite=write --ramp_time=4 # Col 4 fio --ioengine=libaio --direct=1 --name=test --filename=test0 --bs=4K --size=4G --readwrite=read --ramp_time=4 # Col 2 fio --randrepeat=1 --ioengine=libaio --direct=1 --name=test1 --filename=test2 --bs=4k --size=4G --readwrite=randwrite --ramp_time=4 # Col 8 fio --randrepeat=1 --ioengine=libaio --direct=1 --name=test1 --filename=test2 --bs=4k --size=4G --readwrite=randread --ramp_time=4 # Col 6
Smart before tests
root@server6:~# smartctl -a /dev/nvme1 smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.11.0-25-generic] (local build) Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Number: WD_BLACK SN850X 8000GB Serial Number: 2448C94A0B05 Firmware Version: 638201WD PCI Vendor/Subsystem ID: 0x15b7 IEEE OUI Identifier: 0x001b44 Total NVM Capacity: 8,001,563,222,016 [8.00 TB] Unallocated NVM Capacity: 0 Controller ID: 1 NVMe Version: 2.0 Number of Namespaces: 1 Namespace 1 Size/Capacity: 8,001,563,222,016 [8.00 TB] Namespace 1 Formatted LBA Size: 512 Namespace 1 IEEE EUI-64: 001b44 4a41227a24 Local Time is: Mon May 12 11:58:48 2025 UTC Firmware Updates (0x14): 2 Slots, no Reset required Optional Admin Commands (0x0017): Security Format Frmw_DL Self_Test Optional NVM Commands (0x00df): Comp Wr_Unc DS_Mngmt Wr_Zero Sav/Sel_Feat Timestmp Verify Log Page Attributes (0x3e): Cmd_Eff_Lg Ext_Get_Lg Telmtry_Lg Pers_Ev_Lg Log0_FISE_MI Maximum Data Transfer Size: 128 Pages Warning Comp. Temp. Threshold: 90 Celsius Critical Comp. Temp. Threshold: 94 Celsius Namespace 1 Features (0x92): NA_Fields NP_Fields *Other* Supported Power States St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat 0 + 8.25W 8.25W - 0 0 0 0 0 0 1 + 4.00W 4.00W - 0 0 0 0 0 0 2 + 3.40W 3.40W - 0 0 0 0 0 0 3 - 0.0300W - - 3 3 3 3 5000 11000 4 - 0.0035W - - 4 4 4 4 6000 52000 Supported LBA Sizes (NSID 0x1) Id Fmt Data Metadt Rel_Perf 0 + 512 0 2 1 - 4096 0 1 === START OF SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED SMART/Health Information (NVMe Log 0x02) Critical Warning: 0x00 Temperature: 55 Celsius Available Spare: 100% Available Spare Threshold: 10% Percentage Used: 0% Data Units Read: 5,663,193 [2.89 TB] Data Units Written: 5,674,927 [2.90 TB] Host Read Commands: 41,760,032 Host Write Commands: 44,852,550 Controller Busy Time: 32 Power Cycles: 109 Power On Hours: 67 Unsafe Shutdowns: 64 Media and Data Integrity Errors: 0 Error Information Log Entries: 1 Warning Comp. Temperature Time: 0 Critical Comp. Temperature Time: 0 Temperature Sensor 1: 68 Celsius Temperature Sensor 2: 48 Celsius Temperature Sensor 3: 46 Celsius Error Information (NVMe Log 0x01, 16 of 256 entries) No Errors Logged Self-test Log (NVMe Log 0x06) Self-test status: No self-test in progress Num Test_Description Status Power_on_Hours Failing_LBA NSID Seg SCT Code 0 Short Completed without error 2 - - - - - 1 Extended Aborted: Self-test command 1 - - - - - 2 Short Completed without error 0 - - - - -
Change LBA Format for NVMe
check before
root@server6:/mnt# nvme id-ns -H /dev/nvme0n1 | grep "Relative Performance" LBA Format 0 : Metadata Size: 0 bytes - Data Size: 512 bytes - Relative Performance: 0 Best (in use) root@server6:/mnt# nvme id-ns -H /dev/nvme1n1 | grep "Relative Performance" LBA Format 0 : Metadata Size: 0 bytes - Data Size: 512 bytes - Relative Performance: 0x2 Good (in use) LBA Format 1 : Metadata Size: 0 bytes - Data Size: 4096 bytes - Relative Performance: 0x1 Better root@server6:/mnt# lsblk -td NAME ALIGNMENT MIN-IO OPT-IO PHY-SEC LOG-SEC ROTA SCHED RQ-SIZE RA WSAME nvme1n1 0 32768 262144 512 512 0 none 1023 512 0B nvme0n1 0 512 0 512 512 0 none 255 128 0B
change LBA size
nvme format --lbaf=1 /dev/nvme1n1
check after
root@server6:/# lsblk -td NAME ALIGNMENT MIN-IO OPT-IO PHY-SEC LOG-SEC ROTA SCHED RQ-SIZE RA WSAME nvme1n1 0 32768 262144 4096 4096 0 none 1023 512 0B nvme0n1 0 512 0 512 512 0 none 255 128 0B root@server6:/# nvme id-ns -H /dev/nvme1n1 | grep "Relative Performance" LBA Format 0 : Metadata Size: 0 bytes - Data Size: 512 bytes - Relative Performance: 0x2 Good LBA Format 1 : Metadata Size: 0 bytes - Data Size: 4096 bytes - Relative Performance: 0x1 Better (in use)
root@server6:/# smartctl -a /dev/nvme1n1 smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.11.0-25-generic] (local build) Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Number: WD_BLACK SN850X 8000GB Serial Number: 2448C94A0B05 Firmware Version: 638201WD PCI Vendor/Subsystem ID: 0x15b7 IEEE OUI Identifier: 0x001b44 Total NVM Capacity: 8,001,563,222,016 [8.00 TB] Unallocated NVM Capacity: 0 Controller ID: 1 NVMe Version: 2.0 Number of Namespaces: 1 Namespace 1 Size/Capacity: 8,001,563,222,016 [8.00 TB] Namespace 1 Formatted LBA Size: 4096 Namespace 1 IEEE EUI-64: 001b44 4a41227a24 Local Time is: Mon May 12 12:33:16 2025 UTC Firmware Updates (0x14): 2 Slots, no Reset required Optional Admin Commands (0x0017): Security Format Frmw_DL Self_Test Optional NVM Commands (0x00df): Comp Wr_Unc DS_Mngmt Wr_Zero Sav/Sel_Feat Timestmp Verify Log Page Attributes (0x3e): Cmd_Eff_Lg Ext_Get_Lg Telmtry_Lg Pers_Ev_Lg Log0_FISE_MI Maximum Data Transfer Size: 128 Pages Warning Comp. Temp. Threshold: 90 Celsius Critical Comp. Temp. Threshold: 94 Celsius Namespace 1 Features (0x92): NA_Fields NP_Fields *Other* Supported Power States St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat 0 + 8.25W 8.25W - 0 0 0 0 0 0 1 + 4.00W 4.00W - 0 0 0 0 0 0 2 + 3.40W 3.40W - 0 0 0 0 0 0 3 - 0.0300W - - 3 3 3 3 5000 11000 4 - 0.0035W - - 4 4 4 4 6000 52000 Supported LBA Sizes (NSID 0x1) Id Fmt Data Metadt Rel_Perf 0 - 512 0 2 1 + 4096 0 1 === START OF SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED SMART/Health Information (NVMe Log 0x02) Critical Warning: 0x00 Temperature: 56 Celsius Available Spare: 100% Available Spare Threshold: 10% Percentage Used: 0% Data Units Read: 5,856,186 [2.99 TB] Data Units Written: 5,881,473 [3.01 TB] Host Read Commands: 53,692,552 Host Write Commands: 57,989,341 Controller Busy Time: 35 Power Cycles: 109 Power On Hours: 67 Unsafe Shutdowns: 64 Media and Data Integrity Errors: 0 Error Information Log Entries: 1 Warning Comp. Temperature Time: 0 Critical Comp. Temperature Time: 0 Temperature Sensor 1: 69 Celsius Temperature Sensor 2: 48 Celsius Temperature Sensor 3: 47 Celsius Error Information (NVMe Log 0x01, 16 of 256 entries) No Errors Logged Read Self-test Log failed: Invalid Field in Command (0x4002)
btrfs format with default settings
root@server6:/# mkfs.btrfs /dev/nvme1n1p1
btrfs-progs v6.6.3
See https://btrfs.readthedocs.io for more information.
Performing full device TRIM /dev/nvme1n1p1 (7.28TiB) ...
NOTE: several default settings have changed in version 5.15, please make sure
this does not affect your deployments:
- DUP for metadata (-m dup)
- enabled no-holes (-O no-holes)
- enabled free-space-tree (-R free-space-tree)
Label: (null)
UUID: 9f33fe81-41f1-46e3-a334-f06e4f5d4ee9
Node size: 16384
Sector size: 4096
Filesystem size: 7.28TiB
Block group profiles:
Data: single 8.00MiB
Metadata: DUP 1.00GiB
System: DUP 8.00MiB
SSD detected: yes
Zoned device: no
Incompat features: extref, skinny-metadata, no-holes, free-space-tree
Runtime features: free-space-tree
Checksum: crc32c
Number of devices: 1
Devices:
ID SIZE PATH
1 7.28TiB /dev/nvme1n1p1
