Hybrid-disk and File-Disk performance is very poor!

Report bugs or suggestions around Primo Ramdisk
tekken
Level 4
Level 4
Posts: 32
Joined: Wed Sep 19, 2012 8:26 am

Hybrid-disk and File-Disk performance is very poor!

Post by tekken »

Hello!

I want to add Hybrid-disk to my system (Windows server 2019+RAMDisk v6.3.1.)
I make RAID0 of Intel P4608 SSD disks for file component.
All starting good, but when all of the RAM memory has been used up, it begins to store data to a file with VERY low speed. Same same performance with File-Disk with file component on that RAID0.

To compare, please look on CrystalDisk result of that:

1. Speed of RAID0 (2xp4608) volume:
[Read]
Sequential 1MiB (Q= 8, T= 8): 13284.458 MB/s [ 12669.0 IOPS] < 5014.86 us>
Sequential 1MiB (Q= 1, T= 8): 8109.541 MB/s [ 7733.9 IOPS] < 1031.65 us>
Random 4KiB (Q= 32, T=16): 3452.678 MB/s [ 842939.0 IOPS] < 590.08 us>
Random 4KiB (Q= 32, T= 8): 2713.220 MB/s [ 662407.2 IOPS] < 374.96 us>

[Write]
Sequential 1MiB (Q= 8, T= 8): 4899.250 MB/s [ 4672.3 IOPS] < 13369.92 us>
Sequential 1MiB (Q= 1, T= 8): 4935.399 MB/s [ 4706.8 IOPS] < 1689.41 us>
Random 4KiB (Q= 32, T=16): 3282.313 MB/s [ 801345.9 IOPS] < 618.15 us>
Random 4KiB (Q= 32, T= 8): 2298.376 MB/s [ 561127.0 IOPS] < 441.48 us>

2. Speed of Hybrid-disk (when RAM is finished) or File-Disk with file component on that RAID0:
[Read]
Sequential 1MiB (Q= 8, T= 8): 111.989 MB/s [ 106.8 IOPS] <562545.83 us>
Sequential 1MiB (Q= 1, T= 8): 126.265 MB/s [ 120.4 IOPS] < 65736.74 us>
Random 4KiB (Q= 32, T=16): 15.455 MB/s [ 3773.2 IOPS] <130780.21 us>
Random 4KiB (Q= 1, T= 8): 15.418 MB/s [ 3764.2 IOPS] < 2120.72 us>

[Write]
Sequential 1MiB (Q= 8, T= 8): 1992.810 MB/s [ 1900.5 IOPS] < 33311.54 us>
Sequential 1MiB (Q= 1, T= 8): 1979.611 MB/s [ 1887.9 IOPS] < 4223.81 us>
Random 4KiB (Q= 32, T=16): 21.988 MB/s [ 5368.2 IOPS] < 91395.70 us>
Random 4KiB (Q= 1, T= 8): 25.196 MB/s [ 6151.4 IOPS] < 1295.96 us>

P.S. Sorry for my english!
P.S.S. Please help me in my problem, cause I need to buy this software for my tasks :roll:

EDIT: On Windows Server 2012+ RAMDiks v 6.1.0 same same problems :crazy:
EDIT2: Windows 10 X64 2004 same problem//
User avatar
Support
Support Team
Support Team
Posts: 3014
Joined: Sun Dec 21, 2008 2:42 am

Re: Hybrid-disk and File-Disk performance is very poor!

Post by Support »

For hybrid-disks and file-disks, Primo Ramdisk has to process read/write requests to virtual disks, and then issue new read/write requests to access file data. Windows process file access requests very slow, thus the whole process is also very slow.
In initial design, user convenience had higher priority than the performance of hybrid-disks and file-disks, so we simply used a file for them instead of using a dedicated partition. We may change the design in future to improve the performance of hybrid-disks and file-disks.
Primo Ramdisk | PrimoCache
Romex Software Support
tekken
Level 4
Level 4
Posts: 32
Joined: Wed Sep 19, 2012 8:26 am

Re: Hybrid-disk and File-Disk performance is very poor!

Post by tekken »

Thank you very much for your attention to this problem!!!

1. When can you do it?
2. Without this improvement Primo RamDisk is useless to me.
3. I understand, that not so many people need this improve or they don'tunderstand how to test it, and I have to wait long time this improvement... So ok, Can I pay your time to work on this improve?

P.S. Your standalone Ramdisk have a really good performance, so lets do same for hybrid-disks!!!

EDIT: Better solution for me: to add read/write requests of Hybrid-Disk (when RAM is full) directly to some folder on selected partition (not to file)
User avatar
Support
Support Team
Support Team
Posts: 3014
Joined: Sun Dec 21, 2008 2:42 am

Re: Hybrid-disk and File-Disk performance is very poor!

Post by Support »

For best performance, it would be better using a dedicated partition like what PrimoCache does. Using folders or files won't help.
Primo Ramdisk | PrimoCache
Romex Software Support
tekken
Level 4
Level 4
Posts: 32
Joined: Wed Sep 19, 2012 8:26 am

Re: Hybrid-disk and File-Disk performance is very poor!

Post by tekken »

OK, I understand. Lets do dedicated partition support) Just tell me, how much time needed. And I can support this improvement by money and tests.

P.S. I have tested your PrimoCache too, cause Hybrid-disk is very near with PrimoCashe+infinity writeback. But the PrimoCache cache for the performance of the 4KB block is weaker than my raid0 of 2X Intel 4608 in most cases (2-3 times less). I understand it, because when the cache handles I/O requests, it will take additional process time for caching works besides delivering requests to my raid. So, Primocache its not for my case.

1. Speed of RAID0 (2xp4608) volume (without Primocache writeback):
[Read]
Random 4KiB (Q= 32, T=16): 3452.678 MB/s [ 842939.0 IOPS] < 590.08 us>
Random 4KiB (Q= 32, T= 8): 2713.220 MB/s [ 662407.2 IOPS] < 374.96 us>
[Write]
Random 4KiB (Q= 32, T=16): 3282.313 MB/s [ 801345.9 IOPS] < 618.15 us>
Random 4KiB (Q= 32, T= 8): 2298.376 MB/s [ 561127.0 IOPS] < 441.48 us>

2. Speed of RAID0 (2xp4608) volume (with Primocache + infinity writeback):
[Read]
Random 4KiB (Q= 32, T=16): 1104.659 MB/s [ 269692.1 IOPS] < 1896.21 us>
Random 4KiB (Q= 8, T= 8): 1462.917 MB/s [ 357157.5 IOPS] < 178.68 us>
[Write]
Random 4KiB (Q= 32, T=16): 1545.783 MB/s [ 377388.4 IOPS] < 1353.21 us>
Random 4KiB (Q= 8, T= 8): 1310.243 MB/s [ 319883.5 IOPS] < 199.22 us>

3. Speed of PrimoRam Disk Direct I/O:
[Read]
Random 4KiB (Q= 32, T=16): 4698.504 MB/s [1147095.7 IOPS] < 433.33 us>
Random 4KiB (Q= 8, T= 8): 4129.592 MB/s [1008201.2 IOPS] < 61.30 us>
[Write]
Random 4KiB (Q= 32, T=16): 4779.260 MB/s [1166811.5 IOPS] < 425.76 us>
Random 4KiB (Q= 8, T= 8): 4332.873 MB/s [1057830.3 IOPS] < 57.52 us>
User avatar
Support
Support Team
Support Team
Posts: 3014
Joined: Sun Dec 21, 2008 2:42 am

Re: Hybrid-disk and File-Disk performance is very poor!

Post by Support »

#2 is the test result of PrimoCache L1 cache? Could you upload a screenshot of your PrimoCache main dialog which shows the cache configuration and statistics by highlighting the target volume item? And a screenshot of the whole testing results from the benchmark tool? Thanks.
Primo Ramdisk | PrimoCache
Romex Software Support
tekken
Level 4
Level 4
Posts: 32
Joined: Wed Sep 19, 2012 8:26 am

Re: Hybrid-disk and File-Disk performance is very poor!

Post by tekken »

Yes, #2 is the test result of L1 cache. Cache Hit rate =100%

Screenshot:
Image

------------------------------------------------------------------------------
CrystalDiskMark 7.0.0 x64 (C) 2007-2019 hiyohiyo
Crystal Dew World: https://crystalmark.info/
------------------------------------------------------------------------------
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes

[Read]
Sequential 1MiB (Q= 8, T= 8): 16126.919 MB/s [ 15379.8 IOPS] < 4146.78 us>
Sequential 1MiB (Q= 1, T= 8): 13814.534 MB/s [ 13174.6 IOPS] < 606.02 us>
Random 4KiB (Q= 32, T=16): 995.277 MB/s [ 242987.5 IOPS] < 2104.36 us>
Random 4KiB (Q= 8, T= 8): 1055.597 MB/s [ 257714.1 IOPS] < 247.38 us>

[Write]
Sequential 1MiB (Q= 8, T= 8): 15810.019 MB/s [ 15077.6 IOPS] < 4224.58 us>
Sequential 1MiB (Q= 1, T= 8): 18161.072 MB/s [ 17319.7 IOPS] < 460.77 us>
Random 4KiB (Q= 32, T=16): 1006.735 MB/s [ 245784.9 IOPS] < 2079.80 us>
Random 4KiB (Q= 8, T= 8): 1034.740 MB/s [ 252622.1 IOPS] < 252.19 us>

Profile: Default
Test: 8 GiB (x3) [Interval: 5 sec] <DefaultAffinity=DISABLED>
Date: 2020/09/25 8:23:20
OS: Windows Server 2019 [10.0 Build 17763] (x64)
User avatar
Support
Support Team
Support Team
Posts: 3014
Joined: Sun Dec 21, 2008 2:42 am

Re: Hybrid-disk and File-Disk performance is very poor!

Post by Support »

Thank you very much for the detailed information! We will check this.
Primo Ramdisk | PrimoCache
Romex Software Support
tekken
Level 4
Level 4
Posts: 32
Joined: Wed Sep 19, 2012 8:26 am

Re: Hybrid-disk and File-Disk performance is very poor!

Post by tekken »

For more correct tests, I have reinstalled Windows Server 2019+Primocahce 3.2.0, make new RAID0 by Windows diskmanager and did test again:

1. RAID0+PrimoCache (Write cache):

Image

[Read]
Sequential 1MiB (Q= 8, T= 8): 14795.782 MB/s [ 14110.4 IOPS] < 4520.67 us>
Sequential 1MiB (Q= 1, T= 8): 13092.975 MB/s [ 12486.4 IOPS] < 639.39 us>
Random 4KiB (Q= 32, T=16): 996.147 MB/s [ 243200.0 IOPS] < 2102.56 us>
Random 4KiB (Q= 32, T= 8): 1439.972 MB/s [ 351555.7 IOPS] < 727.25 us>
[Write]
Sequential 1MiB (Q= 8, T= 8): 15814.190 MB/s [ 15081.6 IOPS] < 4202.60 us>
Sequential 1MiB (Q= 1, T= 8): 18108.263 MB/s [ 17269.4 IOPS] < 461.82 us>
Random 4KiB (Q= 32, T=16): 1339.833 MB/s [ 327107.7 IOPS] < 1553.47 us>
Random 4KiB (Q= 32, T= 8): 1325.192 MB/s [ 323533.2 IOPS] < 783.33 us>
Profile: Default
Test: 64 GiB (x5) [Interval: 5 sec] <DefaultAffinity=DISABLED>
Date: 2020/09/25 19:12:56
OS: Windows Server 2019 [10.0 Build 17763] (x64)


2. RAID0+PrimoCache (paused):

Image

[Read]
Sequential 1MiB (Q= 8, T= 8): 13342.740 MB/s [ 12724.6 IOPS] < 5015.01 us>
Sequential 1MiB (Q= 1, T= 8): 8170.097 MB/s [ 7791.6 IOPS] < 1023.39 us>
Random 4KiB (Q= 32, T=16): 3253.670 MB/s [ 794353.0 IOPS] < 627.43 us>
Random 4KiB (Q= 32, T= 8): 2143.731 MB/s [ 523371.8 IOPS] < 473.36 us>
[Write]
Sequential 1MiB (Q= 8, T= 8): 4892.812 MB/s [ 4666.1 IOPS] < 13597.01 us>
Sequential 1MiB (Q= 1, T= 8): 4818.337 MB/s [ 4595.1 IOPS] < 1733.53 us>
Random 4KiB (Q= 32, T=16): 1817.570 MB/s [ 443742.7 IOPS] < 1151.37 us>
Random 4KiB (Q= 32, T= 8): 1936.744 MB/s [ 472837.9 IOPS] < 540.30 us>
Profile: Default
Test: 64 GiB (x5) [Interval: 5 sec] <DefaultAffinity=DISABLED>
Date: 2020/09/25 19:22:42
OS: Windows Server 2019 [10.0 Build 17763] (x64)


3. RAID0+Primo RAMdisk 6.3.1 (Derect I/O):

Image

[Read]
Sequential 1MiB (Q= 8, T= 8): 13415.735 MB/s [ 12794.2 IOPS] < 4990.61 us>
Sequential 1MiB (Q= 1, T= 8): 29180.456 MB/s [ 27828.7 IOPS] < 286.28 us>
Random 4KiB (Q= 32, T=16): 5068.810 MB/s [1237502.4 IOPS] < 406.87 us>
Random 4KiB (Q= 32, T= 8): 4000.687 MB/s [ 976730.2 IOPS] < 258.71 us>
[Write]
Sequential 1MiB (Q= 8, T= 8): 19008.697 MB/s [ 18128.1 IOPS] < 3507.35 us>
Sequential 1MiB (Q= 1, T= 8): 11287.193 MB/s [ 10764.3 IOPS] < 741.63 us>
Random 4KiB (Q= 32, T=16): 4665.549 MB/s [1139050.0 IOPS] < 441.59 us>
Random 4KiB (Q= 32, T= 8): 3855.624 MB/s [ 941314.5 IOPS] < 268.06 us>
Profile: Default
Test: 64 GiB (x5) [Interval: 5 sec] <DefaultAffinity=DISABLED>
Date: 2020/09/25 20:05:47
OS: Windows Server 2019 [10.0 Build 17763] (x64)
User avatar
Support
Support Team
Support Team
Posts: 3014
Joined: Sun Dec 21, 2008 2:42 am

Re: Hybrid-disk and File-Disk performance is very poor!

Post by Support »

Thanks! I think there is much room for improvement to PrimoCache on 4K performance.
Primo Ramdisk | PrimoCache
Romex Software Support
Post Reply