Speeding up Writing GB's of Data

FAQ, getting help, user experience about PrimoCache
Post Reply
ibayyouk
Level 1
Level 1
Posts: 1
Joined: Mon Aug 04, 2014 7:17 pm

Speeding up Writing GB's of Data

Post by ibayyouk »

I am collecting a lot of video data at about 120 MB/S. My drive has to be fast enough or I will lose frames.

Currently I am writing my data to 2 SSD's in raid and copying that that to a 2 TB Baracuda HDD while I continue to write data to the SSDs using a script.

I tried using one SSD as an L2 Cache and setting the defer-write time to infinite but it is not fast enough and there is no way to use a RAID SSD as an L2 Cache.

Is there anyway I can use PrimoCache to do any of the following:

Use the raid SSDs as cache and avoid using the copy script so I can copy straight to the HDD.

Improve the speed of writing data to the raid SSDs?

Improve the speed of copying straight to a HDD and avoid using SSDs all together.

Also when writing this much data what is the best configuration in terms of block size and write-defer time?
InquiringMind
Level SS
Level SS
Posts: 477
Joined: Wed Oct 06, 2010 11:10 pm

Re: Speeding up Writing GB's of Data

Post by InquiringMind »

Welcome to the forums Ibayyouk,
ibayyouk wrote:I tried using one SSD as an L2 Cache and setting the defer-write time to infinite but it is not fast enough and there is no way to use a RAID SSD as an L2 Cache.
Defer-write applies to L1 (RAM) caches only, not L2 SSD. As noted in the PrimoCache FAQ, L2 caches cannot store deferred-write data.

However a single SSD should (currently) provide 400-500MB/s read/write speeds if connected to a SATA 3 interface. This would seem to considerably exceed your 120MB/s requirement, so if a single SSD is too slow then perhaps there is an issue elsewhere in the system?
ibayyouk wrote:Is there anyway I can use PrimoCache to do any of the following...
PrimoCache can only improve SSD performance via L1 (RAM) caching which probably won't suffice for very large files. A more practical option may be to boost speeds by adding extra HDDs in a RAID 0 configuration (or RAID 1+0 if you want some protection from disk failure).
Post Reply