Performance 2

I have been testing a lot with the performance tuning and decided that since I need a reliable data storage to keep my stuff safe, I will keep the RAIDZ2 array with mirrored ZIL and striped L2ARC. Below are two charts showing the performance I get with direct writes and reads to the filesystem.

So what comes to writing, we can see that the bigger the blocksize, the faster the speed (says Captain Obvious) and the reading from the fs is somewhat inconsistent, but the speeds are pretty acceptable.

After these tests I turned off atime from the fs and the speeds are a bit better with each blocksize. (zfs set atime=off <fs>)

more later...