First of all, CIFS/SMB write traffic even through IB when sync=always looks bad. It gives around 80MB/s writes and that is not acceptable. When sync=standard it doesn't go through ZIL and the RAIDZ2 can write 100-140MB/s. Still not acceptable.... waiting to figure something out.
Reading on the other hand works perfectly, I transferred around 3GB file from cache and it was around 600MB/s, that is more than acceptable speed. Transfer directly from RAIDZ2 was around 200MB/s, this is also enough.
Below is the test I did with iperf from NAS to my other host:
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-10.0 sec 8.20 GBytes 7.05 Gbits/sec
So to conclude this time, the connectivity between hosts work perfectly and is fast enough.. the only problem is CIFS/SMB writing. (NFS was not tested yet, since I need an IB Switch to connect more hosts)
No comments:
Post a Comment