RAID 6 that can read with least 1000 Mbit/s?

1

0

I purchased a Dell PERC 6/i which I expected to be able to read with 1000 Mbps. There is not much to do now, but there are some things I wanted knowledge about for another time.

I have configured it with four 2 TByte drives and RAID 6.
It has 256 MByte of RAM and transfer rate of 300 Mbps.
The benchmark test showed:

Min read rate: 136.3 Mbps
Max read rate: 329,6 Mbps
Avg read rate: 242,2 Mbps

What could I had done to get at least 1000 Mbps?

Is it normal for internal and external RAID controllers to have a lower transfer rate eg. 300 Mbps? (I did not noticed at the time that it was not 3 Gbps)

How would a RAID 10 had performed compared to RAID 6 or 5?

Would it have been better to use software RAID (Linux) with the internal 3 Gbps SATA controller?

UPDATE:
The drives is SATA III 6 Gbps.
http://www.seagate.com/files/staticfiles/docs/pdf/datasheet/disc/desktop-hdd-data-sheet-ds1770-1-1212us.pdf (2TB)

UPDATE 2:
I was asked what I had expected as transfer rate. I will put my answer here, although it is irrelevant. I did not ask about the speed could be correct or what I had expected.

I have calculated the numbers with a loss of 1/3.
Example 4 x 3 Gbps (SATA II. Total 12 Gbps) will provide 8 Gbps.

So what should I have done to get the 1000 Mbps or .... bump?

UPDATE 3:
Screenshot of the benchmark test:

screenshot of benchmark test https://docs.google.com/file/d/0B6swvDCUiDn9WmtZcEFJUTdZRE0/edit

UPDATE 4:
Screenshot of hdparm: screenshot of hdparm]![enter image description here

But it seems that the fault is in the switch.
Screenshot of the network test (iperf):

screenshot of network test]![enter image description here

Diblo Dk

Posted 2013-06-29T10:43:35.000

Reputation: 584

four 2 TByte drives What if each drive is capable of reading 1MB/s, what would you expect the read rate to be? – ta.speot.is – 2013-06-29T11:47:21.193

@ta.speot.is it's RAID6 setup, so I'd say around 200 MB/s max. if you were using 100 MB/s drives. – Breakthrough – 2013-06-29T16:18:19.410

The hard drives is SATA III 6Gbps, look at the update above :) – Diblo Dk – 2013-06-29T16:18:53.337

2@DibloDk are you sure the benchmark units are in mega bits per second and not mega bytes? – Breakthrough – 2013-06-29T16:20:10.310

Here's a screenshot https://docs.google.com/file/d/0B6swvDCUiDn9WmtZcEFJUTdZRE0/edit?usp=sharing

– Diblo Dk – 2013-06-29T16:30:10.060

I made ​​also a test by copy 3.6 GByt over a 1 Gbps network and I got 45 MByt/s (360 Mbit/s). It was 25 files, that fill 3.6 Gbyt, but the 360 ​​Mbit/s fits approx. with max the transfer rate – Diblo Dk – 2013-06-29T16:35:45.977

@ta.speot.is I do not know. 8000 Mbit/s, but because I was wrong about 300 and 3000 Gbit/s, I'd say 1600 Mbit/s (2/3) – Diblo Dk – 2013-06-29T16:55:14.407

300 and 3000 Mbit/s – Diblo Dk – 2013-06-29T17:18:43.693

@Breakthrough But it says example. 4 TB (TByte) and 329.6 Mb/s (Mbit/s) I hope that I can trust the abbreviations :) ? – Diblo Dk – 2013-06-30T13:39:11.190

1

@DibloDk have you tried another program? This question on AskUbuntu alludes me to believe that those benchmark units should be in MB/s (as per the pictures in the accepted answer on that AU question), so your benchmark either is in bits/sec, or the units are being displayed wrong (possible localization bug?). Anyways, I'd try another disk utility or somehow otherwise verify those speed values you've provided (maybe try some real-world file transfers and see how long it takes?).

– Breakthrough – 2013-06-30T15:37:41.603

@DibloDk I agree with Breakthrough that those are megabytes, not megabits. From your screenshot you can see that the abbreviations are inconsistent. Assuming those are megabytes, you're averaging nearly 2000 megabits per second. – Louis – 2013-06-30T16:00:34.340

Okay, it sounds like that i need to make new benchmark and networks test :) It will take some time before I can make new tests, so I will let the topic stand and come back later. – Diblo Dk – 2013-06-30T16:33:42.403

@DibloDk try using hdparm to do some benchmarking and show us the results; you can find details using hdparm on this AskUbuntu question.

– Breakthrough – 2013-06-30T16:40:12.377

@Breakthrough Yes, I will use both programs :) – Diblo Dk – 2013-06-30T16:44:32.143

1@Breakthrough You're right :) – Diblo Dk – 2013-07-17T00:31:59.390

Many switches cap out much lower than advertised spec. Always start with iperf when testing network-related speeds. Higher-end switches will allow for throughput of much closer to their rated speeds, as well total network traffic on the switch will affect speeds. Out of curiousity what switch was this? I've seen procurve and netgear switches doing this often. In addition, to test drive speeds use a program which writes and reads: memory-disk-memory, for an actual drive speed test. – scape – 2013-10-17T18:39:33.300

Answers

2

According to the technical specifications page the controller is capable of 300 MBps (2400 Mbps).

It's not clear whether this is the maximum when running in RAID 6. Note that RAID levels with parity require parity calculations and this can slow the overall transfer rates. So the maximum might be applicable for a RAID level that's less demanding of the controller.

The parity calculations can come into play during reads, especially if one of the disks has failed and the controller has to "fill in the blanks".

That said, the RAID controller might not be the bottleneck. Take 2 disks with a sequential read speed of 20MB/s each in RAID 0. The fact that the controller can push 2.4 Gbs doesn't mean much if the disks can feed it enough information to transfer at that rate.

ta.speot.is

Posted 2013-06-29T10:43:35.000

Reputation: 13 727

I accept your answer. But I think it's a lot when we're talking about, that it is almost 1/4 of the speed there is lost. - But it is not an answer to the four questions. Ex. what could I do to get 1000Mbps? – Diblo Dk – 2013-06-30T13:27:48.883

3/4 of the speed there is***** – Diblo Dk – 2013-06-30T15:40:48.547

How did you get up to 2400 Mbps and not 1200 Mbps. – Diblo Dk – 2013-06-30T18:41:02.360

0

Performance of linear read per disk is not limited by interface (SATA III in your case). It may be so for SSDs, but not for HDDs anyway.

Measure your disks independently of RAID controller. They are likely to give about 100 Mb/s each, hence the benchmark result you provided.

Mikhail Kupchik

Posted 2013-06-29T10:43:35.000

Reputation: 2 381

0

There are many determining factors in a hard drive or controller's reported speeds when under use:

  1. The speed of the hard drive
  2. The speed of the controller/processor

For the speed of the hard drive, you need to also know that hard drives will not run at the fastest possible sped all the time, especially with desktop consumer drives, that are rated for up to 7200 RPM. There are server drives that spin at 10K or 15K RPM, are much more expensive, and much faster when looking for information.

There is also the cache to take into account. The cache is the information received from the spinning parts of the hard drive, which are then fed as a burst of data to the controller. I don't know of any hard drive with a 6 Gb cache to deliver the speed right up to 6Gbps... The most I've seen so far is 64Mb, but I'm sure there are larger caching hard drives available somewhere.

The next part is the controller or the CPU. Once the data leaves the hard drive for the rest of the system, the processor, whether it's a dedicated controller, or the CPU, needs to process the data and decide what's happening with it. There is a bottle neck here as well, as the processor has to do calculations on the data, and possibly manipulate it, before it does anything else (i.e. send to Network card). As well, if Anti virus programs are running and scanning files being accessed, this will also slow down (I realize this isn't part of your question, but not something to eliminate).

In theory, multiple drives increase speed and redundancy; this is true in most situations, but not always the best way. For the fastest speed, you need to lose all redundancy, and go with a RAID 0 (stripe). The issue with that is that if one drive fails, you typically lose all your data across all the drives (at least, the controller says you do). With a RAID 1, you lose half the space, but you have redundancy if one drive fails, and can rebuild easily. RAID 10 offers the best of both worlds, allowing the controller to read from the 4 hard drives at the same time, and not spend time calculating parity, while still allowing you to lose 1 (or, if you're lucky with the selection, 2) drive(s). RAID 5 and 6 both require calculating parity on each drive, for each write and read, which will slow down the processing of the data; their redundancy allows for 1 (RAID 5) or 2 (RAID 6) drive(s) to fail, while keeping the data intact.

With the data sheet you provided, it also shows the MAXIMUM sustained data reading speeds maxing out at 210 MB/s, which is not anywhere close to 6Gbps, which SATA 3 is rated at. So it's easy to see that you will not see the full 6Gbps from that, or from most consumer based Processors.

Canadian Luke

Posted 2013-06-29T10:43:35.000

Reputation: 22 162

Okay thanks, now I understand what @ta.speot.is talk about. It sounds like that i need to make new benchmark and networks test :) – Diblo Dk – 2013-06-30T16:24:50.827

It's also sometimes known as the interface speed. Basically, the fact that your interface (e.g. SATAIII) can reach a high speed, does not mean that the drive itself can sustain such a transfer speed. – Bob – 2013-07-17T00:43:38.040

-1

You need a better RAID controller. Your PERC 6/i can only transfer at a maximum of 300Mbps. That is less than a 1/3 of a gigabit per second (.292969 Gbps). This is a relatively low performance card.

There are better cards out there, Googling one at random and came across this one. It had a maximum of 1,850MB/s transfer. This is the equivalent of 2.8 Gbps. Factor in RAID calculations, latencies, etc... This card should be able to support 1Gbps transfer rates.

Your drives and PCIe x8 are more than capable of transferring 1Gbps.

Keltari

Posted 2013-06-29T10:43:35.000

Reputation: 57 019

Your numbers are completely inaccurate, I have a perc 6/i and typically perform near 300MB/s, that's 2.3Gbit/s-- easily saturating a single gig link-- that's with a RAID 6 – scape – 2013-10-17T19:19:53.413