-10

I run a video hosting, youtube like site. I currently run it with 2x3TB HDDs and they max out at 150mB/s

I`m willing to achieve higher speeds and I think of storing the data on HDDs and streaming them via SSD disk.

How can this be achieved? Can there be multiple backend servers that store data?

Thanks!

Tmz Litz
  • 19
  • 2
  • 4
    what %age of your catalogue is read? what's your cache hit ratio? how much capacity do you want/need? I do exactly this kind of thing professionally and it's not a quick answer. – Chopper3 May 08 '13 at 14:58
  • 2
    @Chopper3 Pfft, you claim to do this stuff professionally but you still ask boring questions. Just tell the man how to serve his wares ultra quick. I'd guess he needs to RAID0 everything or something – Dan May 08 '13 at 14:59
  • @dan haha :) I suspect someone's not read the first paragraph of the FAQ *again* – Chopper3 May 08 '13 at 15:01
  • 2
    I can't see how a question like this can be answered is a useful way. There are too many dependencies to the usage pattern, budget, hardware, etc. – Stephane May 08 '13 at 15:03
  • 1
    Amazon EC2 or other CDN will improve your speeds way more for less. – bonsaiviking May 08 '13 at 15:08

2 Answers2

4

This is going to cost you a shedload, but basically, you either need a huge SSD array, or a huge tiered storage array. There's a bunch of SAN vendors who'll be able to provide you something to meet your requirements, but basically you need:

Many SATA disks, for storage capacity, fronted by SAS 15k disks, or SAS SSDs, for quick access storage.

All provided over 8Gbit Fibrechannel to your webservers.

89c3b1b8-b1ae-11e6-b842-48d705
  • 1,465
  • 1
  • 13
  • 22
Tom O'Connor
  • 27,440
  • 10
  • 72
  • 148
0

Two simple choice:

  • If you are using Linux on the server(s), check out version 3.9, includes SSD caching. Or maybe check out Bcache.
  • Store the hot/popular videos on SSD
Sandor Marton
  • 1,544
  • 9
  • 12