MySQL storage: how to manage a grow to infinite?

1

I'm just thinking about how famous internet services like facebook or twitter manage fast growing databases.

Which could be a solution for this kind of problem?

What about ids ? I read there is a limit in MySQL - 18446744073709551615 - in unsigned bigint... how would you generate and manage a bigger value ?

Just a theoric problem, but i'm curious about a possible solution.

Thank you!

Dario

Posted 2010-06-10T15:47:02.050

Reputation: 11

Answers

1

In order to manage a social network with over 350 million users you need a custom setup. Customized and highly tuned databases, severs, tables, query caching, etc.

You can't do it with an out of the box MySQL installation. Every single aspect of the database needs to be customized and tailored to the exactly.

Josh K

Posted 2010-06-10T15:47:02.050

Reputation: 11 754

of course, but since actually there are those infrascrutures, i was just thinking about what they did to make them work – Dario – 2010-06-10T16:16:37.127

@Dario The customization is website specific... like Facebook is going to have a special way of dealing with people names versus group names as well as status updates. The information only available upon viewing someones profile is probably the only thing anywhere close to out of the box. Twitter has completely different needs. They both have a large staff of people all working full time just to manage and maintain their database. – Jarvin – 2010-06-10T17:55:59.993

1

Here is an interview with VP of Engineering Mike Schroepfer from facebook where he address questions around scaling.

Jarvin

Posted 2010-06-10T15:47:02.050

Reputation: 6 712