Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [high-volume]

18 questions
20
votes
5 answers

I'm designing a system to handle 10000 TCP connections per second, what problems will I run into?

I have a relatively new 8-core box running CentOS. I would like to develop a stats server that uses TCP. It's very simple, it accepts a TCP connection, increments a counter and closes the connection. The catch is it needs to do this at at least 10k…
Larry G
16
votes
2 answers

Tips for maximizing Nginx requests/sec?

I'm building an analytics package, and project requirements state that I need to support 1 billion hits per day. Yep, "billion". In other words, no less than 12,000 hits per second sustained, and preferably some room to burst. I know I'll need…
linkedlinked
  • 446
  • 1
  • 3
  • 11
4
votes
7 answers

Expecting High traffic on website..How to manage

I am expecting high traffic on a corporate website i am managing.At present the website is hosted on godaddy shared hosting. As it will be an IPO for my clients company so i don't have any idea what kind of traffic surge there would be. How should i…
sunny
  • 149
  • 1
  • 1
  • 6
4
votes
1 answer

How does php know what memcached node to look for its data in?

I am new to the world of Memcached clusters If I have a php web application that is using memcache - how does it does its hash and decide what node to check for a particular value to avoid having to check them all. Bonus: How can I easily add a…
ckliborn
  • 2,750
  • 4
  • 24
  • 36
2
votes
2 answers

Can a CDN (specifically CloudFront) stampede its origin server after a miss?

Similar to how a memcache server can stampede a db after a missed hit. Should I ever expect high traffic from my CDN(s)?
ckliborn
  • 2,750
  • 4
  • 24
  • 36
2
votes
1 answer

Preload/Prime Amazon Cloud Front CDN before move.

I am changing CDNs and I would like to preload some content to AWS Cloud Front so that my origin server is not hammered during that transition. Any tips?
ckliborn
  • 2,750
  • 4
  • 24
  • 36
2
votes
3 answers

DNS Load balancing vs Incremented DNS

I don't know much about DNS administration, etc, however I know about best practices in application programming. Currently, in my company, we have 6 servers respectively named…
JohnT
  • 145
  • 1
  • 1
  • 4
2
votes
2 answers

need a distributed high performance durable logging solution for multiple log sources

Looking for a high performance distributed scalable solution for storing tons of log messages. We have multiple concurrent log sources(=servers). The interesting thing here is that performance is crucial and we are even willing to loose a small…
Karoly Horvath
  • 334
  • 1
  • 4
  • 14
1
vote
1 answer

High volume low overhead requests

I have an application that will process data it receives through high volume, low overhead requests sent from different internet-enabled hardware devices. These data will be received continually and will only increase in future as more and more…
fijas
  • 111
  • 3
1
vote
0 answers

Apache - Very high load/bandwidth and unusual pattern of requests

I am a web developer and have this server that's being used as a development machine of sorts. So, my experience with Apache is that I can fiddle around and get basic stuff done / google stuff to get the answers I need. Over the weekend, we had a…
Adhip Gupta
  • 111
  • 2
0
votes
0 answers

Server becomes too slow with high traffic http requests for tracking page loads of multiple sites

We have the following server resources : 16GB RAM Memory Intel Xeon E5-2650 v2 @ 2.60GHz (8 Core) 240GB SSD (RAID 10) 1 IP Address (2 extra) Unmetered Traffic / 1Gbit Port / 100Mbps guaranteed We are using piece of javascript on around 30 websites…
Bilal Halayqa
  • 101
  • 1
0
votes
0 answers

Diagnosing high Network Out (Bytes) by MySQL instance

I have an EC2 instance (r3.xlarge) with only MySQL running on it. At some points in time, this machine sends a sustained amount of information (at almost a rate of 400Mbps) for about an hour or more (in many cases), to another EC2 instance which is…
siliconpi
  • 1,707
  • 6
  • 30
  • 45
0
votes
1 answer

Large, high performance object or key/value store for HTTP serving on Linux

I have a service that serves images to end users at a very high rate using plain HTTP. The images vary between 4 and 64kbytes, and there are 1.300.000.000 of them in total. The dataset is about 30TiB in size and changes (new objects, updates,…
Tommy
  • 331
  • 1
  • 7
0
votes
2 answers

Large photo sharing service. Where to start

I'm sorry if this post is too vague but I don't even know what topics to start looking at. I need a server that has the ability to share large amounts of data with potentially very high traffic, and the ability for users to upload photos quickly. It…
JoshDG
  • 101
0
votes
1 answer

High traffic, slow response: where is the bottleneck?

I have a site which is receiving relatively high traffic of around 250.000 pageviews a day. The PHP code is usually executing in under 0.02 seconds, but the actual response time can go up during peak times to several seconds (sometimes 10+ seconds).…
Aron
  • 189
  • 7
1
2