Questions tagged [high-load]

All aspects of high-loaded systems development and maintenance.

All aspects of high-loaded systems development and maintenance: design, algorithms, architecture, technologies, development, testing, databases, storage, support, hardware, hosting, management.

219 questions
3
votes
3 answers

How to detect if Apache is (on the verge of) being overwhelmed by requests?

I'm maintaining and planning an EC2 server instance running Apache2 on Ubuntu which receives currently up to about 10000 (very simple) requests per hour. It's just some data coming in by POST and a dummy plain text hyphen is responded with. The…
Raffael
  • 669
  • 7
  • 15
3
votes
3 answers

Kernel Processes Periodically Eating CPU During High Load

I run a production web server with 24 cores in which the work is both CPU and I/O intensive, but mostly CPU. My scripts delay execution when total CPU load is ~85% or higher in order to keep the load manageable. Thus, the CPU is never under greater…
meridionaljet
  • 351
  • 2
  • 4
  • 10
3
votes
0 answers

High network softirq requests for kernel 3.10 under a lot of traffic

We have been experimenting rolling out 3.10 series kernel that's provided by centos via the centosplus repo for v6. We have been noticing something interesting where under the same load the load for the server is 6-7x more on the 3.10 series then…
Mike
  • 21,910
  • 7
  • 55
  • 79
3
votes
0 answers

High Performance AWS EC2 / RDS + Nginx + PHP-FPM setup

General description of the issue We're currently running an application on a PaaS type solution for PHP. Their solution is based on AWS cloud and due to the fact that their plans don't fit our scaling needs, we've decided to migrate to AWS directly…
Carvefx
  • 31
  • 1
  • 4
3
votes
1 answer

Linux NIC bonding failure; strange CPU load

Note: An update as been added below I'm having a very strange issue with a Linux server (Debian 6.0.6) using 802.3ad NIC bonding. Occasionally all of the NICs in the bond get marked as down and the events process runs away with 100% CPU utilization…
Rain
  • 211
  • 1
  • 3
  • 10
3
votes
4 answers

Linux high load with ImageMagick convert utility and server freezes (blktrack output attached)

I'm using ImageMagick to convert a JPG to TIF file, and I'm using the limit options for Imagemagick as below: /usr/bin/convert -limit memory 256 -limit map 512 subjectfile.jpg -colorspace Gray -depth 8 -resample 200x200 output.tif When I run the…
3
votes
1 answer

Perform action based on load avg

I'm running some web applications on an debian server and have to struggle with ddos attacks sometimes. It's eating up all my resources and I can't ssh anymore into the server. An idea was to drop all connections if the load avg is too high, so…
sfx
  • 135
  • 3
3
votes
2 answers

Very high load, apparently caused by pdflush

I have a server that's running CentOS 5, and it will periodically (a couple of times a day) have enormous spikes in load, and the whole server will grind to a halt. After a couple of minutes, the load will go back down and everything returns to…
Dean Harding
  • 390
  • 3
  • 9
3
votes
1 answer

KVM IO leads to high system load, WD Caviar Green (EACS)

I have Ubuntu 12.04 host running Linux 3.2.0-24-generic, libvirt 0.9.8-2ubuntu17, qemu-kvm 1.0+noroms-0ubuntu13. Host uses elevator=deadline, guests use elevator=noop. All KVM guests use virtio, no caching, io mode default, and LVM logical volumes…
Tader
  • 141
  • 1
  • 6
3
votes
2 answers

Real CPU load with multiple cores

My machine has 4 cores. And my load average is about 1.2 Does with means that all cores are more than busy? Or is the real load of my machine? 1.2 / 4 = 0.3 In other words is this machine overloaded of not?
ddofborg
  • 223
  • 1
  • 3
  • 7
3
votes
3 answers

Simulate high traffic using data from log files

I need to test a saas service load by sending 1000s requests/sec from multiple remote sources. The urls need to be from my access log. Is there a service that can simulate high traffic using the data from my log files?
Niro
  • 1,371
  • 3
  • 17
  • 35
3
votes
6 answers

Scalable WordPress Host for High-Volume Site?

I need recommendations for a scalable web host for a high volume WordPress web site. For my purposes, high-volume might be 100K-500K visitors/hour. Might think towards a 1M/hour burst rate as a "high water mark." I know WP isn't the…
Jonathan Eunice
  • 141
  • 1
  • 6
3
votes
2 answers

Inexplicably high total CPU usage when itemized view shows less

I'm having issues with CPU usage on a WinServ08 machine: Effectively, the CPU usage (and more noticeably on core 0 out of 3) is higher than I'd think, and task manager (when sorted by CPU %) shows only a few processes above 0 (and those don't add up…
cpf
  • 133
  • 5
3
votes
1 answer

High CPU Load and High I/O wait time : Mysql process

i am fairly new to the role and the technology. we have a Network server that receives the telemetry data from sensors and temeletry data is stored in MYSQL dabatase. we have a front end portal which we use for device management and queries the…
cjonnala
  • 31
  • 3
2
votes
3 answers

High load average, when should I be worried?

I have a server which runs a few hundred processes simultaneously, most of them are idle, it is some sort of web crawler it sleeps between requests for various reasons. So as a result, my load average is usually something like: 21.64, 27.05,…
AL-Kateb
  • 271
  • 1
  • 5
  • 13