Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [oom-killer]

oom-killer Out-Of-Memory killer in the Linux kernel

A part of the Linux memory management that will sacrifice one or more processes in order to free up memory for the system when all else fails.

39 questions
67
votes
3 answers

Rsync triggered Linux OOM killer on a single 50 GB file

I have a single 50 GB file on server_A, and I'm copying it to server_B. I run server_A$ rsync --partial --progress --inplace --append-verify 50GB_file root@server_B:50GB_file Server_B has 32 GB of RAM with 2 GB swap. It is mostly idle and should…
dataless
  • 833
  • 7
  • 11
17
votes
4 answers

Linux oom situation (32 bit kernel)

I have continous oom&panic situation unresolved. I am not sure system fills up all the ram (36GB). Why this system triggered this oom situation? I suspect it as related to lowmem zone in 32 bit linux systems. How can I analize the logs from kernel…
seaquest
  • 668
  • 2
  • 11
  • 25
16
votes
1 answer

Scaling Logstash (with redis/elasticsearch)

Over a cluster of over 12 centos 5.8 servers, I deployed logstash using the native logstash shipper, which sends /var/log/*/*.log back to a central logstash server. We tried using rsyslogd as the shipper, but due to a bug in rsyslogd's ImFile…
Tom O'Connor
  • 27,440
  • 10
  • 72
  • 148
10
votes
2 answers

View full program command line arguments in OOM killer logs

Is it possible to view full program command line arguments in OOM killler logs ? What I see now in /var/log/syslog is Memory cgroup out of memory: Kill process 29187 (beam.smp) score 998 or sacrifice child Killed process 29302 (cpu_sup)…
sergeyz
  • 223
  • 1
  • 3
  • 8
8
votes
3 answers

Please help interpret OOM-Killer

We were testing our java application and it was killed by the OOM Killer, logs below. A couple of points: this is a java web application. It runs with a 190G heap. The server is a 240G total memory EC2 instance. We were trying the new,…
Taylor
  • 211
  • 2
  • 6
7
votes
1 answer

Is it recommended to set OOMScoreAdjust=1000 in systemd for a replaceable service?

systemd has the OOMScoreAdjust option, which allows to adjust the oom-killer score of the started process. To quote from the systemd documentation: OOMScoreAdjust= Sets the adjustment level for the Out-Of-Memory killer for executed processes. Takes…
Philipp Claßen
  • 511
  • 1
  • 8
  • 19
7
votes
2 answers

How does Docker deal with OOM killer and memory limits?

I have a docker container which starts a simple java (jgroups-based) application through a bash script. The java process is limited through Xmx by 128m, the container is allowed to use 256m (swap is disabled). Unfortunately, time to time I face the…
mikhail
  • 239
  • 1
  • 4
  • 9
7
votes
1 answer

linux OOM-kill why?

. Greetings, fellow admins. I post in the hope of shedding light on the OOM-kills that haunt one of my company's machines. I cannot decide if they are legit OOMs or not. It's a Centos 6.x with kernel 2.6.32-279.1.1.el6.x86_64. Ram 8 gb, cpu…
Leo
  • 71
  • 1
  • 2
7
votes
1 answer

MongoDB getting OOM killed

we are running a mongodb replicaset on three machines. All three machines have around 16GB but only 255MB Swap. Swappiness is left on it's default value 60. The machines are running CentOS 6.4. The databases are much larger than the 16GB, but that's…
bjoernhaeuser
  • 171
  • 1
  • 1
  • 2
5
votes
3 answers

Mysql crashing, oom-killer, out of memory, tuning issues?

I just moved all of my websites to a new server with 4GB RAM. Almost immediately, mysql started crashing, and at one point, didn't reboot which caused a major outage (since I didn't notice until someone pointed it out to me). Here is the log with…
runningonplants
  • 287
  • 2
  • 10
4
votes
1 answer

Troubleshooting oom-killer using atop: Is it fixed or not?

I have a Debian system with 4GB of RAM, 2GB of swap and 2 CPUs. I've been experiencing a number of system failures involving oom-killer. The system will be working fine one minute, and the next will be inoperable with numerous oom-killer messages…
KIsmay
  • 115
  • 7
3
votes
2 answers

OOM killer shut down MySQL although ram usage seems low

Setup EC2 t2.large instance with Ubuntu 16.04 (2 Cores, 8GB RAM) Apache/2.4.18 (Ubuntu) 5.7.20-0ubuntu0.16.04.1 (Ubuntu) Currently this instance hosts multiple Drupal 6 & 7 sites, around 150 in total. The majority of the sites have a DB size of…
Angelos Ar
  • 31
  • 1
  • 2
3
votes
1 answer

Adjust oom_score at process launch

I've got a few servers that have begun oom-killing their backup processes and, while I understand that encountering the oom condition is quite bad in itself, I need this process to not die so that backups happen properly while the memory issue is…
Sammitch
  • 2,072
  • 1
  • 20
  • 34
3
votes
0 answers

Running out of memory with plenty of memory and swap

I have a Debian-based system that is running out of memory but there appears to be plenty of free memory. The box will run for about 6-12 days and then it will begin killing anything allocating memory (usually allocating skbs). Eventually, it kills…
Dom G
  • 31
  • 2
3
votes
4 answers

mysqld crashing almost every hour - mysqld invoked oom-killer

I am running wordpress on a centOS digital ocean droplet my mysql keeps crashing almost every hour -- with an out of memory error manually restarting mysqld brings it back up via sudo service mysqld restart Does anyone know what could be causing…
Alicia R
  • 31
  • 1
  • 6
1
2 3