Server crashes between 3am and 5am every morning

EdRooney

BANNED
Oct 21, 2004
166
0
166
My server crashes between 3am and 5am every morning, in the error log it says the following right before the crash:

Dec 5 04:43:06 server101 kernel:
Dec 5 04:43:06 server101 kernel: Free pages: 5496kB (3264kB HighMem)
Dec 5 04:43:06 server101 kernel: Active:23703 inactive:2330 dirty:4 writeback:5 unstable:0 free:1374 slab:5324 mapped:20824 pagetables:1491
Dec 5 04:43:06 server101 kernel: DMA free:240kB min:16kB low:32kB high:48kB active:0kB inactive:0kB present:16384kB
Dec 5 04:43:06 server101 kernel: protections[]: 8 476 540
Dec 5 04:43:06 server101 kernel: Normal free:1992kB min:936kB low:1872kB high:2808kB active:464kB inactive:464kB present:901120kB
Dec 5 04:43:06 server101 kernel: protections[]: 0 468 532
Dec 5 04:43:06 server101 kernel: HighMem free:3264kB min:128kB low:256kB high:384kB active:94348kB inactive:8856kB present:114624kB
Dec 5 04:43:06 server101 kernel: protections[]: 0 0 64
Dec 5 04:43:06 server101 kernel: DMA: 60*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 240kB
Dec 5 04:43:06 server101 kernel: Normal: 494*4kB 2*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1992kB
Dec 5 04:43:06 server101 kernel: HighMem: 380*4kB 134*8kB 28*16kB 1*32kB 1*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3264kB
Dec 5 04:43:06 server101 kernel: Swap cache: add 1037089, delete 1026852, find 824732/1012991, race 3+2429
Dec 5 04:43:06 server101 kernel: Out of Memory: Killed process 30651 (exim).
Dec 5 04:43:06 server101 kernel: oom-killer: gfp_mask=0xd0
Dec 5 04:43:06 server101 kernel: DMA per-cpu:
Dec 5 04:43:06 server101 kernel: cpu 0 hot: low 2, high 6, batch 1
Dec 5 04:43:06 server101 kernel: cpu 0 cold: low 0, high 2, batch 1
Dec 5 04:43:06 server101 kernel: cpu 1 hot: low 2, high 6, batch 1
Dec 5 04:43:06 server101 kernel: cpu 1 cold: low 0, high 2, batch 1
Dec 5 04:43:06 server101 kernel: Normal per-cpu:
Dec 5 04:43:06 server101 kernel: cpu 0 hot: low 32, high 96, batch 16
Dec 5 04:43:06 server101 kernel: cpu 0 cold: low 0, high 32, batch 16
Dec 5 04:43:06 server101 kernel: cpu 1 hot: low 32, high 96, batch 16
Dec 5 04:43:06 server101 kernel: cpu 1 cold: low 0, high 32, batch 16
Dec 5 04:43:06 server101 kernel: HighMem per-cpu:
Dec 5 04:43:06 server101 kernel: cpu 0 hot: low 12, high 36, batch 6
Dec 5 04:43:06 server101 kernel: cpu 0 cold: low 0, high 12, batch 6
Dec 5 04:43:06 server101 kernel: cpu 1 hot: low 12, high 36, batch 6
Dec 5 04:43:06 server101 kernel: cpu 1 cold: low 0, high 12, batch 6
Dec 5 04:43:06 server101 kernel:
Dec 5 04:43:06 server101 kernel: Free pages: 4312kB (2160kB HighMem)
Dec 5 04:43:06 server101 kernel: Active:25095 inactive:1164 dirty:0 writeback:32 unstable:0 free:1078 slab:5359 mapped:21698 pagetables:1523
Dec 5 04:43:06 server101 kernel: DMA free:240kB min:16kB low:32kB high:48kB active:0kB inactive:0kB present:16384kB
Dec 5 04:43:06 server101 kernel: protections[]: 8 476 540
Dec 5 04:43:06 server101 kernel: Normal free:1912kB min:936kB low:1872kB high:2808kB active:396kB inactive:524kB present:901120kB
Dec 5 04:43:06 server101 kernel: protections[]: 0 468 532
Dec 5 04:43:06 server101 kernel: HighMem free:2160kB min:128kB low:256kB high:384kB active:99984kB inactive:4132kB present:114624kB
Dec 5 04:43:06 server101 kernel: protections[]: 0 0 64
Dec 5 04:43:06 server101 kernel: DMA: 60*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 240kB
Dec 5 04:43:06 server101 kernel: Normal: 462*4kB 8*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1912kB
Dec 5 04:43:06 server101 kernel: HighMem: 392*4kB 44*8kB 1*16kB 1*32kB 1*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2160kB
Dec 5 04:43:06 server101 kernel: Swap cache: add 1037572, delete 1027816, find 824888/1013359, race 3+2429
Dec 5 04:43:06 server101 kernel: Out of Memory: Killed process 30672 (exim).

How do I fix this? WHat is causing it?
 

Solokron

Well-Known Member
Aug 8, 2003
852
2
168
Seattle
cPanel Access Level
DataCenter Provider
We have the problem with 1 server consistantly crashing on 3am. Still investigating.
 

big

Well-Known Member
Aug 12, 2001
224
0
316
Earth
i think cpanel updates runs at this time and seems something is using all memory?

check exim logs see if someone spams everyday during this time or something
 

chirpy

Well-Known Member
Verifed Vendor
Jun 15, 2002
13,437
33
473
Go on, have a guess
Also check that:

1. You do not have laus installed and if so remove it with:

rpm -e laus

2. Make sure that upcp cpbackup and the daily 04:00 crons do not clash.
 

dgbaker

Well-Known Member
PartnerNOC
Sep 20, 2002
2,531
10
343
Toronto, Ontario Canada
cPanel Access Level
DataCenter Provider
Care to provide more details? Like what error message you are seeing etc...

Also unless you are having the same issue as this thread (crashing daily at the same time) then please do not hijack threads.
 

raquii

Member
Jun 3, 2004
10
0
151
New York, NY
dgbaker said:
Care to provide more details? Like what error message you are seeing etc...
Also unless you are having the same issue as this thread (crashing daily at the same time) then please do not hijack threads.
:confused:
I still can't get into my mail!!!
At all!
Nothing!
Not even an error message!
This is sort of an emergency. This has never happenned to me before.
Not even my website is coming up...
My business is conducted through cPanel.
I will PM you my sign-in string....
 

dgbaker

Well-Known Member
PartnerNOC
Sep 20, 2002
2,531
10
343
Toronto, Ontario Canada
cPanel Access Level
DataCenter Provider
It looks as though your hosting provider is down.

This is based on the nameservers you have configured.

One shows 0 records for your domain, the other is completely unresponsive.

You will need to contact the web hosting company you are using and find out from them what is going on. Not much we can do from here for you in this case.
 

dgbaker

Well-Known Member
PartnerNOC
Sep 20, 2002
2,531
10
343
Toronto, Ontario Canada
cPanel Access Level
DataCenter Provider
cPanel is just a software program licensed to web hosting companies to use for managing their clients and to provide a webbased interface to their clients. It has control on whether they are up or not.

From what I can tell there server/nameservers are down.