Server crashes between 3am and 5am every morning

[EdRooney]

My server crashes between 3am and 5am every morning, in the error log it says the following right before the crash:

Dec 5 04:43:06 server101 kernel:
Dec 5 04:43:06 server101 kernel: Free pages: 5496kB (3264kB HighMem)
Dec 5 04:43:06 server101 kernel: Active:23703 inactive:2330 dirty:4 writeback:5 unstable:0 free:1374 slab:5324 mapped:20824 pagetables:1491
Dec 5 04:43:06 server101 kernel: DMA free:240kB min:16kB low:32kB high:48kB active:0kB inactive:0kB present:16384kB
Dec 5 04:43:06 server101 kernel: protections[]: 8 476 540
Dec 5 04:43:06 server101 kernel: Normal free:1992kB min:936kB low:1872kB high:2808kB active:464kB inactive:464kB present:901120kB
Dec 5 04:43:06 server101 kernel: protections[]: 0 468 532
Dec 5 04:43:06 server101 kernel: HighMem free:3264kB min:128kB low:256kB high:384kB active:94348kB inactive:8856kB present:114624kB
Dec 5 04:43:06 server101 kernel: protections[]: 0 0 64
Dec 5 04:43:06 server101 kernel: DMA: 60*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 240kB
Dec 5 04:43:06 server101 kernel: Normal: 494*4kB 2*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1992kB
Dec 5 04:43:06 server101 kernel: HighMem: 380*4kB 134*8kB 28*16kB 1*32kB 1*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3264kB
Dec 5 04:43:06 server101 kernel: Swap cache: add 1037089, delete 1026852, find 824732/1012991, race 3+2429
Dec 5 04:43:06 server101 kernel: Out of Memory: Killed process 30651 (exim).
Dec 5 04:43:06 server101 kernel: oom-killer: gfp_mask=0xd0
Dec 5 04:43:06 server101 kernel: DMA per-cpu:
Dec 5 04:43:06 server101 kernel: cpu 0 hot: low 2, high 6, batch 1
Dec 5 04:43:06 server101 kernel: cpu 0 cold: low 0, high 2, batch 1
Dec 5 04:43:06 server101 kernel: cpu 1 hot: low 2, high 6, batch 1
Dec 5 04:43:06 server101 kernel: cpu 1 cold: low 0, high 2, batch 1
Dec 5 04:43:06 server101 kernel: Normal per-cpu:
Dec 5 04:43:06 server101 kernel: cpu 0 hot: low 32, high 96, batch 16
Dec 5 04:43:06 server101 kernel: cpu 0 cold: low 0, high 32, batch 16
Dec 5 04:43:06 server101 kernel: cpu 1 hot: low 32, high 96, batch 16
Dec 5 04:43:06 server101 kernel: cpu 1 cold: low 0, high 32, batch 16
Dec 5 04:43:06 server101 kernel: HighMem per-cpu:
Dec 5 04:43:06 server101 kernel: cpu 0 hot: low 12, high 36, batch 6
Dec 5 04:43:06 server101 kernel: cpu 0 cold: low 0, high 12, batch 6
Dec 5 04:43:06 server101 kernel: cpu 1 hot: low 12, high 36, batch 6
Dec 5 04:43:06 server101 kernel: cpu 1 cold: low 0, high 12, batch 6
Dec 5 04:43:06 server101 kernel:
Dec 5 04:43:06 server101 kernel: Free pages: 4312kB (2160kB HighMem)
Dec 5 04:43:06 server101 kernel: Active:25095 inactive:1164 dirty:0 writeback:32 unstable:0 free:1078 slab:5359 mapped:21698 pagetables:1523
Dec 5 04:43:06 server101 kernel: DMA free:240kB min:16kB low:32kB high:48kB active:0kB inactive:0kB present:16384kB
Dec 5 04:43:06 server101 kernel: protections[]: 8 476 540
Dec 5 04:43:06 server101 kernel: Normal free:1912kB min:936kB low:1872kB high:2808kB active:396kB inactive:524kB present:901120kB
Dec 5 04:43:06 server101 kernel: protections[]: 0 468 532
Dec 5 04:43:06 server101 kernel: HighMem free:2160kB min:128kB low:256kB high:384kB active:99984kB inactive:4132kB present:114624kB
Dec 5 04:43:06 server101 kernel: protections[]: 0 0 64
Dec 5 04:43:06 server101 kernel: DMA: 60*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 240kB
Dec 5 04:43:06 server101 kernel: Normal: 462*4kB 8*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1912kB
Dec 5 04:43:06 server101 kernel: HighMem: 392*4kB 44*8kB 1*16kB 1*32kB 1*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2160kB
Dec 5 04:43:06 server101 kernel: Swap cache: add 1037572, delete 1027816, find 824888/1013359, race 3+2429
Dec 5 04:43:06 server101 kernel: Out of Memory: Killed process 30672 (exim).

How do I fix this? WHat is causing it?

 

[Solokron]

We have the problem with 1 server consistantly crashing on 3am. Still investigating.

 

[big]

i think cpanel updates runs at this time and seems something is using all memory?

check exim logs see if someone spams everyday during this time or something

 

[chirpy]

Also check that:

1. You do not have laus installed and if so remove it with:

rpm -e laus

2. Make sure that upcp cpbackup and the daily 04:00 crons do not clash.

 

[big]

whats laus?

 

[DigitalN]

whats laus?

Linux Audit-Subsystem (LAuS).

 

[raquii]

OK, so now cPanel doesn't come up at all.
I haven't been able to check my email since 7 pm last night (3/27)
What's going on?

 

[dgbaker]

Care to provide more details? Like what error message you are seeing etc...

Also unless you are having the same issue as this thread (crashing daily at the same time) then please do not hijack threads.

 

[raquii]

Care to provide more details? Like what error message you are seeing etc...
Also unless you are having the same issue as this thread (crashing daily at the same time) then please do not hijack threads.

I still can't get into my mail!!!
At all!
Nothing!
Not even an error message!
This is sort of an emergency. This has never happenned to me before.
Not even my website is coming up...
My business is conducted through cPanel.
I will PM you my sign-in string....

 

[dgbaker]

It looks as though your hosting provider is down.

This is based on the nameservers you have configured.

One shows 0 records for your domain, the other is completely unresponsive.

You will need to contact the web hosting company you are using and find out from them what is going on. Not much we can do from here for you in this case.

 

[raquii]

But I believe Funender.com is also hosted by cPanelX, and their site isn't responding either!!!!

 

[dgbaker]

cPanel is just a software program licensed to web hosting companies to use for managing their clients and to provide a webbased interface to their clients. It has control on whether they are up or not.

From what I can tell there server/nameservers are down.

 

[raquii]

Thank you so much dgbaker for your help with this.
this problem has been resolved.
The server did crash.