The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

System Stalls Periodically

Discussion in 'Workarounds and Optimization' started by Phylum, Dec 5, 2012.

  1. Phylum

    Phylum Active Member

    Joined:
    Apr 20, 2010
    Messages:
    29
    Likes Received:
    0
    Trophy Points:
    1
    We've run into a peculiar problem: Periodically the server seems to stop responding necessitating a hard reboot. It happened over night & I didn't notice until nearly 11AM. I took a look at /var/log/messages and there's a wealth of information here I'm hoping to get some help in evaluating. From my point of view, it seems we may need to add more memory or configure swap. This is an Amazon VM so adding more memory won't be that easy unless we get bumped up to a larger VM type; which we're not prepared to do.

    Is there anything we could do short of increasing RAM and bouncing the server every X days/weeks to reduce the likelihood of these problems?

    An excerpt of my /var/log/messages can be found here: System hang/crash /var/log/messages - Pastebin.com
     
  2. Phylum

    Phylum Active Member

    Joined:
    Apr 20, 2010
    Messages:
    29
    Likes Received:
    0
    Trophy Points:
    1
    The box tanked again and when I briefly skimmed the logs, saw the same set of errors. I'm trying to figure out whether or not its some third-party add-in/add-on, theme or website that's causing/contributing to this problem.


    Code:
    Dec 11 16:54:43 bawxkname kernel: [3728120.211567] DMA free:4112kB min:3192kB low:3988kB high:4788kB active:569704kB inactive:2452kB present:637952kB pages_scanned:684102 all_unreclaimable? yes
    Dec 11 16:54:43 bawxkname kernel: [3728120.211575] lowmem_reserve[]: 0 0 0 0
    Dec 11 16:54:43 bawxkname kernel: [3728120.211581] DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
    Dec 11 16:54:43 bawxkname kernel: [3728120.211586] lowmem_reserve[]: 0 0 0 0
    Dec 11 16:54:43 bawxkname kernel: [3728120.211591] Normal free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
    Dec 11 16:54:44 bawxkname kernel: [3728120.211598] lowmem_reserve[]: 0 0 0 0
    Dec 11 16:54:44 bawxkname kernel: [3728120.211604] HighMem free:0kB min:128kB low:128kB high:128kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
    Dec 11 16:54:44 bawxkname kernel: [3728120.211609] lowmem_reserve[]: 0 0 0 0
    Dec 11 16:54:44 bawxkname kernel: [3728120.211614] DMA: 250*4kB 15*8kB 1*16kB 1*32kB 0*64kB 1*128kB 1*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 4112kB
    Dec 11 16:54:44 bawxkname kernel: [3728120.211636] DMA32: empty
    Dec 11 16:54:45 bawxkname kernel: [3728120.211638] Normal: empty
    Dec 11 16:54:45 bawxkname kernel: [3728120.211641] HighMem: empty
    Dec 11 16:54:45 bawxkname kernel: [3728120.211646] Swap cache: add 0, delete 0, find 0/0, race 0+0
    Dec 11 16:54:45 bawxkname kernel: [3728120.211649] Free swap  = 0kB
    Dec 11 16:54:45 bawxkname kernel: [3728120.211652] Total swap = 0kB
    Dec 11 16:54:45 bawxkname kernel: [3728120.211654] Free swap:            0kB
    Dec 11 16:54:45 bawxkname kernel: [3728120.212663] 159488 pages of RAM
    Dec 11 16:54:46 bawxkname kernel: [3728120.212665] 4106 reserved pages
    Dec 11 16:54:46 bawxkname kernel: [3728120.212666] 42429 pages shared
    Dec 11 16:54:46 bawxkname kernel: [3728120.212667] 0 pages swap cached
    Dec 11 16:54:46 bawxkname kernel: [3728120.212704] oom-killer: gfp_mask=0x201d2, order=0
    Dec 11 16:54:46 bawxkname kernel: [3728120.212711]
    Dec 11 16:54:47 bawxkname kernel: [3728120.212711] Call Trace:
    Dec 11 16:54:47 bawxkname kernel: [3728120.212719]  [<ffffffff802ba720>] out_of_memory+0x30/0x1a0
    Dec 11 16:54:47 bawxkname kernel: [3728120.212725]  [<ffffffff80210838>] __alloc_pages+0x248/0x2e0
    Dec 11 16:54:47 bawxkname kernel: [3728120.212731]  [<ffffffff802142fe>] __do_page_cache_readahead+0x12e/0x2e0
    Dec 11 16:54:47 bawxkname kernel: [3728120.212737]  [<ffffffff8026c298>] io_schedule+0x28/0x40
    Dec 11 16:54:47 bawxkname kernel: [3728120.212745]  [<ffffffff8026c617>] __wait_on_bit_lock+0x67/0x80
    Dec 11 16:54:48 bawxkname kernel: [3728120.212751]  [<ffffffff802498cf>] __lock_page+0x5f/0x70
    Dec 11 16:54:48 bawxkname kernel: [3728120.212757]  [<ffffffff80215be7>] filemap_nopage+0x157/0x350
    Dec 11 16:54:48 bawxkname kernel: [3728120.212762]  [<ffffffff8020927a>] __handle_mm_fault+0x75a/0x1080
    Dec 11 16:54:48 bawxkname kernel: [3728120.212771]  [<ffffffff8020c235>] do_page_fault+0xe05/0x1220
    Dec 11 16:54:48 bawxkname kernel: [3728120.212777]  [<ffffffff8026945c>] tracesys+0xa7/0xb3
    Dec 11 16:54:48 bawxkname kernel: [3728120.212782]  [<ffffffff802b490a>] audit_syscall_exit+0x31a/0x360
    Dec 11 16:54:48 bawxkname kernel: [3728120.212788]  [<ffffffff8026998f>] error_exit+0x0/0x71
    Dec 11 16:54:48 bawxkname kernel: [3728120.212793]
    Dec 11 16:54:49 bawxkname kernel: [3728120.212795] Mem-info:
    Dec 11 16:54:49 bawxkname kernel: [3728120.212796] DMA per-cpu:
    Dec 11 16:54:49 bawxkname kernel: [3728120.212799] cpu 0 hot: high 186, batch 31 used:117
    Dec 11 16:54:49 bawxkname kernel: [3728120.212804] cpu 0 cold: high 62, batch 15 used:10
    Dec 11 16:54:49 bawxkname kernel: [3728120.212808] DMA32 per-cpu: empty
    Dec 11 16:54:49 bawxkname kernel: [3728120.212810] Normal per-cpu: empty
    Dec 11 16:54:49 bawxkname kernel: [3728120.212814] HighMem per-cpu: empty
    Dec 11 16:54:50 bawxkname kernel: [3728120.212817] Free pages:        4112kB (0kB HighMem)
    Dec 11 16:54:50 bawxkname kernel: [3728120.212821] Active:142426 inactive:613 dirty:1 writeback:0 unstable:0 free:1028 slab:3448 mapped:565 pagetables:2903
    Dec 11 16:54:50 bawxkname kernel: [3728120.212827] DMA free:4112kB min:3192kB low:3988kB high:4788kB active:569704kB inactive:2452kB present:637952kB pages_scanned:684102 all_unreclaimable? yes
    Is this an issue that needs a ticket?
     
Loading...

Share This Page