The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[Case CPANEL-1843] pkgacct on 11.50.2.0 under CentOS 5

Discussion in 'Data Protection' started by tomfra, Oct 7, 2015.

Tags:
  1. tomfra

    tomfra Well-Known Member

    Joined:
    Sep 30, 2002
    Messages:
    62
    Likes Received:
    0
    Trophy Points:
    6
    Hello everyone,

    We had some serious problems earlier Today after a recent cpanel update. Every night cpanel updates itself and then runs a backup. We are using legacy backup still, it's been working OK for us, for several years.

    Tonight at 1:39 AM local time we received the standard cpanel update log, so far so good. Backup normally begins at 1 AM. At 1:57 AM we received "server down" notification.

    So apparently, it crashed during the backup.

    Server was rebooted, raid resynced. Again, so far so good. I launched the backup process again as it did not finish before, via the standard cpanel backup script.

    Some 15 minutes after it launched, server load got extremely high again (like 95+) and had to be rebooted again.

    So apparently, the problem is in the backup process - but as I said, it's been working for years so the recent update is at fault apparently.

    After some log research, it seems the backup was creating an archive and in /var/log/messages there was a "running out of memory" error. A bad process I suppose but have no further information.

    Anyone experiences anything similar? I cannot use the backup system before it's fixed!

    Thanks!

    Tomas
     
  2. qtgame

    qtgame Registered

    Joined:
    Feb 9, 2013
    Messages:
    1
    Likes Received:
    0
    Trophy Points:
    1
    cPanel Access Level:
    Root Administrator
    Hello Tomfra,

    we have a same problem with the backup. After i started manual, 30 min later the LOAD very hight ( >140 ).
    This server have 6GB memory and run out... server start using swap!
    (I temporarily disabled the backup)
    Any other solution?

    Krisztian​
     
  3. tomfra

    tomfra Well-Known Member

    Joined:
    Sep 30, 2002
    Messages:
    62
    Likes Received:
    0
    Trophy Points:
    6
    I have also contacted customer support about this issue and they confirmed there seems to be a problem on CentOS 5 servers, and that it also affects the new/standard backup system. They are trying to find a solution.
     
  4. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,678
    Likes Received:
    654
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    Hello :)

    Internal case number CPANEL-1843 is open to address an issue where systems running CentOS 5 and 11.50.2.0 are locking up due to resource usage when pkgacct (Backups, Transfers) runs. This bug is considered a high priority, and it's likely a resolution will be released in the near future. In the meantime, the current workaround is to downgrade to cPanel version 11.50.1.3 (available on the "Stable" build tier). I will update this thread with more information as it becomes available.

    Thank you.
     
    daflame likes this.
  5. Erik Knepfler

    Erik Knepfler Member

    Joined:
    Sep 2, 2014
    Messages:
    11
    Likes Received:
    0
    Trophy Points:
    1
    Location:
    Long Beach, California, United States
    cPanel Access Level:
    Root Administrator
    I just had two systems freeze this morning during modern backup process which had to be rebooted. Result was incomplete backups. cpbackup logs show it on "Creating archive ..." with many "....." and then it stopped logging when it froze. The drives are basically healthy (one has a handful of read errors but the other does not, on either the source or destination drive.) The odds of both failing in the same way on the same day is pretty low, though one also failed the day before the same way before the other did. One was using compression, one was not.

    Both servers logged this in upcp logs the day it started (Oct 6 2015)
    Code:
    update.1444117681.log:Fetching http://httpupdate.cpanel.net/cpanelsync/transfers_PUBLIC/pkgacct/.cpanelsync.asc (connected:1).......(request attempt 1/12)...@208.109.109.239......connected......receiving...100%......request success......Done
    update.1444117681.log:Fetching http://httpupdate.cpanel.net/cpanelsync/transfers_PUBLIC/pkgacct/.cpanelsync.bz2 (connected:1).......(request attempt 1/12)...@208.109.109.239......connected......receiving...100%......request success......Done
    update.1444117681.log:Fetching http://httpupdate.cpanel.net/cpanelsync/transfers_PUBLIC/pkgacct/.cpanelsync.asc (connected:1).......(request attempt 1/12)...@208.109.109.239......connected......receiving...100%......request success......Done
    update.1444117681.log:Fetching http://httpupdate.cpanel.net/cpanelsync/transfers_PUBLIC/pkgacct/.cpanelsync (connected:1).......(request attempt 1/12)...@208.109.109.239......connected......receiving...100%......request success......Done
    
    
    I wonder if there are issues with those.
     
    #5 Erik Knepfler, Oct 7, 2015
    Last edited by a moderator: Oct 8, 2015
  6. Erik Knepfler

    Erik Knepfler Member

    Joined:
    Sep 2, 2014
    Messages:
    11
    Likes Received:
    0
    Trophy Points:
    1
    Location:
    Long Beach, California, United States
    cPanel Access Level:
    Root Administrator
  7. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,678
    Likes Received:
    654
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    This issue is addressed in cPanel version 11.50.2.2:

    Fixed case CPANEL-1853: pkgacct: Avoid overload on backup on CentOS 5.

    You can update cPanel via "/scripts/upcp" if you are on the "Release" build tier to receive this update.

    Thank you.
     
    daflame likes this.
  8. hostmoon

    hostmoon Well-Known Member

    Joined:
    Aug 4, 2004
    Messages:
    52
    Likes Received:
    0
    Trophy Points:
    6
    I am having this problem with CloudLinux in 11.50.2.2 and had to roll back to 11.50.1.3
     
  9. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,678
    Likes Received:
    654
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    Could you provide more information about which version of Cloud Linux is installed on your system, the exact issue you experienced, and if you were able to verify that 11.50.2.2 was in-fact used "before" this happened?

    Thank you.
     
  10. @home

    @home Well-Known Member

    Joined:
    Nov 5, 2003
    Messages:
    119
    Likes Received:
    0
    Trophy Points:
    16
    cPanel Access Level:
    Root Administrator
    I had the same problems on 3 VPS machines running on Xen With WHM 11.50.2.0 under Centos 5,

    Upgrade to 11.50.2.2 fixed it for me.
     
    #10 @home, Oct 8, 2015
    Last edited: Oct 9, 2015
Loading...

Share This Page