The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Backups not completing since April 8

Discussion in 'Data Protection' started by Kevin C, Apr 10, 2014.

  1. Kevin C

    Kevin C Member

    Joined:
    Apr 10, 2014
    Messages:
    6
    Likes Received:
    0
    Trophy Points:
    1
    cPanel Access Level:
    Root Administrator
    Something in one of the accounts on the server is killing the backup process. On April 8, the backups did not complete, failing at this account. When killing those backup processes and re-running manually and tailing the logfile, we see it again stop on this particular account;

    Code:
    Copy userdata...Done
Copy custom virtualhost templates...Done
Leaving timeout safety mode
Copying mailman lists and archives....
Done
Copying homedir.............
.........
.........
.........
.........
.........
.........
.........
.........
.........
.........
.........
.........
.........
.........
Done
Calculating nobody files............
Done
Entering timeout safety mode
Determining mysql dbs......mysql version: 5.5......mysqldump version: 5.5...Saving mysql privs...Done
    It has been sitting on this step for 8 hours now and the account only has one database at 20MB so it isn't a size issue. I'm not sure where else to look for a solution to this problem.

    Any help?
     
    #1 Kevin C, Apr 10, 2014
  2. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    36,275
    Likes Received:
    1,201
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Hello :)

    Please run the following command when the restoration is hanging:

    Code:
    ps auxf
    Could you verify which particular process that is hanging?

    Thank you.
     
    #2 cPanelMichael, Apr 10, 2014
  3. Kevin C

    Kevin C Member

    Joined:
    Apr 10, 2014
    Messages:
    6
    Likes Received:
    0
    Trophy Points:
    1
    cPanel Access Level:
    Root Administrator
    Code:
    root     11663  0.0  0.1 180704 26344 ?        SNs  09:27   0:00 /usr/local/cpanel/bin/backup
root     13889  0.0  0.0   4056   496 ?        SN   09:53   0:00  \_ /usr/local/cpanel/bin/cpuwatch 8.0 /usr/local/cpanel/scripts/pkgacct user /backup/2014-04-10/accounts backup
root     13890  0.0  0.3 254932 55140 ?        DNs  09:53   0:00      \_ pkgacct - user - av: 3
    'user' above is being used to mask the actual username.
     
    #3 Kevin C, Apr 10, 2014
  4. Kevin C

    Kevin C Member

    Joined:
    Apr 10, 2014
    Messages:
    6
    Likes Received:
    0
    Trophy Points:
    1
    cPanel Access Level:
    Root Administrator
    Backups still failing this morning

    Really could use some help here, cPanel.
     
    #4 Kevin C, Apr 11, 2014
  5. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    36,275
    Likes Received:
    1,201
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Feel free to open a support ticket so we can take a closer look. You can post the ticket number here so we can update this thread with the outcome.

    Thank you.
     
    #5 cPanelMichael, Apr 11, 2014
  6. Kevin C

    Kevin C Member

    Joined:
    Apr 10, 2014
    Messages:
    6
    Likes Received:
    0
    Trophy Points:
    1
    cPanel Access Level:
    Root Administrator
    Request ID 4807527
     
    #6 Kevin C, Apr 11, 2014
  7. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    36,275
    Likes Received:
    1,201
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    To update, it was determined the issue was related to the NFS mount itself. Processes utilizing the NFS mount were instantly placed in the "D" state.

    Thank you.
     
    #7 cPanelMichael, Apr 14, 2014
  8. keywaystab

    keywaystab Member

    Joined:
    May 26, 2005
    Messages:
    6
    Likes Received:
    0
    Trophy Points:
    151
    Could you post the solution? Was it related to the mount options? Or trouble with the NFS server?
     
    #8 keywaystab, Jun 5, 2014
  9. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    36,275
    Likes Received:
    1,201
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    The backup process was instantly going into a "D" state when attempting to read/write data on the NFS mount. The customer did not report what method or steps they took to resolve the issue, but it was determined not to be related to the cPanel backup script.

    Thank you.
     
    #9 cPanelMichael, Jun 5, 2014
  10. noisetheory

    noisetheory Registered

    Joined:
    Aug 23, 2004
    Messages:
    2
    Likes Received:
    0
    Trophy Points:
    151
    I'm wondering if anyone has any ideas on the solution here.

    I am having the same problem with an NFS mount and it appears the backup process goes to D state immediately when started (though previous days logs show the backup process stopping on a specific account on the same mysql line as posted earlier in the thread).

    i'm not an nfs expert and have tried soft mounts, intr option but no luck. While the backup process fails I can successfully copy various files via command line to the nfs mounted location.

    Suggestions welcome :)
     
    #10 noisetheory, Jun 30, 2014
  11. danny0n

    danny0n Member

    Joined:
    Jan 21, 2010
    Messages:
    8
    Likes Received:
    0
    Trophy Points:
    51
    Did you find any solution for this problem ?

    I have the same problem on one of my servers. What is weird is that I have a second cpanel server with the same configuration, same NFS server and everything works fine there.

    Thank you.
     
    #11 danny0n, Mar 22, 2015
  12. danny0n

    danny0n Member

    Joined:
    Jan 21, 2010
    Messages:
    8
    Likes Received:
    0
    Trophy Points:
    51
    The problem seems to be with the horde database.

    More specifically the process dies at line 1103 of pkgacct script

    Code:
             eval { $horde->backup( $user, $horde_dir, $is_incremental ) };
    For the moment I can't find that horde script.
    If someone can point me to the script I could investigate this further.

    Thank you.
     
    #12 danny0n, Mar 22, 2015
  13. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    36,275
    Likes Received:
    1,201
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Can you backup the horde database manually? EX:

    Code:
    mysqldump horde > /path/to/horde_backup.sql
    Thank you.
     
    #13 cPanelMichael, Mar 23, 2015
  14. danny0n

    danny0n Member

    Joined:
    Jan 21, 2010
    Messages:
    8
    Likes Received:
    0
    Trophy Points:
    51
    Yes, mysqldump works as expected.
    It would have been very weird if it didn't.

    This problem only occurs when using a NFS for backups.
    So probably is something weird happening in the horde backup script that kills the process and I don't think is database related. It works when there is no horde database probably because it skips everything.
     
    #14 danny0n, Mar 30, 2015
  15. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    36,275
    Likes Received:
    1,201
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Feel free to open a support ticket if you believe this is an issue with cPanel/WHM and not with your NFS mount. You can post the ticket number here so we can update this thread with the outcome.

    Thank you.
     
    #15 cPanelMichael, Apr 7, 2015
(You must log in or sign up to post here.)
Loading...
Similar Threads - Backups completing since
  1. webmasteryoda

    Backups not completing properly

    webmasteryoda, Feb 28, 2017, in forum: Data Protection
    Replies:
    6
    Views:
    325
    cPanelMichael
    Mar 1, 2017
  2. Matt Klein

    Backups to Amazon S3 not completing properly

    Matt Klein, Dec 22, 2016, in forum: Data Protection
    Replies:
    1
    Views:
    367
    cPanelMichael
    Dec 23, 2016
  3. Mauritz

    Incremental backups - Could not create hard link

    Mauritz, Jul 7, 2017, in forum: Data Protection
    Replies:
    1
    Views:
    100
    cPanelMichael
    Jul 7, 2017
  4. joaosavioli

    How to restore multiple backups WHM

    joaosavioli, Jun 28, 2017, in forum: Data Protection
    Replies:
    2
    Views:
    107
    kssuhesh
    Jul 2, 2017
  5. Andrew Davis

    Multiple Remote Incremental Backups

    Andrew Davis, May 28, 2017, in forum: Data Protection
    Replies:
    8
    Views:
    245
    Andrew Davis
    May 31, 2017

Share This Page