Please whitelist cPanel in your adblocker so that you’re able to see our version release promotions, thanks!

The Community Forums

Interact with an entire community of cPanel & WHM users!

Problem with huge accounts backups

Discussion in 'Data Protection' started by Kent Brockman, May 27, 2015.

  1. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,181
    Likes Received:
    7
    Trophy Points:
    168
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    Hello buddies. I'm noticing this issue when cPanel backup script needs to transfer a backup to a remote destination like Amazon S3. When the account is using several Gigabytes of data, the backup zip file is randomly chunked to 1.2-2.2 GB in size.

    I see this happenning with accounts that allocate more than 10 GB of files, which is not a weird amount of data nowadays. It happens whether I use local or remote backups.

    May this be some kind of OS restriction? I'm using CentOS 6.6 in several VPS. May be a bug in backup script? what steps can I take to troubleshoot it?

    Thanks in advance
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  2. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    44,367
    Likes Received:
    1,855
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Hello,

    Are there any error messages in the backup logs within /usr/local/cpanel/logs/cpbackup/ when this happens? Are you able to extract the archive manually, and if so, do you notice any missing files?

    Thank you.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  3. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,181
    Likes Received:
    7
    Trophy Points:
    168
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    Hello Michael, the logs are not showing any errors. By example, an account weighing 18GB is resulting in a tar.gz file of barely 1.3 GB, and when I decompress that tar.gz, I can see there are mail and public_html folders clearly missing.

    And I'm using pigz. May it be due to a bug on it? should I try with classic gzip?

    Any idea? should I open a ticket?
    Thanks!
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  4. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    44,367
    Likes Received:
    1,855
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Is it possible that certain directories have been excluded in the /etc/cpbackup-exclude.conf file, or in the /home/username/cpbackup-exclude.conf file?

    Thank you.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  5. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,181
    Likes Received:
    7
    Trophy Points:
    168
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    Nope. No exclusions.
    Also, there is plenty of free disk space.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  6. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    44,367
    Likes Received:
    1,855
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Could you open a support ticket using the link in my signature so we can take a closer look? You can post the ticket number here so we can update this thread with the outcome.

    Thank you.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  7. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,181
    Likes Received:
    7
    Trophy Points:
    168
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    Also, if I untar the backup file, it ends with a message:

    And reviewing the extracted files, looks like the compression have included some of the mail accounts and suddenly have been trunked, because there is no public_html nor tmp folders included... And this is happenning in all the huge accounts.

    I'll open a ticket and post its ID...
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  8. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    44,367
    Likes Received:
    1,855
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    The "tar: Unexpected EOF in archive" message indicates archive corruption. It's likely something prevented the archive from generating successfully (e.g. lack of memory, lack of inodes, etc). Feel free to update this thread with the ticket number.

    Thank you.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  9. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,181
    Likes Received:
    7
    Trophy Points:
    168
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    There are hundred of GB of free disk space.
    RAM used: 1.5/8.0 GB
    inodes usage: <5%

    Anyway, the ticket ID is:
    6587589
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  10. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,181
    Likes Received:
    7
    Trophy Points:
    168
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    Hello guys. The problem was caused by Process Tracking feature by CSF plugin, which monitors processes that take to long to finish, and it was set to just kill those processes. That lead to obtaining incomplete backup files. Now that I whitelisted the perl process, may now work as expected.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
  11. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    44,367
    Likes Received:
    1,855
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    I am happy to see the issue is now resolved. Thank you for updating us with the outcome.
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
Loading...

Share This Page

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice