The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Backup large accounts

Discussion in 'Data Protection' started by veronicabend, Apr 9, 2015.

  1. veronicabend

    veronicabend Well-Known Member

    Joined:
    Feb 25, 2005
    Messages:
    52
    Likes Received:
    0
    Trophy Points:
    6
    Hi,

    I have a dedicated server with many domains, some of those are small but a few are about 4-10GB in size.

    I run cpanel backup daily to keep backup copies on a 2nd hard drive.

    I'm having issues because the backup process is running for many hours to get all accounts backed up, and it is causing high server load, particularly when packing up the large accounts.

    The large accounts have many image and video files.

    How should I configure the backups to run? Is it necessary to use a tool other than builtin WHM Backups? I need to keep sites backups without affecting server performance this much.

    Thanks for any help.
     
  2. LostNerd

    LostNerd Well-Known Member

    Joined:
    Mar 12, 2014
    Messages:
    258
    Likes Received:
    11
    Trophy Points:
    18
    Location:
    Hastings, East Sussex, UK
    cPanel Access Level:
    Root Administrator
    Twitter:
    What transport method are you using? (e.g. FTP/Amazon/WebDAV) - I personally now use a custom backup script thanks to @jgillmanjr and his script allows me to manage the amount of threads to allow in an instance whilst uploading to an S3 platform.
     
  3. madmanmachines

    madmanmachines Well-Known Member

    Joined:
    Nov 28, 2014
    Messages:
    94
    Likes Received:
    3
    Trophy Points:
    8
    cPanel Access Level:
    Root Administrator
    Hi,

    This is likely due to I/O. You can use the `sar' command line utility to confirm. You should check the accounts for directories with many(1,000+) files directly within. You should also check mail accounts for the same issue. If mail accounts are large, you should impose mailbox limits or encourage POP for large accounts.

    You may also check Tweak Settings I/O priority and try pigz compression. As well, if you have the space, you may consider disabling compression altogether.

    Thanks,
     
  4. veronicabend

    veronicabend Well-Known Member

    Joined:
    Feb 25, 2005
    Messages:
    52
    Likes Received:
    0
    Trophy Points:
    6
    Currently these backups are being generated to a 2nd hard drive on the same server. The problem is that cpanel takes about 10 hours to complete the backups, during this period several time with high load, especially when it is packing the big accounts.
     
  5. veronicabend

    veronicabend Well-Known Member

    Joined:
    Feb 25, 2005
    Messages:
    52
    Likes Received:
    0
    Trophy Points:
    6
    Yes I think it is due to cpanel backup copying the files over and then gzipping them. That's why I was thinking, if there is a better way to backup cpanel accounts?
     
  6. madmanmachines

    madmanmachines Well-Known Member

    Joined:
    Nov 28, 2014
    Messages:
    94
    Likes Received:
    3
    Trophy Points:
    8
    cPanel Access Level:
    Root Administrator
    If you plan to use compression with your backups, you will likely see similar issues/delay with other methods. You should check for large directories.

    Thanks,
     
  7. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,854
    Likes Received:
    676
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    Hello,

    Have you considered excluding certain large photo and video files and backing them up through another method? If that's an option, then the following document explains how you can exclude certain files from backups:

    cPanel - Backup Exclusions

    Thank you.
     
Loading...

Share This Page