The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

backup bogs down server... why?

Discussion in 'General Discussion' started by dandanfireman, Oct 23, 2002.

  1. dandanfireman

    dandanfireman Well-Known Member
    PartnerNOC

    Joined:
    May 31, 2002
    Messages:
    117
    Likes Received:
    0
    Trophy Points:
    16
    Why does the load go up? Keep in mind that the files are compressed. So everytime the server is backed up, most of the files on the server are copied and then compressed. What drive/partition are you backing up to?
     
  2. oSM

    oSM Well-Known Member

    Joined:
    Aug 18, 2001
    Messages:
    45
    Likes Received:
    0
    Trophy Points:
    6
    its a dual p3 1.13ghz with 1gb ram

    im backing up to /backup/

    my backup script runs on thursday... how can i set it to run on a sunday at 2am?

    my cron shows:

    6 3 * * * /scripts/upcp

    is this okay?
     
  3. oSM

    oSM Well-Known Member

    Joined:
    Aug 18, 2001
    Messages:
    45
    Likes Received:
    0
    Trophy Points:
    6
    Why does the cpanel backup script slow down the server so much?

    sometimes server loads reaches 8.0 when cpbackup is running.. causing dns or mail server to go down.. Does anyone know a better backup solution?
     
  4. thedetonator

    thedetonator Member

    Joined:
    Aug 31, 2002
    Messages:
    9
    Likes Received:
    0
    Trophy Points:
    1
    I would also like to know how I can set my backups and awstats to run at night. These things cause my server's load to go very high. I have some sites getting 4000 hits per day... so their logs become HUGE!
     
  5. TheVoice

    TheVoice Well-Known Member

    Joined:
    Feb 7, 2002
    Messages:
    105
    Likes Received:
    0
    Trophy Points:
    16
    what are your system specs?
     
  6. SHSaeed

    SHSaeed Well-Known Member

    Joined:
    May 9, 2002
    Messages:
    245
    Likes Received:
    0
    Trophy Points:
    16
    Run it at night when the the traffic is at lowest.
     
  7. rpmws

    rpmws Well-Known Member

    Joined:
    Aug 14, 2001
    Messages:
    1,824
    Likes Received:
    5
    Trophy Points:
    38
    Location:
    back woods of NC, USA
    [quote:aacd4f34e1][i:aacd4f34e1]Originally posted by thedetonator[/i:aacd4f34e1]

    I would also like to know how I can set my backups and awstats to run at night. These things cause my server's load to go very high. I have some sites getting 4000 hits per day... so their logs become HUGE![/quote:aacd4f34e1]

    I have a site that gets 200k hits a day and logs are huge. Backup runs every night. I have never seen over 3.0 on loads. 300 users only.
     
  8. PWSowner

    PWSowner Well-Known Member

    Joined:
    Nov 10, 2001
    Messages:
    2,948
    Likes Received:
    3
    Trophy Points:
    38
    Location:
    ON, Canada
    [quote:e90efceaf5][i:e90efceaf5]Originally posted by oSM[/i:e90efceaf5]

    its a dual p3 1.13ghz with 1gb ram

    im backing up to /backup/

    my backup script runs on thursday... how can i set it to run on a sunday at 2am?

    my cron shows:

    6 3 * * * /scripts/upcp

    is this okay?[/quote:e90efceaf5]


    Your upcp script is running at 3:06am every morning which should be fine. I do my backups at 5am because that's when there is the least activity on my server.
     
  9. oSM

    oSM Well-Known Member

    Joined:
    Aug 18, 2001
    Messages:
    45
    Likes Received:
    0
    Trophy Points:
    6
    Why does it run on a Thursday???? How do I change it to a Sunday????
     
  10. PWSowner

    PWSowner Well-Known Member

    Joined:
    Nov 10, 2001
    Messages:
    2,948
    Likes Received:
    3
    Trophy Points:
    38
    Location:
    ON, Canada
    Right now it is set to run every day, not just Thursday, at 3:06am. To change it you need to edit this file.
    /var/spool/cron/root
    To only have updates run on Sundays at 2am, the upcp line in that file needs to be changed to
    0 2 * * 0 /scripts/upcp
     
  11. oSM

    oSM Well-Known Member

    Joined:
    Aug 18, 2001
    Messages:
    45
    Likes Received:
    0
    Trophy Points:
    6
    THANKS for that.. btw, atm my MRTG script is running via cron,however i deleted MRTG but the CRON cannot find it. I keep getting lots of error messages such as:

    From: Cron Daemon

    /bin/bash: /usr/bin/mrtg: No such file or directory

    ---

    Does anyone know where this CRON file is located? I really want to remove this because I am getting an email sent to me every 5minutes!
     
  12. PWSowner

    PWSowner Well-Known Member

    Joined:
    Nov 10, 2001
    Messages:
    2,948
    Likes Received:
    3
    Trophy Points:
    38
    Location:
    ON, Canada
    You deleted the script but cron is still trying to run it and telling you that it can't find it. You need to remove it from the cron list.
    That one is in the crontab file at
    /etc/crontab

    There is a line like
    0-59/5 * * * * root /usr/bin/mrtg /etc/mrtg/mrtg.cfg
    Just remove it.
     
  13. oSM

    oSM Well-Known Member

    Joined:
    Aug 18, 2001
    Messages:
    45
    Likes Received:
    0
    Trophy Points:
    6
    squirrel you are my HERO!!
    Thanks :) :)
     
  14. PWSowner

    PWSowner Well-Known Member

    Joined:
    Nov 10, 2001
    Messages:
    2,948
    Likes Received:
    3
    Trophy Points:
    38
    Location:
    ON, Canada
    Your welcome. :)
    It was only a couple months ago that I figured this stuff out. I wanted to understand my server so I downloaded the whole thing to my hard drive so I could investigate safely. A lot can be learned by looking through the files.
     
  15. dwayrynen

    dwayrynen Member

    Joined:
    Jun 19, 2002
    Messages:
    22
    Likes Received:
    0
    Trophy Points:
    1
    & Why does the cpanel backup script slow down the server so
    & much?
    &
    & sometimes server loads reaches 8.0 when cpbackup is running..
    & causing dns or mail server to go down.. Does anyone know a
    & better backup solution?

    I have the exact same problem... I've dug around as much as possible and it appears to happen when log files larger than the cache memory available are copied during the backup process.

    Same thing happens when daily backups are rotated to weekly backups - the backups larger than the servers ram will cause the load average to scream out of control and the servers services will become unresponsive to new connections.

    Darin
     
  16. H2Hosting.com

    H2Hosting.com Well-Known Member

    Joined:
    Sep 4, 2001
    Messages:
    192
    Likes Received:
    0
    Trophy Points:
    16
    question to cpanel programmers - what is a reason to include log files into backup??
     
  17. oSM

    oSM Well-Known Member

    Joined:
    Aug 18, 2001
    Messages:
    45
    Likes Received:
    0
    Trophy Points:
    6
    lol.. very true.. WHY do we need to waste extra resources with logfiles? It doesnt help at all and they are HUGE!!!!
     
  18. PWSowner

    PWSowner Well-Known Member

    Joined:
    Nov 10, 2001
    Messages:
    2,948
    Likes Received:
    3
    Trophy Points:
    38
    Location:
    ON, Canada
    Not all log files really do need to be backed up, and not all users want to keep the different log files for the same length of time either. That's when we get into technical stuff by each customizing our system for our own needs.
    I have my error logs being cleaned every Monday morning. The previous weeks error_log file is saved compressed over the last one and a new file is started.
    Every now and then I go in and clean up some of the other log files.
     
  19. ThunderHostingDotCom

    ThunderHostingDotCom Well-Known Member

    Joined:
    Nov 18, 2002
    Messages:
    450
    Likes Received:
    1
    Trophy Points:
    16
    Location:
    All over!
    [quote:2484aa0c38][i:2484aa0c38]Originally posted by squirrel[/i:2484aa0c38]

    Not all log files really do need to be backed up, and not all users want to keep the different log files for the same length of time either. That's when we get into technical stuff by each customizing our system for our own needs.
    I have my error logs being cleaned every Monday morning. The previous weeks error_log file is saved compressed over the last one and a new file is started.
    Every now and then I go in and clean up some of the other log files.[/quote:2484aa0c38]


    Cool web site! How do I configure my server to clean my log files every week?
     
  20. PWSowner

    PWSowner Well-Known Member

    Joined:
    Nov 10, 2001
    Messages:
    2,948
    Likes Received:
    3
    Trophy Points:
    38
    Location:
    ON, Canada
    I'm not sure if there would be problems with cleaning up the logs used for bandwidth monitoring or not so I leave those ones. I just clean up the ones I know can be safely removed. I use a simple script to clean the error logs weekly, and about once a month I go through the rest of them and manually delete the ones I know can be deleted.
    There are likely others who automatically clean up other log files and might know for sure which ones are safe for removing.
     
Loading...

Share This Page