backup bogs down server... why?

dandanfireman

Well-Known Member
PartnerNOC
May 31, 2002
117
0
316
Why does the load go up? Keep in mind that the files are compressed. So everytime the server is backed up, most of the files on the server are copied and then compressed. What drive/partition are you backing up to?
 

oSM

Well-Known Member
Aug 18, 2001
47
0
306
its a dual p3 1.13ghz with 1gb ram

im backing up to /backup/

my backup script runs on thursday... how can i set it to run on a sunday at 2am?

my cron shows:

6 3 * * * /scripts/upcp

is this okay?
 

oSM

Well-Known Member
Aug 18, 2001
47
0
306
Why does the cpanel backup script slow down the server so much?

sometimes server loads reaches 8.0 when cpbackup is running.. causing dns or mail server to go down.. Does anyone know a better backup solution?
 

thedetonator

Member
Aug 31, 2002
9
0
151
I would also like to know how I can set my backups and awstats to run at night. These things cause my server's load to go very high. I have some sites getting 4000 hits per day... so their logs become HUGE!
 

rpmws

Well-Known Member
Aug 14, 2001
1,787
10
318
back woods of NC, USA
[quote:aacd4f34e1][i:aacd4f34e1]Originally posted by thedetonator[/i:aacd4f34e1]

I would also like to know how I can set my backups and awstats to run at night. These things cause my server's load to go very high. I have some sites getting 4000 hits per day... so their logs become HUGE![/quote:aacd4f34e1]

I have a site that gets 200k hits a day and logs are huge. Backup runs every night. I have never seen over 3.0 on loads. 300 users only.
 

PWSowner

Well-Known Member
Nov 10, 2001
2,901
4
343
ON, Canada
[quote:e90efceaf5][i:e90efceaf5]Originally posted by oSM[/i:e90efceaf5]

its a dual p3 1.13ghz with 1gb ram

im backing up to /backup/

my backup script runs on thursday... how can i set it to run on a sunday at 2am?

my cron shows:

6 3 * * * /scripts/upcp

is this okay?[/quote:e90efceaf5]


Your upcp script is running at 3:06am every morning which should be fine. I do my backups at 5am because that's when there is the least activity on my server.
 

oSM

Well-Known Member
Aug 18, 2001
47
0
306
Why does it run on a Thursday???? How do I change it to a Sunday????
 

PWSowner

Well-Known Member
Nov 10, 2001
2,901
4
343
ON, Canada
Right now it is set to run every day, not just Thursday, at 3:06am. To change it you need to edit this file.
/var/spool/cron/root
To only have updates run on Sundays at 2am, the upcp line in that file needs to be changed to
0 2 * * 0 /scripts/upcp
 

oSM

Well-Known Member
Aug 18, 2001
47
0
306
THANKS for that.. btw, atm my MRTG script is running via cron,however i deleted MRTG but the CRON cannot find it. I keep getting lots of error messages such as:

From: Cron Daemon

/bin/bash: /usr/bin/mrtg: No such file or directory

---

Does anyone know where this CRON file is located? I really want to remove this because I am getting an email sent to me every 5minutes!
 

PWSowner

Well-Known Member
Nov 10, 2001
2,901
4
343
ON, Canada
You deleted the script but cron is still trying to run it and telling you that it can't find it. You need to remove it from the cron list.
That one is in the crontab file at
/etc/crontab

There is a line like
0-59/5 * * * * root /usr/bin/mrtg /etc/mrtg/mrtg.cfg
Just remove it.
 

PWSowner

Well-Known Member
Nov 10, 2001
2,901
4
343
ON, Canada
Your welcome. :)
It was only a couple months ago that I figured this stuff out. I wanted to understand my server so I downloaded the whole thing to my hard drive so I could investigate safely. A lot can be learned by looking through the files.
 

dwayrynen

Member
Jun 19, 2002
22
0
151
& Why does the cpanel backup script slow down the server so
& much?
&
& sometimes server loads reaches 8.0 when cpbackup is running..
& causing dns or mail server to go down.. Does anyone know a
& better backup solution?

I have the exact same problem... I've dug around as much as possible and it appears to happen when log files larger than the cache memory available are copied during the backup process.

Same thing happens when daily backups are rotated to weekly backups - the backups larger than the servers ram will cause the load average to scream out of control and the servers services will become unresponsive to new connections.

Darin
 

oSM

Well-Known Member
Aug 18, 2001
47
0
306
lol.. very true.. WHY do we need to waste extra resources with logfiles? It doesnt help at all and they are HUGE!!!!
 

PWSowner

Well-Known Member
Nov 10, 2001
2,901
4
343
ON, Canada
Not all log files really do need to be backed up, and not all users want to keep the different log files for the same length of time either. That's when we get into technical stuff by each customizing our system for our own needs.
I have my error logs being cleaned every Monday morning. The previous weeks error_log file is saved compressed over the last one and a new file is started.
Every now and then I go in and clean up some of the other log files.
 

ThunderHostingDotCom

Well-Known Member
Nov 18, 2002
449
1
168
All over!
[quote:2484aa0c38][i:2484aa0c38]Originally posted by squirrel[/i:2484aa0c38]

Not all log files really do need to be backed up, and not all users want to keep the different log files for the same length of time either. That's when we get into technical stuff by each customizing our system for our own needs.
I have my error logs being cleaned every Monday morning. The previous weeks error_log file is saved compressed over the last one and a new file is started.
Every now and then I go in and clean up some of the other log files.[/quote:2484aa0c38]


Cool web site! How do I configure my server to clean my log files every week?
 

PWSowner

Well-Known Member
Nov 10, 2001
2,901
4
343
ON, Canada
I'm not sure if there would be problems with cleaning up the logs used for bandwidth monitoring or not so I leave those ones. I just clean up the ones I know can be safely removed. I use a simple script to clean the error logs weekly, and about once a month I go through the rest of them and manually delete the ones I know can be deleted.
There are likely others who automatically clean up other log files and might know for sure which ones are safe for removing.