backup bogs down server... why?

[H2Hosting.com]

question to cpanel programmers - what is a reason to include log files into backup??

[oSM]

lol.. very true.. WHY do we need to waste extra resources with logfiles? It doesnt help at all and they are HUGE!!!!

[PWSowner]

Not all log files really do need to be backed up, and not all users want to keep the different log files for the same length of time either. That's when we get into technical stuff by each customizing our system for our own needs.
I have my error logs being cleaned every Monday morning. The previous weeks error_log file is saved compressed over the last one and a new file is started.
Every now and then I go in and clean up some of the other log files.

[ThunderHostingDotCom]

[quote:2484aa0c38][i:2484aa0c38]Originally posted by squirrel[/i:2484aa0c38]

Not all log files really do need to be backed up, and not all users want to keep the different log files for the same length of time either. That's when we get into technical stuff by each customizing our system for our own needs.
I have my error logs being cleaned every Monday morning. The previous weeks error_log file is saved compressed over the last one and a new file is started.
Every now and then I go in and clean up some of the other log files.[/quote:2484aa0c38]


Cool web site! How do I configure my server to clean my log files every week?

[PWSowner]

I'm not sure if there would be problems with cleaning up the logs used for bandwidth monitoring or not so I leave those ones. I just clean up the ones I know can be safely removed. I use a simple script to clean the error logs weekly, and about once a month I go through the rest of them and manually delete the ones I know can be deleted.
There are likely others who automatically clean up other log files and might know for sure which ones are safe for removing.

[Craig]

I would like to see more options for the backup part of cpanel, such as:

1) telling it what i want backing up - essential files, log files, mysql etc.. maybe a tick box for each?
2) Would be nice to set a time, from WHM for when the backup runs.

and for the log runner, again, it would be nice to set a time for this to start &running& so to speak in WHM. As sometimes we get an overlap where its running logs and backing up, causing high loads.

Just my thoughts

Craig.

[JustinK]

I'd like some more options as to what gets backed up and possibly some kind of options file that could be put into directories one didn't want backed up (or at the very least on file with a list of directories/users not to be backed up).

[rpmws]

I posted early on in this thread that my loads were fine during backup.. however since then I started using the backup scripts built into cPanel. Before I was using another. They both do almost exactalyl teh same thing. The main difference is before it would finish in half the time and now It takes hours and I get loads at 15.00 for an hour. Nothing works but backup. sites timeout ..people driving me nuts. This is at 3AM and with almost no traffic on a dual box with 1GB ram also.

any help ..suggestions would be great!!!

[internetfab]

cpbackup --delete seems to be running at 10:30am.. that's not overly healthy
When we did a manual delete of all backup files it took about 6 hours time.. And load was up quite a bit.

Is the cPanel backup still screwed? Any alternatives? Any future fixes?

upcp is set to run at 00:58...

Anyone?


(running stable release, on a 1.3 Ghz AMD single CPU with 1GB RAM and about 200 accounts)

[ThunderHostingDotCom]

It seems to me noone at cPanel plans to answer this HUGE problem! Has anyone put in a feature request? Has anyone put in a trouble ticket & actually received a reply? Let me know because I am having the same problem. Thanks.

[ThunderHostingDotCom]

Originally posted by squirrel
I use a simple script to clean the error logs weekly.

Could you tell me what script you use & where I can find it? Also can you tell me the steps I would have to take to do what you do with your error logs? Keep in mind I am a novice. Thanks.

[ThunderHostingDotCom]

1) I have seen like 3 different cron files people have instructed others to edit. Why are there so many different cron files in so many different places? Can someone provide a list of them all and what each one handels?
2) How can I see if my backup completed without any errors & how long in total it took to run? Is there a log file I can look at or can we have the server email us like cPanel does daily after an update?
4) Where can I find how to properly create a cron job?
5) I want to have my server start a daily backup at 2am and a cPanel update right after that. What file would I edit & what would the cron job be for both of these?

Below is what my /var/spool/cron/root file has in it. I am lost as to what these crons are doing. Can anyone tell me? Thanks in advance for your help.

# DO NOT EDIT THIS FILE - edit the master and reinstall.
# (/scripts/.crontab installed on Sat Jun 14 03:00:03 2003)
# (Cron version -- $Id: crontab.c,v 2.13 1994/01/17 03:20:37 vixie Exp $)

0 3 * * * /scripts/upcp
2,58 * * * * /usr/local/bandmin/bandmin
0 0 * * * /usr/local/bandmin/ipaddrmap
*/5 * * * * /usr/local/cpanel/bin/dcpumon >/dev/null 2>&1

[Stenny Chong]

does it better to backup to another server via rsync? doesn't it is better to backup within the same server? I know it will use little bit more bandwidth per month, but I guess with rsync I can have most recent backup ready.

Thanks.

cPanel.net Support Ticket Number:

[PWSowner]

Originally posted by ThunderHostingDotCom
Could you tell me what script you use & where I can find it? Also can you tell me the steps I would have to take to do what you do with your error logs? Keep in mind I am a novice. Thanks.

I PM'd you.

cPanel.net Support Ticket Number:

[pguy]

Hello Mike,

If possible , please send me the information too on which logs can be deleted and which cannot be. We too have had severe backup issues and we had to resort to disabling daily backups.

We now only do weekly backups and it definitely helps in keeping the server load in check. But I would surely like to know which logs can be pruned to ensure the process goes off without any much loads.

Warm Regards,

cPanel.net Support Ticket Number: