Weekly/monthly backup causes excessive cpu load

[MironJ]

Hello,

Weekly and monthly backup is causing high cpu load (>10) for over 12 hours.

I see that weekly/monthly backup is simply copied from one location on the backup drive to another location on the same back-up drive.

To be quicker weekly back-ups will have to be drawn from the main hard-drive, and not the same backup drive. Just like is configured in WHM, incremental backup and rsync only what was changed from the last backup.

This will greatly increase the amount of time it takes for weekly/monthly back-ups to complete, and thus the load with it.

Currently daily backup is finished in less than 2 hours, but weekly/monthly backups need 16-20 hours. Tooooooooo much!

Regards,

 

[eth00]

Have you already done a full backup or is that the first full backup it was taking?

Do you have 100's of Gb of data on the machine or do you change a lot of data during a week or months time?

You may want to watch the load during your weekly backup and see what is going on, it generally goes a lot quicker.

 

[MironJ]

It's not a first time backup. I have serveral (12) dedicated servers, 6 years to the 3 months old.
This issue is active in past one month on the three servers, first was on just one server, but in last 2 weeks it's noticed on the second and third server.

All servers are shared with 200-400 cpanel accounts.

Complete /home (or daily backup) folder is between 30 and 50 Gb on the all servers.


Backup log:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[cpbackup] Started at Sat Jun 5 01:00:02 2010
[cpbackup] Running dir & file backup with target : /backup/cpbackup/daily
[cpbackup] Running account backup with target : /backup/cpbackup/daily
......
......
[cpbackup] Copying daily backups to weekly backups for retention
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
Waiting for load to go down to continue
[cpbackup] Executing user defined post backup script (/scripts/postcpbackup).
CleanBackups Plug-in: Detected this script was executed by /scripts/cpbackup
CleanBackups Plug-in: auto clean is ENABLED, running now...
[cpbackup] Completed at Sat Jun 5 13:04:33 2010
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


If I manually terminate weekly/monthly backup proccess, cpu load will automatically drop down from over 10 onto 1-2.


Regards

 

[syslint]

Which backup method are you using ? Is it incremental or compressed backup ?

 

[MironJ]

Incremental backup.

Screenshot attached.

 

[blazenetworks]

Hi

Thanks for the [email protected] also thanks for sharing Incremental back-up with us.

 

[syslint]

If so you need to use SAS HDD's for decreasing I/O