Filed with Developers Exclude files from backup based on a defined maximum size threshold [Case 50767]

[AlexAT]

I'd like to see the backup option "Do not include to backup files in size more than XXX Mb".
Where XXX - configurable (value 0 means that all files included).


Big accounts cause big load so they are usually skipped from backup - and when problem comes then we have no backups of such accounts at all.

But this option allow us to have backups of such accounts. Big files may not included in such backup but major site information will be there and this is very important in case of any failures.

As far as we will have MAJOR load reducing when there is no needs to copy/pack big files.


Please...

[cPanelDon]

Thank you for the suggestion. For ease of understanding the unique feature request and to ensure proper attention I've revised the thread title to better reflect the desired option being requested; if the new thread title does not match what you're looking for please clarify and elaborate with additional detail.

Old Title: "Backup feature: dramatically load reducing"
New Title: "Exclude files from backup based on a defined maximum size threshold"

[AlexAT]

Thank you!

I'd like to add there something about "load reducing".
Since backup overload is a HUGE cPanel problem then I think this addition will be the main reason for cPanel managers and devs to implement this feature ASAP.

[Poopool]

Thank you!

I'd like to add there something about "load reducing".
Since backup overload is a HUGE cPanel problem then I think this addition will be the main reason for cPanel managers and devs to implement this feature ASAP.

You can write a shell script to find big accounts(more than XXX) and put their users in /etc/cpbackup-userskip.conf file.
You can use repquota in your script for finding big accounts then run /scripts/cpbackup, it will exclude users that are listed in cpbackup-userskip.conf

[AlexAT]

That's not a solution since in this way we will have no backups of big accounts at all.
But those accounts may contain many needed for backup information: say 15 DB sites with normal size and 5-7 big AVI.

You can't lost 15 sites content. But you can lost 5-7 big AVIs.
And I do not know other way to get this other than limit files to backup by its size. Do you have another one?

[jdw_id]

Hi, i got this thread from google....

i'm looking for this feature too...

are there any progress since it was already almost 1/2 year ago ?

[AlexAT]

Hi, i got this thread from google....

i'm looking for this feature too...

are there any progress since it was already almost 1/2 year ago ?

If you ask cPanel - no, there is no new to backup for all that time.
If you ask me - yes, I implement custom backup script that goes through accounts and generates "BIG files exclude list". So my clients backups does not contains BIG files and this GREATLY improves the server load.

[cPanelDavidG]

I'll meet with the developers next week to evaluate the practicality of this and see if there's any questions they have that they need answered before I start putting together reports on what is desired etc.

[cPanelDavidG]

I met with our developers and have filed a report requesting this functionality. This feature will now go through review before going to planning. The one thing I added to the report that was not discussed here (but strongly implied) is that database dumps generated by our backup scripts should be exempted from this file size exclusion.

[Xavior82]

a big +1 for this feature as well for me. Backing up large files is a huge ressource drain.

Furthermore, I would like to see additional control on client-generated backups via the cPanel (I am assuming this thread addresses mainly the automated daily backups). More specifically, I would like to (a) exclude large files from user-generated backups via the cPanel as well, and (b) be able to prevent archives from being created for account exceeding X gigs in total size. I know that there are various providers that have implemented their own custom solutions for this, but would like to see this part of cPanel core.

Thanks!