Backup and restore inconveniences - Suggestions for doing so with large accounts?

[Optimizr]

Hi,

After reading posts by posts, I backup is now incremental backup retaining on local backup directory which is /mnt/home2/backup. I am not sure if I can call that a local backup because it is as separate drive mounted for rearranging user accounts to save primary drive's storage. If I don't use that for backup, the primary drive can't hold that much data because the backup will be around 1TB soon. So, I am using incremental backup to reduce backup run time and load on server.

With that configuration, the problem is now transporting the backups to S3 compatible storage which doesn't support SSH thus rsync can't be used to transport to that destination.

Now, since WHM doesn't support post backup scripts anymore, I am thinking to schedule a rclone sync (not rsync) command cronjob while keeping a relative distance from backup cron. The problem is, I am not sure it is a good idea. In fact, I am thinking there should be better way. Kindly suggest.

 

[cPAdminsMichael]

I think you have several options:

- Use the "Additional Destinations tab to add Amazon S3"
- rclone/scp ot offsite
- JetBackup

Alternatively you could use a remote rsync storage service...

 

[Optimizr]

I think you have several options:

- Use the "Additional Destinations tab to add Amazon S3"
- rclone/scp ot offsite
- JetBackup

Alternatively you could use a remote rsync storage service...

Correct me if I am wrong but according to my knowledge,

1. Since I am using a manually mounted drive to run and retain backups, it takes longer and more resources to compress backups and transport to destinations under The Additional Destinations tab including Amazon S3 and my current S3 compatible storage (Wasabi). That's why I chose Incremental Backup which is fast and minimum resource consuming but only rsync is supported to transport the backups. rsync needs port 22 and both Amazon s3 and Wasabi S3 do not support port 22. So, can't transport using WHM interface.
2. As I said, I am thinking to use rclone sync with cronjob but thinking there should be better (like transporting as soon as the backup is finished instead of setting a cronjob)
3. JetBackup is for each user but my backup goal is for the all accounts by one person (me). Also JetBackup would add up my backup cost - a lot.
4. remote rsync storage services can ONLY be schedule with cron.

See? I am out of option or am I just doing wrong?

 

[cPanelLauren]

I don't see why you couldn't create a hook. There isn't script hooks anymore but there are standardized hooks and pkgacct is a hookable event: Guide to Standardized Hooks - PkgAcct Functions - Developer Documentation - cPanel Documentation

 

[Optimizr]

@cPanelLauren
Thank you. I will checkout the link. Another thing I found out is that rclone sync is slow and it takes a lot of time to check files even though all files are synced. I know it is a standard procedure and not rclone's fault but do you have any suggestions for backup, restore and transport to S3 according to my use case?

The situation now is; backup fast, restore fast but the transport is painfully slow. Please suggest me better option(s).

 

[antonJetApps]

Hello @Optimizr,

3. JetBackup is for each user but my backup goal is for the all accounts by one person (me). Also JetBackup would add up my backup cost - a lot.

I just wanted to clarify that each JetBackup license covers all accounts hosted on each of your cPanel servers. This includes both the JetBackup WHM and the cPanel User Interface. You also have complete control over the backups for all accounts on your cPanel server via the JetBackup WHM Interface as well as added flexibility of granting each user control over their own backups.

Best Regards,
AntonJetApps.

 

[Optimizr]

Thank you for your clarification. I will look into jetbackup in more detail.

 

[Optimizr]

Just to update the ticket. JetBackup isn't support the incremental backup yet and my use case is best fit with incremental backup, I will find another solution since I am not getting suggestion from @cPanelLauren either.

 

[antonJetApps]

Hello @Optimizr,

Just to update the ticket. JetBackup isn't support the incremental backup yet and my use case is best fit with incremental backup

Just wanted to reach out and clarify that JetBackup does support incremental backups depending on the destination. For a list of destinations that supports incremental backups, please visit JetBackup Destinations Overview.

Thank You,
AntonJetApps.