Backup and restore inconveniences - Suggestions for doing so with large accounts?

Operating System & Version
CENTOS 7.8
cPanel & WHM Version
v90.0.5

Optimizr

Active Member
Aug 8, 2020
31
3
8
Yangon
cPanel Access Level
Root Administrator
Hi,

After reading posts by posts, I backup is now incremental backup retaining on local backup directory which is /mnt/home2/backup. I am not sure if I can call that a local backup because it is as separate drive mounted for rearranging user accounts to save primary drive's storage. If I don't use that for backup, the primary drive can't hold that much data because the backup will be around 1TB soon. So, I am using incremental backup to reduce backup run time and load on server.

With that configuration, the problem is now transporting the backups to S3 compatible storage which doesn't support SSH thus rsync can't be used to transport to that destination.

Now, since WHM doesn't support post backup scripts anymore, I am thinking to schedule a rclone sync (not rsync) command cronjob while keeping a relative distance from backup cron. The problem is, I am not sure it is a good idea. In fact, I am thinking there should be better way. Kindly suggest.
 

cPAdminsMichael

Well-Known Member
Dec 19, 2016
129
40
103
Denmark
cPanel Access Level
Root Administrator
I think you have several options:

- Use the "Additional Destinations tab to add Amazon S3"
- rclone/scp ot offsite
- JetBackup

Alternatively you could use a remote rsync storage service...
 
  • Like
Reactions: Optimizr

Optimizr

Active Member
Aug 8, 2020
31
3
8
Yangon
cPanel Access Level
Root Administrator
I think you have several options:

- Use the "Additional Destinations tab to add Amazon S3"
- rclone/scp ot offsite
- JetBackup

Alternatively you could use a remote rsync storage service...
Correct me if I am wrong but according to my knowledge,
  1. Since I am using a manually mounted drive to run and retain backups, it takes longer and more resources to compress backups and transport to destinations under The Additional Destinations tab including Amazon S3 and my current S3 compatible storage (Wasabi). That's why I chose Incremental Backup which is fast and minimum resource consuming but only rsync is supported to transport the backups. rsync needs port 22 and both Amazon s3 and Wasabi S3 do not support port 22. So, can't transport using WHM interface.
  2. As I said, I am thinking to use rclone sync with cronjob but thinking there should be better (like transporting as soon as the backup is finished instead of setting a cronjob)
  3. JetBackup is for each user but my backup goal is for the all accounts by one person (me). Also JetBackup would add up my backup cost - a lot.
  4. remote rsync storage services can ONLY be schedule with cron.
See? I am out of option or am I just doing wrong?
 

cPanelLauren

Product Owner
Staff member
Nov 14, 2017
13,296
1,252
313
Houston
  • Like
Reactions: Optimizr

Optimizr

Active Member
Aug 8, 2020
31
3
8
Yangon
cPanel Access Level
Root Administrator
@cPanelLauren
Thank you. I will checkout the link. Another thing I found out is that rclone sync is slow and it takes a lot of time to check files even though all files are synced. I know it is a standard procedure and not rclone's fault but do you have any suggestions for backup, restore and transport to S3 according to my use case?

The situation now is; backup fast, restore fast but the transport is painfully slow. Please suggest me better option(s).
 

antonJetApps

Registered
Verifed Vendor
Jun 8, 2020
2
2
3
California, U.S.
cPanel Access Level
Root Administrator
Hello @Optimizr,

3. JetBackup is for each user but my backup goal is for the all accounts by one person (me). Also JetBackup would add up my backup cost - a lot.
I just wanted to clarify that each JetBackup license covers all accounts hosted on each of your cPanel servers. This includes both the JetBackup WHM and the cPanel User Interface. You also have complete control over the backups for all accounts on your cPanel server via the JetBackup WHM Interface as well as added flexibility of granting each user control over their own backups.

Best Regards,
AntonJetApps.
 
  • Like
Reactions: Optimizr

antonJetApps

Registered
Verifed Vendor
Jun 8, 2020
2
2
3
California, U.S.
cPanel Access Level
Root Administrator
Hello @Optimizr,

Just to update the ticket. JetBackup isn't support the incremental backup yet and my use case is best fit with incremental backup
Just wanted to reach out and clarify that JetBackup does support incremental backups depending on the destination. For a list of destinations that supports incremental backups, please visit JetBackup Destinations Overview.

Thank You,
AntonJetApps.
 
  • Like
Reactions: cPanelLauren