Accounts does not Backup to AWS S3, but System does - .master.meta failure

[Andrew Davis]

Hello, I've noticed for some time, that my "accounts" folder of WHM auto-backup is never being copied to my AWS S3 bucket.
However, the "system" folder does appear to successfully be copied/backed-up to S3.

I do notice these seemingly related lines in the "/usr/local/cpanel/logs/cpbackup_transporter/cpbackup_transporter.##########.log" file:

[cpbackup_transporter] Asked to upload backup metadata file /backup/2019-{date}/accounts/.master.meta to Amazon S3 , however this transport does not support that backup type

I assume that the backup of my "accounts" folder may be failing at this line?
Specifically, something regarding the ".master.meta" file?

Can someone please suggest how I may be able to fix this?
Possibly some setting from the AWS side?



Additionally (a slightly different topic), I see that my AWS S3 bucket has the following settings: "Objects can be public"

I see that in "Permissions", "Block public access" options are all set to "Off" (unchecked).

Should I change the settings listed here? Or might it affect my automated WHM backups to S3?

I'll paste the list of "Block public access" options below.

Thanks and kind regards,
Andrew

AWS S3 bucket > Permissions > Block public access

Block all public access
Turning this setting on is the same as turning on all four settings below. Each of the following settings are independent of one another.

• Block public access to buckets and objects granted through new access control lists (ACLs)
  S3 will block public access permissions applied to newly added buckets or objects, and prevent the creation of new public access ACLs for existing buckets and objects. This setting doesn’t change any existing permissions that allow public access to S3 resources using ACLs.

• Block public access to buckets and objects granted through any access control lists (ACLs)
  S3 will ignore all ACLs that grant public access to buckets and objects.

• Block public access to buckets and objects granted through new public bucket policies
  S3 will block new bucket policies that grant public access to buckets and objects. This setting doesn't change any existing policies that allow public access to S3 resources.

• Block public and cross-account access to buckets and objects through any public bucket policies
  S3 will ignore public and cross-account access for buckets with policies that grant public access to buckets and objects.

 

[Andrew Davis]

Update:
From what I read after doing further research, it appears as though WHM does not support Incremental Backups to AWS S3.

However, what's odd is:

1) The "system" folder backs up incrementally just fine, to AWS.

2) I would think that with Incremental Backup setting turned on, that the option to backup to S3 should be disabled, or at least some clear warning that it will fail using the current given settings.


What I did, was went on to set up my own incremental backup script using Restic, run automatically via Cronjob.

So far, this works quite well, and seems to accomplish what I was hoping for.
(Slightly better also, as I can now additionally auto-backup files outside of the cPanel area of my server.)

 

[cPanelLauren]

You can only use the rsync transport with incremental backups, this is noted when you select incremental backups from WHM>>Backup>>Backup Configuration as well.

We do have a feature request open to provide support for incremental backups to different cloud based solutions here if you'd like to vote for it: Incremental Backup in Remote Cloud Storage Locations

I am glad to see that you were able to develop your own solution though and thanks for letting us know how you resolved the issue.