[Case 74517] Backup System Splitting Certain Folders & Files

ILLUMINICE

Registered
Oct 28, 2012
3
0
1
cPanel Access Level
Root Administrator
I've noticed a peculiar problem in cPanel's backup system that started after the last major upgrade, and was wondering if anyone reading this could help...

Starting in July I noticed a problem in my compressed backups for my accounts. The issue is that when I unzip a tar.gz for certain accounts, some of the files/folders are being split apart from the main backup folder. In other words, when you usually unzip a cPanel backup the first thing you see is a single folder named with the account name. That folder then breaks down into the many account folders, the home directory, etc. But starting last month I noticed that when upzipping a backup there were now two folders, the account folder, and another folder called "home."

Upon looking in this extra folder I discovered that inside it were what appeared to be random folders and files taken from the home directory folder in the backup. It seems that when backing up an account, the backup system is splitting certain folders and files off from the main backup, and is putting them in this extra home folder. At first I thought these folders may have been duplicates of what was in the main backup folder. So I checked and did a comparison. What I discovered was that many of the folders were simply empty, and their counterparts in the main backup folder were indeed there and contained files. But, I found other cases where there were files that were actually split from the main backup folder, and were not in both places.

I started thinking about what may have caused this. One of the big changes made in the cPanel backup system was that it no longer compresses the home directory folder on its own. In the past the home directory was separately compressed, and was embedded in the main tar.gz. You used to have to unzip it separately. The latest revisions to the backup system stopped doing this, and now the home directory is included as a normal folder, and is not zipped.

I think this change is related to the problem I found, because I noticed the folders and files that were being split apart had longer file paths. In other words, they had more folders within folders, or long file names. It's possible that by not compressing the home directory some sort of limit is being reached related to file path length. Perhaps this is why these files and folders are being split off in this way.

Most content managed websites (like WordPress sites) have deeply complex folder/file structures. It can be disastrous if the backups are not true mirrors of what's in the public_html folder. I actually discovered this problem when attempted to restore a WordPress site from a backup. It was very problematic because some of the files/folders were being separated in this way. I had to determine where they came from and reintegrate them with the rest of the files.

Please let me stress that this is a new problem that did not occur prior to the last upgrade to the backup system. I like to think the common denominator is the cause here. Since the home directory is no longer compressed, this is probably related to the cause. I admit its convenient not having it compressed, but by compressing it separately ensures that everything is contained within it.

If anyone can shed some light on this issue, please let me know. I appreciate any help regarding this!

~ Michael
 
Last edited:

cPanelMichael

Administrator
Staff member
Apr 11, 2011
47,880
2,261
463
re: [Case 74517] Backup System Splitting Certain Folders & Files

Hello :)

This type of issue is better addressed directly through the ticket system. Please open a bug report with a specific example of an incomplete archive:

Submit A Bug Report

Let us know the ticket number that is generated so we can update this thread with the outcome.

Thank you.
 

ILLUMINICE

Registered
Oct 28, 2012
3
0
1
cPanel Access Level
Root Administrator
re: [Case 74517] Backup System Splitting Certain Folders & Files

Thank you very much for your suggestion to post this issue directly to the Customer Portal. This is exactly what I have done.

Here is the ticket number so that you can update this thread for others to see... 4315289

I've added additional information to my original description inside the ticket. I hope we can determine the cause of this problem, so our backup system is full proof.

Thank you again!

~ Michael
 

ILLUMINICE

Registered
Oct 28, 2012
3
0
1
cPanel Access Level
Root Administrator
re: [Case 74517] Backup System Splitting Certain Folders & Files

I'm happy to report that this problem was identified by a cPanel Technical Analyst III as a known issue (Case 74517) that has already been corrected internally. Apparently they will be publishing a correction for this issue in the near future. Here is what the analyst had to say....


Hello Michael,

What is happening is that any file exceeding 155 bytes (over 110 characters) won't be properly written to the backup for a user due to becoming orphaned (it isn't assigning the correct user for the backup while being archived).

The details you've provided along with the file name examples do fit with case 74517 that has been filed and fixed internally. It hasn't yet been pushed into a set version, although it would appear in the changelog at Change Logs for 11.38 or 11.40 once published.

Unfortunately, there is no workaround available at this point beyond re-naming files to be shorter, which isn't likely a viable solution in this instance. The best option I would suggest would instead be that anyone needing a backup that isn't functioning properly, you could skip the home directory in pkgacct manually:

/scripts/pkgacct --skiphomedir username

After this, you could copy the /home/username directory for that account:

tar -cvf username-homedir.tar /home/username

If you are going to be moving an account to another location before the case is fixed, you can skip the home directory in WHM > Transfers > Multiple Account Transfers area, then rsync the files or scp them from that user's account to the new machine.

I am terribly sorry for the inconvenience that this occurred. Hopefully, this case will be released into production soon.

Thanks!

--
Tristan J. Wallace
Technical Analyst III, Forums Specialist cPanel, Inc.
 

cPanelMichael

Administrator
Staff member
Apr 11, 2011
47,880
2,261
463
Thank you for updating this thread with the outcome. A resolution for internal case 74517 is scheduled for inclusion in cPanel version 11.38.3 and a future build of cPanel 11.39 (11.39 is the development build for 11.40). There is no specific time frame available, but feel free to monitor the change log for the case number.

Thank you.