"Copy multiple accounts/packages from another server" streaming /home not allowed

MikeDVB

Well-Known Member
PartnerNOC
Jun 4, 2008
220
6
68
Indiana, USA
It seems as of cPanel 11.28 that WHM will no longer package with --skiphomedir the account and then stream the home directory. Is there a setting to revert it back to the previous behavior by chance that I've missed?

The new method is creating incredibly large loads & sluggishness on the source server while large accounts are being transferred and then the same large loads and sluggishness on the destination server when the account is being restored.

While there may be a "good" reason for this, or maybe somebody who doesn't do transfers on a regular basis though this change would be good - but for large-scale moves such as migrating to new hardware, this is absolutely atrocious.

I wouldn't be here posting this if there was simply a box to select for "stream home directories" instead of none and it doing it the way it's doing it now.

In 3 days I will be transferring 1,500 GB worth of data from several servers to new hardware and the way the system does it now, it's going to cause substantial downtime for customers that would have otherwise had no issues at all with the old method of transferring accounts using this tool.

The only thing that I can think at this point (which almost defeats the purpose of the transfer tool, imho) is to transfer the accounts without the home directory, rsync the /home over manually either before I begin copying accounts themselves or just afterwards... This creates more labor where as the older version of the tool would have accomplished all of this without the extra work.

I'm very frustrated, maybe somebody can point me to a setting I've missed to revert this behavior.
 
Last edited:

JLHC

Member
Aug 9, 2008
7
3
53
cPanel Access Level
Root Administrator
Twitter
re: "Copy multiple accounts/packages from another server" streaming /home not allowed

I have faced this same issue recently myself. :(

It will be best if there can be an option for us to choose whether to use the older method or the current one.
 

MikeDVB

Well-Known Member
PartnerNOC
Jun 4, 2008
220
6
68
Indiana, USA
re: "Copy multiple accounts/packages from another server" streaming /home not allowed

I have faced this same issue recently myself. :(

It will be best if there can be an option for us to choose whether to use the older method or the current one.
I agree - it would be nice to have the option to choose (and not per account, but for the entire process).

For small accounts this likely isn't an issue but we house at least 5 10gb+ accounts per server and each one is going to take a *long* time to package even on Raid10 SAS15k arrays causing extreme sluggishness. I do realize that we can select smaller accounts to copy first, but in the event of something like I'm doing tonight which is migrating a couple of the really large accounts early - it's causing issues.

Just a simple check box on the first page (like, right next to where you have the option to check not sending the home directory at all) would be excellent.

Before it's suggested I open a ticket, I already have one open (1027626).
 
Last edited:

cPanelKenneth

cPanel Development
Staff member
Apr 7, 2006
4,607
80
458
cPanel Access Level
Root Administrator
re: "Copy multiple accounts/packages from another server" streaming /home not allowed

Thank you for reporting this issue. Our developers are currently investigating it. The matter has been assigned case # 44750
 

ffeingol

Well-Known Member
PartnerNOC
Nov 9, 2001
947
425
363
cPanel Access Level
DataCenter Provider
re: "Copy multiple accounts/packages from another server" streaming /home not allowed

Please update this thread with info etc. on this issue. We noticed this over the weekend with a small move to a VPS. We have 2 servers to move to new hardware in the next few weeks and really need this solved.
 

MikeDVB

Well-Known Member
PartnerNOC
Jun 4, 2008
220
6
68
Indiana, USA
re: "Copy multiple accounts/packages from another server" streaming /home not allowed

11.28 is going Stable tonight or tomorrow as near as I understand it... I've been able to roll back our current servers to 11.26 for the transfers we're about to do but the server that isn't coming online until Friday will be forced to 11.28...

I know there are a lot of issues facing cPanel right now but if it's possible to get this fixed within the next few days... That would be amazing.
 

MikeDVB

Well-Known Member
PartnerNOC
Jun 4, 2008
220
6
68
Indiana, USA
re: "Copy multiple accounts/packages from another server" streaming /home not allowed

I was informed of this via ticket:
"The transfer issue (44750) has been resolved and backmerged to 11.28 -- this should be reflected in the next 11.28 builds."

I'm just waiting to see a screen shot of a streaming transfer working on 11.28 before I move back to 11.28.
 

MikeDVB

Well-Known Member
PartnerNOC
Jun 4, 2008
220
6
68
Indiana, USA
re: "Copy multiple accounts/packages from another server" streaming /home not allowed

Confirmed fixed:
http://www.screen-shot.net/2010-11-16_2144.png

I'm not seeing it in release yet myself so I updated the ticket to see what builds it's being pushed to and when we can expect to see it.
 
Last edited:

MikeDVB

Well-Known Member
PartnerNOC
Jun 4, 2008
220
6
68
Indiana, USA
re: "Copy multiple accounts/packages from another server" streaming /home not allowed

Update: It's being pushed to release now and should be available within an hour or so.
 

MikeDVB

Well-Known Member
PartnerNOC
Jun 4, 2008
220
6
68
Indiana, USA
re: "Copy multiple accounts/packages from another server" streaming /home not allowed

I've verified it's in 11.28 Release and I've used it myself :)
 

cPanelDon

cPanel Quality Assurance Analyst
Staff member
Nov 5, 2008
2,544
14
268
Houston, Texas, U.S.A.
cPanel Access Level
DataCenter Provider
re: "Copy multiple accounts/packages from another server" streaming /home not allowed

As many of you have noticed by now, the corrective update from case 44750 was published in cPanel version 11.28.39; the details of this maintenance release are now included in the change log: cPanel & WHM 11.28 Change Log