Task order on a live transfer

[Esquio]

Hi.
I need to know the order what a live transfer from server to server does. I explain:

I need to transfer an account that have 350 GB of email files on 49 email accounts. I need to transfer all this data to another server, but without losing the service in part of client.
My question is what is the order of the tasks that live transfer does with the email accounts? The possibilities are:

1. Create all email accounts, and then transfer the email files.
   or
2. Create one email account, transfer its email files, and repeat with the next account.

I need the first option, the second option can be harmful to the account because while I transfer all the data, the old server will receive new emails. My plan is to set the MX record to the new server and set the mail on remote exchange, but if the accounts are not created yet the emails will be lost. It's because this reason why I need the first option: create all accounts on the first steps of the transfer, and then transfer all the email files.

Can you tell me what is the real order that a live transfer does the tasks?

Thank you so much.

 

[cPRex]

Hey there! Live Transfer, and the Transfer Tool in general, uses option 1, where the cPanel account details are created and then the data is streamed from the home directory of the user account to the new server.

It's always possible there will be updates on the Source machine that won't get carried over to the Destination, even when using Live Transfer. The Live Transfer proxies do get configured quickly, but there is still that potential for something to happen. Just be careful with your timing and planning so this work happens during non-peak hours for the account, and you should have a good experience.

 

[Esquio]

Thank you cPRex! There are all good news. I love transfer tool because makes my life easier, but I have a trouble with this account due the big amount of data and the old server have a mechanic HDD, so it's slower than the SSD on our new servers.

I will solve the problem (I guess) starting the transfer and in the same moment when the target server has all the email accounts in the list, in the old server I will point the MX record on the DNS to the new server, and setup the remote exchanger on the mail configuration. I think this allows the clients to send mails through old server and new emails will receive in the new server during the transfer, but clients will not see the new emails until the transfer ends and the proxy configured. I think it's the best possibility, because I think about the imap-sync possibility (this involves usernames and passwords from 49 users, that they don't have need to be disturbed), and take down the service during the copy, but i think that the MX record is the best thing here.

If you have any suggestions, I will appreciate.

Regards.

 

[cPRex]

I don't think you'll need to do anything manually if you're using Live Transfer, since the traffic will get proxied over. You'll just update the DNS when the transfer is complete and everything will either point to the new machine through the proxies or through actual DNS changes.

 

[Esquio]

I don't think you'll need to do anything manually if you're using Live Transfer, since the traffic will get proxied over. You'll just update the DNS when the transfer is complete and everything will either point to the new machine through the proxies or through actual DNS changes.

But the traffic will be proxied once the copy is finished. During the copy, the problem are the mails that can be received on the old server, but the transfer tool can ignore depending on the files copied, so these few emails are possible to find on the old server, but not on the new server. It's because I try to ensure that zero new received emails will stored only on old server.

If you tell me that the transfer tool tries to resync the new possible files, then it's a perfect solution. If this is not sure, the MX record pointing to new server seems to be better.

 

[cPRex]

The Transfer Tool doesn't have a final sync option just yet. It's something we've talked about adding, but haven't decided just yet.

 

[Esquio]

Ok, thank you. The resync could be fantastic.

Thanks for all the information on this post, it's soooo useful for me to make a decision about the method.

Regards

 

[jpenner]

It would also be good if the account wasn't pointed at the new server until AFTER content is moved. On large accounts, it can mean a total unnecessary outage of a website for a long period (especially if there are a lot of files and it spends a LOT of time doing the incremental file list). This would definitely be made better by a final sync.

 

[Esquio]

It would also be good if the account wasn't pointed at the new server until AFTER content is moved. On large accounts, it can mean a total unnecessary outage of a website for a long period (especially if there are a lot of files and it spends a LOT of time doing the incremental file list). This would definitely be made better by a final sync.

It works as this. While the account is transfered, the old website server still serve the page. When the transfer it's totally done, cPanel suspend the old account and creates a proxy to redirect requests, so there's no outage of websites.

 

[jpenner]

It works as this. While the account is transfered, the old website server still serve the page. When the transfer it's totally done, cPanel suspend the old account and creates a proxy to redirect requests, so there's no outage of websites.

Not as far as I can tell. I've just used the Transfer Tool to move a dozen accounts and each one of them started serving the website from the new server before any content was sent over. So, if the transfer took 20 minutes, the website was offline for most of that.

 

[cPRex]

That's odd - normally I would expect to see what @Esquio outlined. I'm assuming you had the Live Transfer option enabled?

 

[jpenner]

Yes, absolutely. It begins the process and at 18% it starts getting the file list from the source server but everything's now pointing to the new server with no content. Had an ugly one yesterday that was down for nearly 12 hours because of this.

 

[cPRex]

I wasn't able to reproduce this with a test transfer I performed just now. Here is the full log:

Remote Root Account Transfer

    Home /
    Transfers /
    Transfer Tool
    [Documentation]

Warning: This system is not authoritative for the zone “transfertest.com”.
Warning: Contact “transfertest.com”’s registrar and set that domain’s nameservers to “ns1.cprapid.com” and “ns2.cprapid.com”. (For registrar information, visit https://client.rdap.org/?object=transfertest.com&type=domain.)
Warning: You must also make “ns1.cprapid.com” and “ns2.cprapid.com” resolve to this server.
Starting “RESTORE” for “Account” “transfertest”.
Restore File: /home/cpmove-transfertest.tar.gz.part00001
Restore Reseller Privs: no
Restricted mode: no
Live transfer: yes
Target “/home” on host “10-2-35-244.cprapid.com” has 10.8 GB free and requires at least 1.79 MB free, which includes space for temporary files.
Target “/home” on host “10-2-35-244.cprapid.com” has 10,261,850 inodes free and requires at least 68 inodes free, which includes space for temporary files.
The “Reseller” restore module has the following areas disabled by request: “all”
ArchiveManager
Preparing archive for restoration …
Calculating disk space needed …
Done.
Target “/home/cpanelpkgrestore.TMP.work.71ffb3f4/unsafe_to_read_archive” on host “10-2-35-244.cprapid.com” has 10.8 GB free and requires at least 24.31 KB free, which includes space for temporary files.
This archive’s payload appears to be in the archive’s “cpmove-transfertest” directory.
ArchiveManager
The system successfully prepared the archive for restoration.
PreRestoreActions
PreRestoreActions
Account
Force Mode: no
Dedicated IP Address: no
Checking input data...Forced Dns is enabled. Validating Username......Done Validating IP......Done Validating Contact Email......Done ...Done Checking for database conflicts......Done Checking for account enhancements......Done WWWAcct 12.6.0 (c) 2022 cPanel, L.L.C.... +===================================+ | New Account Info | +===================================+ | Domain: transfertest.com | Ip: 10.2.35.244 (n) | HasCgi: n | UserName: transfertest | PassWord: HIDDEN | CpanelMod: jupiter | HomeRoot: /home | Quota: 0 bytes | NameServer1: ns1.cprapid.com | NameServer2: ns2.cprapid.com | NameServer3: | NameServer4: | Contact Email: | Package: default | Feature List: default | Account Enhancements: None | Language: en +===================================+ ...Done Custom Account Data Provided: no Running pre creation script (/usr/local/cpanel/scripts/prewwwacct)......Done Adding User...Removing Shell Access (n) Success...Done Adding Entries to userdata......Done Copying skel files from /root/cpanel3-skel/ to /home/transfertest/......Done Setting up Mail & Local Domains...localdomains...valiases ...vdomainaliases ...vfilters ......Done Configuring DNS...Zone transfertest.com has been successfully added ...Done Verifying MX Records and Setting up Databases...Reconfiguring Mail Routing: LOCAL MAIL EXCHANGER: This server will serve as a primary mail exchanger for transfertest.com's mail.: This configuration has been manually selected. ...Done Updating Authentication Databases......Done Setting passwords......Done Updating the userdata cache......Done Setting up Horde database in the background.......Done Creating bandwidth datastore......Done Updating the dedicated IP address usage cache......Done Generating and installing DKIM keys......Done Enabling Apache SpamAssassin™......Done Enabling Apache SpamAssassin™ Spam Box......Done Sending Account Information......Done Running post creation scripts (/usr/local/cpanel/scripts/legacypostwwwacct, /usr/local/cpanel/scripts/postwwwacct, /usr/local/cpanel/scripts/postwwwacctuser)......Done wwwacct creation finished Account Creation Complete!!!...Account Creation Ok...Done
Account
Account created
CpUser
Restoring cPanel user file.
Updating Caches …
CpUser
CpUser data restored
Homedir
Streaming home directory from source server …
receiving incremental file list
…100 % …
sent 8.26K bytes received 62.19K bytes 46.96K bytes/sec
total size is 1.62M speedup is 23.04
Homedir
Homedir restored
IPAddress
IPAddress
Package
Package
The package exists on the system.
FeatureList
FeatureList
Feature list exists.
Domains
Retrieving and sanitizing main userdata …
Parsing domain databases …
…Subdomains…
…ParkedDomains…
…AddonDomains…
Restoring Domains …
Updating internal databases…
Domains
Domains restored
OldHomedirs
Linking old home directories
OldHomedirs
BrandCustomizations
Restoring customization data
BrandCustomizations
Roundcube
Roundcube
MysqlRemoteNotes
MysqlRemoteNotes
Mysql
Preparing MySQL restore …
Restoring MySQL databases
Restoring MySQL database mappings
Restoring MySQL privileges
Restoring MySQL grants
Restoring MySQL access hosts
Storing MySQL Grants
Mysql
AutoSSL
AutoSSL
BackupConfig
Restoring backup config …
Updated backup config for “transfertest”.
Restoring legacy backup config …
Updated legacy backup config for “transfertest”.
BackupConfig
CustomLocale
CustomLocale
OK
DKIM
DKIM
DKIM restored
DigestShadow
DigestShadow
Horde
Restoring Horde (if any)
Updating the horde configuration.
Running database checks for 1 account(s) … Starting update of 1 user in parallel … ------------------------------------------------------------------------ Summary: Ran database checks on 1 account(s). There were 0 accounts with failures during this process (see above): n/a There were 1 accounts successfully processed: transfertest There were 0 accounts that did not need any work done: n/a
Fixing hostnames: source.domain.com => 10-2-35-244.cprapid.com.
Horde
Integration
Integration
LinkedNodesSubarchives
LinkedNodesSubarchives
Logs
Logs
Mail
Restoring Mail files
Resetting Quotas to sane values
Mail
MailFix
Fixing mail permissions
Converting to maildir if needed
MailFix
MailLimits
Restoring mail limits (if any)
MailLimits
Mailman
Restoring Mailman lists
Mailman
Mailman Restored
NobodyFiles
NobodyFiles
Password
Restoring password …
Password for “transfertest” has been changed.
Password
Postgres
Preparing PostgreSQL restore …
This archive contains no PostgreSQL data.
Postgres
PublicContact
PublicContact
PublicHtmlSymlinks
PublicHtmlSymlinks
Shell
Restoring shell
Setting the user’s shell to “/bin/bash” …
Shell
SpamAssassin
SpamAssassin
Ran SpamAssassin check
Subaccount
Subaccount
Ran Subaccount database checks
Unsuspend
Unsuspending .htaccess files for domains transfertest.com.
Unsuspend
VhostIncludes
Restoring custom virtualhost templates…
VhostIncludes
WebCalls
WebCalls
WebDiskHomedir
WebDiskHomedir
userdata
Restoring userdata…
Restoring userdata for “transfertest.com” …
userdata
Cron
Restoring crontab
Cron
Ftp
Restoring ftp password file
Resyncing FTP Passwords
0
Ftp
Htaccess
Looking for “.htaccess” files …
Updating “transfertest”’s “.htaccess” files …
Updating the system’s web virtual host configuration cache and “.htaccess” files …
Repairing “/home/transfertest/public_html/.htaccess” for EasyApache 4 …
The system mapped “/home/transfertest/public_html/.htaccess” to the virtual host “transfertest.com” …
Htaccess
EasyApache4 was repaired in .htaccess files.
SSL
The SSL certificate is now installed onto the domain “transfertest.com” using the IP address “10.2.35.244”.
SSL
LocalConfig
LocalConfig
Vhosts
Refreshing vhosts and restarting apache
Vhosts
ZoneFile
Restoring DNS zones
Fetching existing zones.
Restoring zone: “transfertest.com”.
Local Zone Updates: “transfertest.com”
ZoneFile
DNSSEC
DNSSEC
MailRouting
Update mail routing
LOCAL MAIL EXCHANGER: This server will serve as a primary mail exchanger for transfertest.com's mail.This configuration has been manually selected.
MailRouting
SPF
Updating SPF Records
SPF
ProxySubdomains
Update service subdomains for “transfertest”.
transfertest.com [REMOVE:[email protected]:10.2.35.244, REMOVE:[email protected]_carddavs._tcp:0 0 2080 source.domain.com., REMOVE:[email protected]_carddavs._tcp:path=/, REMOVE:[email protected]:10.2.35.244, REMOVE:[email protected]_caldav._tcp:0 0 2079 source.domain.com., REMOVE:[email protected]_caldav._tcp:path=/, REMOVE:[email protected]_autodiscover._tcp:0 0 443 cpanelemaildiscovery.cpanel.net., REMOVE:[email protected]_carddav._tcp:0 0 2079 source.domain.com., REMOVE:[email protected]_carddav._tcp:path=/, REMOVE:[email protected]_caldavs._tcp:0 0 2080 source.domain.com., REMOVE:[email protected]_caldavs._tcp:path=/]
ProxySubdomains
PublishZones
Altering sourcedomain.com’s “transfertest” account …
Pointing “transfertest.com”’s DNS records to the new server … …
[xferpoint] server:source.domain.com user:transfertest
[xferpoint] Per request, skipping creation of dynamic content block.
[xferpoint] Updating IP addresses in DNS …
The system updated “11” entries.
[xferpoint] Setting nameservers (ns1.cprapid.com ns2.cprapid.com) …
[xferpoint] complete
Done
Updating mail routing on the source server … …
Setting mail handling for transfertest.com to : secondary
Done
Disabling logins on the source server … …
Locking password for user transfertest.
passwd: Success
Updating FTP passwords for transfertest
FTP password files updated.
FTP vhost passwords synced
Done
Syncing zones to the dns cluster
Cluster Zone Updates: “transfertest.com”
Reloading zones
PublishZones
DNSAuthority
This system is not authoritative for the zone “transfertest.com”.
Local zone’s nameservers: ns1.cprapid.com, ns2.cprapid.com
“ns1.cprapid.com” does not resolve to the local server.
“ns2.cprapid.com” does not resolve to the local server.
“transfertest.com”’s public nameservers: ns1.namebrightdns.com, ns2.namebrightdns.com
Contact “transfertest.com”’s registrar and set that domain’s nameservers to “ns1.cprapid.com” and “ns2.cprapid.com”. (For registrar information, visit https://client.rdap.org/?object=transfertest.com&type=domain.)
You must also make “ns1.cprapid.com” and “ns2.cprapid.com” resolve to this server.
DNSAuthority
ManualMX
Configuring manual MX entries on the source server (sourcedomain.com) …
ManualMX
Manual MX entries configured.
ResyncHomedir
Streaming home directory from source server …
receiving incremental file list
…100 % …
sent 7.99K bytes received 21.76K bytes 19.83K bytes/sec
total size is 1.62M speedup is 54.57
ResyncHomedir
Homedir restored
ServiceProxy
Configuring the source server (sourcedomain.com) to proxy services to the new account …
Terminating “transfertest”’s mailbox sessions on “sourcedomain.com” …
ServiceProxy
MailSync
MailSync
FileProtect
FileProtect
PostRestoreActions
Updating Caches …
Enabling IPv6 for account …
Updating Nameserver IP Address Report
Syncing contact information
PostRestoreActions
Quota
Restoring quota
Quota
APITokens
APITokens
AuthnLinks
AuthnLinks
LinkedNodes
LinkedNodes
BandwidthData
Restoring Bandwidth Data
BandwidthData
Suspend
The user “transfertest” was not suspended. The system will not suspend the restored user.
Suspend
Removing copied archive “/home/cpmove-transfertest.tar.gz.part00001” from the local server …
Success.

The portion of the Live Transfer log that changes the service routing is PublishZone, and if you put all of that code into a text editor that happens in line 210. The Homedir section where the initial data is streamed between the two machines is line 41.

If you could open a ticket with our team we'd be interested in reviewing the specific transfer on your system to see if something went wrong.

 

[jpenner]

Where can I find that logging? What I see running viewtransfer doesn't format that way.

 

[cPRex]

If you visit WHM >> Review Transfers and Restores you should be able to click the log and see the full log entries from there.

 

[jpenner]

Thank you.

Here is the log for the site I mentioned (names changed to protect the innocent). Right after pktacct completed, I am guessing is about 18% through the process and where it begins to receive the incremental file list (which takes a long time with a lot of files). At this point, the DNS is pointing to the new server. Perhaps I'm doing this wrong? I'm running the transfer tool from the destination server in WHM (and confirmed that Live Transfer is on).

Also for clarification, the process after "pkgacct completed" took 19 hours (it should add a timestamp at completion for the logs)

Now you have me wondering... All of my servers use the same nameservers on a DNS cluster. They are 3 nameservers running WHM cPanel only. Are they getting the update too soon perhaps?

Starting “TRANSFER” for “Account” “accounttotransfer”.
Copy Destination: /home
Remote server type: “WHM1164”.
Initiating a remote API (Application Programming Interface) connection in order to package the account in a background process …
[2022-08-03 09:33:13 -0700] pkgacct started.
[2022-08-03 09:33:13 -0700] pkgacct version 10 - user : accounttotransfer - tarball: 1 - target mysql : 5.7 - split: 1 - incremental: 0 - homedir: 0 - mailman: 1 - backup: 0 - archive version: 4 - running with uid 0
[2022-08-03 09:33:13 -0700] pkgacct using '/usr/local/cpanel/3rdparty/bin/pigz -6 --processes 1 --blocksize 128 --rsyncable' to compress archives
[2022-08-03 09:33:13 -0700] pkgacct -- attempting to use daily backup to create an account package
[2022-08-03 09:33:13 -0700] pkgacct -- could not use daily backup because no daily incremental backup for user accounttotransfer can be found ( check if daily incremental backups are enabled )
[2022-08-03 09:33:13 -0700] pkgacct working dir : /home/cpmove-accounttotransfer
[2022-08-03 09:33:13 -0700] Copying Reseller Config...
[2022-08-03 09:33:13 -0700] Done
[2022-08-03 09:33:13 -0700] Copying Suspension Info (if needed)...
[2022-08-03 09:33:13 -0700] Done
[2022-08-03 09:33:13 -0700] Copying installed SSL certificates and keys...
[2022-08-03 09:33:13 -0700] Performing “ApacheTLS” component....
[2022-08-03 09:33:13 -0700] Completed “ApacheTLS” component.
[2022-08-03 09:33:13 -0700] Done
[2022-08-03 09:33:13 -0700] Copying DKIM keys....
[2022-08-03 09:33:13 -0700] Done
[2022-08-03 09:33:13 -0700] Copying Bandwidth Data....
[2022-08-03 09:33:13 -0700] Performing “Bandwidth” component....
[2022-08-03 09:33:13 -0700] Summary databases …
[2022-08-03 09:33:15 -0700] done!
[2022-08-03 09:33:15 -0700] Completed “Bandwidth” component.
[2022-08-03 09:33:15 -0700] Done
[2022-08-03 09:33:15 -0700] Copying Dns Zones....
[2022-08-03 09:33:15 -0700] ...sitetotransfer.com...
[2022-08-03 09:33:15 -0700] Done
[2022-08-03 09:33:15 -0700] Copying Mail files....
[2022-08-03 09:33:15 -0700] Performing “MailConfig” component....
[2022-08-03 09:33:15 -0700] Completed “MailConfig” component.
[2022-08-03 09:33:15 -0700] Done
[2022-08-03 09:33:15 -0700] Copying proftpd file....
[2022-08-03 09:33:15 -0700] Done
[2022-08-03 09:33:15 -0700] Performing “Logs” component....
[2022-08-03 09:33:15 -0700] ...log file sizes [49500 byte(s)]...
[2022-08-03 09:33:15 -0700] ...sitetotransfer.com-ssl_log...
[2022-08-03 09:33:15 -0700] ...sitetotransfer.com-bytes_log...
[2022-08-03 09:33:15 -0700] ...sitetotransfer.com...
[2022-08-03 09:33:15 -0700] Completed “Logs” component.
[2022-08-03 09:33:15 -0700] Copy userdata...
[2022-08-03 09:33:15 -0700] Done
[2022-08-03 09:33:15 -0700] Copy custom virtualhost templates...
[2022-08-03 09:33:15 -0700] Done
[2022-08-03 09:33:15 -0700] Copying mailman lists and archives....
[2022-08-03 09:33:15 -0700] Done copying mailman lists and archives.
[2022-08-03 09:33:15 -0700] Performing “Postgresql” component....
[2022-08-03 09:33:15 -0700] Completed “Postgresql” component.
[2022-08-03 09:33:15 -0700] Performing “Mysql” component....
[2022-08-03 09:33:15 -0700] Determining mysql dbs...
[2022-08-03 09:33:15 -0700] ...mysqldump version: 5.6.51...
[2022-08-03 09:33:15 -0700] ...mysql version: 5.6...
[2022-08-03 09:33:15 -0700] Saving mysql privs...
[2022-08-03 09:33:15 -0700] Done
[2022-08-03 09:33:15 -0700] Saving mysql authentication information...
[2022-08-03 09:33:15 -0700] Done
[2022-08-03 09:33:15 -0700] Storing MySQL databases...
[2022-08-03 09:33:15 -0700] Storing database accounttotransfer_blog
[2022-08-03 09:33:15 -0700] Storing database accounttotransfer_webc593
[2022-08-03 09:33:15 -0700] Done
[2022-08-03 09:33:15 -0700] ...Done
[2022-08-03 09:33:15 -0700] ...Done
[2022-08-03 09:33:15 -0700] Completed “Mysql” component.
[2022-08-03 09:33:15 -0700] Performing “MysqlRemoteNotes” component....
[2022-08-03 09:33:15 -0700] Completed “MysqlRemoteNotes” component.
[2022-08-03 09:33:15 -0700] Performing “CpUserFile” component....
[2022-08-03 09:33:15 -0700] Completed “CpUserFile” component.
[2022-08-03 09:33:15 -0700] Performing “Cron” component....
[2022-08-03 09:33:15 -0700] Readable crontab file (/var/spool/cron/accounttotransfer) found; copying …
[2022-08-03 09:33:15 -0700] Completed “Cron” component.
[2022-08-03 09:33:15 -0700] Performing “Quota” component....
[2022-08-03 09:33:15 -0700] Completed “Quota” component.
[2022-08-03 09:33:15 -0700] Performing “Integration” component....
[2022-08-03 09:33:15 -0700] Completed “Integration” component.
[2022-08-03 09:33:15 -0700] Performing “AuthnLinks” component....
[2022-08-03 09:33:15 -0700] Completed “AuthnLinks” component.
[2022-08-03 09:33:15 -0700] Performing “APITokens” component....
[2022-08-03 09:33:15 -0700] Completed “APITokens” component.
[2022-08-03 09:33:15 -0700] Performing “DNSSEC” component....
[2022-08-03 09:33:15 -0700] Completed “DNSSEC” component.
[2022-08-03 09:33:15 -0700] Performing “Custom” component....
[2022-08-03 09:33:15 -0700] No custom components to perform.
[2022-08-03 09:33:15 -0700] Completed “Custom” component.
[2022-08-03 09:33:15 -0700] Performing “AutoSSL” component....
[2022-08-03 09:33:15 -0700] Completed “AutoSSL” component.
[2022-08-03 09:33:15 -0700] Storing Subdomains....
[2022-08-03 09:33:15 -0700] Done
[2022-08-03 09:33:15 -0700] Storing Parked Domains....
[2022-08-03 09:33:15 -0700] Done
[2022-08-03 09:33:15 -0700] Storing Addon Domains....
[2022-08-03 09:33:15 -0700] Performing “Password” component....
[2022-08-03 09:33:15 -0700] Completed “Password” component.
[2022-08-03 09:33:15 -0700] Performing “DigestShadow” component....
[2022-08-03 09:33:15 -0700] Completed “DigestShadow” component.
[2022-08-03 09:33:15 -0700] Copying shell.......
[2022-08-03 09:33:15 -0700] Done
[2022-08-03 09:33:15 -0700] Performing “WebCalls” component....
[2022-08-03 09:33:15 -0700] Completed “WebCalls” component.
[2022-08-03 09:33:15 -0700] Performing “BrandCustomizations” component....
[2022-08-03 09:33:15 -0700] Completed “BrandCustomizations” component.
[2022-08-03 09:33:15 -0700] Performing “PublicContact” component....
[2022-08-03 09:33:15 -0700] Completed “PublicContact” component.
[2022-08-03 09:33:15 -0700] Performing “MailLimits” component....
[2022-08-03 09:33:15 -0700] Completed “MailLimits” component.
[2022-08-03 09:33:15 -0700] Performing “LinkedNodes” component....
[2022-08-03 09:33:15 -0700] Completed “LinkedNodes” component.
[2022-08-03 09:33:15 -0700] Creating Archive ....
[2022-08-03 09:33:16 -0700] .........
[2022-08-03 09:33:17 -0700]
[2022-08-03 09:33:17 -0700] splitpkgacctfile is: /home/cpmove-accounttotransfer-split/cpmove-accounttotransfer.tar.gz.part00001
[2022-08-03 09:33:17 -0700] splitmd5sum is: a8de7d35f437e866fa9a355333a1df4c
[2022-08-03 09:33:17 -0700] splitsize is: 8339762
[2022-08-03 09:33:17 -0700] Done
[2022-08-03 09:33:17 -0700] mysqlsize is: 151334840
[2022-08-03 09:33:17 -0700] pkgacct completed
Target “/home” on host “destinationserver.com” has 81.35 GB free and requires at least 9.25 GB free, which includes space for temporary files.
Target “/home” on host “destinationserver.com” has 11,062,920 inodes free and requires at least 17,981 inodes free, which includes space for temporary files.
Using the archive split method!
File #1: “/home/cpmove-accounttotransfer-split/cpmove-accounttotransfer.tar.gz.part00001” with md5sum: a8de7d35f437e866fa9a355333a1df4c
Remote file is: “/home/cpmove-accounttotransfer-split/cpmove-accounttotransfer.tar.gz.part00001” with size: 8339762
Attempt #1 to transfer using “WHM” method.
The system will fetch the stream through Remote WHM from host “sourceserver.com:2087” …
…100% @ 0.1662 MiB/s …
Done
Verifying cpmove file checksum …
Checksum Matches (Actual remote username is “accounttotransfer”).
The remote file list contains: /home/cpmove-accounttotransfer-split/cpmove-accounttotransfer.tar.gz.part00001
The local file list contains: /home/cpmove-accounttotransfer.tar.gz.part00001
Copied cpmove file to: “/home/cpmove-accounttotransfer.tar.gz.part00001”.
Success.

 

[cPRex]

There we go - it's the cluster. Once the account gets created that change will get pushed to the cluster so it updates everywhere.

In general, it's best to disable the cluster for a bit while a migration happens or else you run into situations like this.

 

[jpenner]

Ahhh, that's good to know. That would be a good note at the time of transfer [or an option to "Disable cluster until transfer complete"].

Thank you for walking through that with me. Hopefully this information helps someone else out. (and thanks Esquio for allowing me to augment your thread with more info)

 

[cPRex]

Sure thing - you're very welcome!

Do you think there is something we could do better in the interface? We can't really delay the account creation, because the DNS record will get propagated to the cluster as soon as the account exists. Would a "we detected a cluster and this could cause unintended behavior" type of warning help end users?

 

[jpenner]

I think that warning would be VERY useful. I'd never have though that it could be the problem and we've delayed moving large accounts for weeks/months because of that issue. If I'd know it was that simple, that could have saved me a lot of time and money.

Is it possible to temporarily disable the cluster (or have an option to do so) if it was detected and then re-enable it after the transfer is complete if that that temporary disable was detected?