Adding a new Parked Domain not working (DNS Cluster issue?)

[pwells]

I am seeing an issue when attempting to add a new Parked Domain (Alias Domain) to a cPanel account. After clicking the button to add the domain, the page loads for about 2 minutes then displays an error.

After reloading the Addon Domains screen the domain is displayed but it does not work (ie. the VirtualHost entry has not been created).

The error log (/usr/local/cpanel/logs/error_log) has the following output:

[2020-02-26 12:45:19 +1100] warn [cpanel] Cpanel::Wrap::send_cpwrapd_request adminbin Cpanel/park/ADD: SIGALRM (#14): namespace=[Cpanel] module=[park] function=[ADD]: set error in context park: raw_response=[{"exit_code":14,"error":1,"statusmsg":"adminbin Cpanel/park/ADD: SIGALRM (#14)","status":1,"mode":"simple","data":"","timeout":0,"version":"2.4","action":"run"}] at /usr/local/cpanel/Cpanel/Wrap.pm line 120, <$socket> line 1.
    Cpanel::Wrap::send_cpwrapd_request("namespace", "Cpanel", "module", "park", "function", "ADD", "data", "mydomain.com.au  1 0", ...) called at /usr/local/cpanel/Cpanel/AdminBin.pm line 57
    Cpanel::AdminBin::adminrun("park", "ADD", "mydomain.com.au", undef, 1, 0) called at /usr/local/cpanel/Cpanel/Park.pm line 282
    Cpanel::Park::_park("mydomain.com.au") called at /usr/local/cpanel/Cpanel/Park.pm line 233
    Cpanel::Park::Park_park("mydomain.com.au") called at cpanel.pl line 1632
    eval {...} called at cpanel.pl line 1632
    cpanel::cpanel::_api1("Park", "park", "park(mydomain.com.au)", "park", ARRAY(0x18bfe40), "safe_html_encode") called at /usr/local/cpanel/Cpanel/Template/Plugin/Api1.pm line 93
    eval {...} called at /usr/local/cpanel/Cpanel/Template/Plugin/Api1.pm line 93
    Cpanel::Template::Plugin::Api1::_api1_exec(0, "Park", "park", ARRAY(0x18bfe40)) called at /usr/local/cpanel/Cpanel/Template/Plugin/Api1.pm line 47
    Cpanel::Template::Plugin::Api1::_captured_api1_exec("Park", "park", ARRAY(0x18bfe40)) called at /usr/local/cpanel/base/frontend/paper_lantern/park/doaddparked.html.tt line 3
    eval {...} called at /usr/local/cpanel/base/frontend/paper_lantern/park/doaddparked.html.tt line 3
    eval {...} called at /usr/local/cpanel/base/frontend/paper_lantern/park/doaddparked.html.tt line 16
    Cpanel::Template::Shared::__ANON__(Template::Context=HASH(0x18b8da0)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Document.pm line 162
    eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Document.pm line 160
    Template::Document::process(Template::Document=HASH(0x18bfe58), Template::Context=HASH(0x18b8da0)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Context.pm line 357
    eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Context.pm line 327
    Template::Context::process(Template::Context=HASH(0x18b8da0), Template::Document=HASH(0x18bfe58)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Service.pm line 94
    eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Service.pm line 91
    Template::Service::process(Template::Service=HASH(0x18b8980), "/usr/local/cpanel/base/frontend/paper_lantern/park/doaddparke"..., HASH(0x18b4448)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template.pm line 64
    Template::process(Template=HASH(0x18b85d8), "/usr/local/cpanel/base/frontend/paper_lantern/park/doaddparke"..., HASH(0x18b4448), SCALAR(0x1405c50)) called at /usr/local/cpanel/Cpanel/Template.pm line 483
    Cpanel::Template::process_template("cpanel", HASH(0x18b4448), HASH(0x18b42b0)) called at cpanel.pl line 1104
    cpanel::cpanel::cptt_exectag("/usr/local/cpanel/base/frontend/paper_lantern/park/doaddparke"..., 1) called at cpanel.pl line 4491
    cpanel::cpanel::run_standard_mode() called at cpanel.pl line 927
    cpanel::cpanel::script("cpanel::cpanel", "./frontend/paper_lantern/park/doaddparked.html.tt") called at cpanel.pl line 321
[2020-02-26 12:45:19 +1100] warn [cpanel] Cpanel::Wrap::send_cpwrapd_request error: namespace=[Cpanel] module=[park] function=[ADD]: set error in context park: statusmsg=[adminbin Cpanel/park/ADD: SIGALRM (#14)] at /usr/local/cpanel/Cpanel/Wrap.pm line 129, <$socket> line 1.
    Cpanel::Wrap::send_cpwrapd_request("namespace", "Cpanel", "module", "park", "function", "ADD", "data", "mydomain.com.au  1 0", ...) called at /usr/local/cpanel/Cpanel/AdminBin.pm line 57
    Cpanel::AdminBin::adminrun("park", "ADD", "mydomain.com.au", undef, 1, 0) called at /usr/local/cpanel/Cpanel/Park.pm line 282
    Cpanel::Park::_park("mydomain.com.au") called at /usr/local/cpanel/Cpanel/Park.pm line 233
    Cpanel::Park::Park_park("mydomain.com.au") called at cpanel.pl line 1632
    eval {...} called at cpanel.pl line 1632
    cpanel::cpanel::_api1("Park", "park", "park(mydomain.com.au)", "park", ARRAY(0x18bfe40), "safe_html_encode") called at /usr/local/cpanel/Cpanel/Template/Plugin/Api1.pm line 93
    eval {...} called at /usr/local/cpanel/Cpanel/Template/Plugin/Api1.pm line 93
    Cpanel::Template::Plugin::Api1::_api1_exec(0, "Park", "park", ARRAY(0x18bfe40)) called at /usr/local/cpanel/Cpanel/Template/Plugin/Api1.pm line 47
    Cpanel::Template::Plugin::Api1::_captured_api1_exec("Park", "park", ARRAY(0x18bfe40)) called at /usr/local/cpanel/base/frontend/paper_lantern/park/doaddparked.html.tt line 3
    eval {...} called at /usr/local/cpanel/base/frontend/paper_lantern/park/doaddparked.html.tt line 3
    eval {...} called at /usr/local/cpanel/base/frontend/paper_lantern/park/doaddparked.html.tt line 16
    Cpanel::Template::Shared::__ANON__(Template::Context=HASH(0x18b8da0)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Document.pm line 162
    eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Document.pm line 160
    Template::Document::process(Template::Document=HASH(0x18bfe58), Template::Context=HASH(0x18b8da0)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Context.pm line 357
    eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Context.pm line 327
    Template::Context::process(Template::Context=HASH(0x18b8da0), Template::Document=HASH(0x18bfe58)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Service.pm line 94
    eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Service.pm line 91
    Template::Service::process(Template::Service=HASH(0x18b8980), "/usr/local/cpanel/base/frontend/paper_lantern/park/doaddparke"..., HASH(0x18b4448)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template.pm line 64
    Template::process(Template=HASH(0x18b85d8), "/usr/local/cpanel/base/frontend/paper_lantern/park/doaddparke"..., HASH(0x18b4448), SCALAR(0x1405c50)) called at /usr/local/cpanel/Cpanel/Template.pm line 483
    Cpanel::Template::process_template("cpanel", HASH(0x18b4448), HASH(0x18b42b0)) called at cpanel.pl line 1104
    cpanel::cpanel::cptt_exectag("/usr/local/cpanel/base/frontend/paper_lantern/park/doaddparke"..., 1) called at cpanel.pl line 4491
    cpanel::cpanel::run_standard_mode() called at cpanel.pl line 927
    cpanel::cpanel::script("cpanel::cpanel", "./frontend/paper_lantern/park/doaddparked.html.tt") called at cpanel.pl line 321
[2020-02-26 12:45:19 +1100] warn [cpanel] Encountered error in Park::park: Park::park failed: adminbin Cpanel/park/ADD: SIGALRM (#14) at /usr/local/cpanel/Cpanel/EventHandler.pm line 46.
    Cpanel::EventHandler::_event(1, "post", "Park", "park", ARRAY(0x18bfe40), ARRAY(0x18c8ab0)) called at cpanel.pl line 1488
    cpanel::cpanel::__ANON__(__CPANEL_HIDDEN__) called at cpanel.pl line 1640
    cpanel::cpanel::_api1("Park", "park", "park(mydomain.com.au)", "park", ARRAY(0x18bfe40), "safe_html_encode") called at /usr/local/cpanel/Cpanel/Template/Plugin/Api1.pm line 93
    eval {...} called at /usr/local/cpanel/Cpanel/Template/Plugin/Api1.pm line 93
    Cpanel::Template::Plugin::Api1::_api1_exec(0, "Park", "park", ARRAY(0x18bfe40)) called at /usr/local/cpanel/Cpanel/Template/Plugin/Api1.pm line 47
    Cpanel::Template::Plugin::Api1::_captured_api1_exec("Park", "park", ARRAY(0x18bfe40)) called at /usr/local/cpanel/base/frontend/paper_lantern/park/doaddparked.html.tt line 3
    eval {...} called at /usr/local/cpanel/base/frontend/paper_lantern/park/doaddparked.html.tt line 3
    eval {...} called at /usr/local/cpanel/base/frontend/paper_lantern/park/doaddparked.html.tt line 16
    Cpanel::Template::Shared::__ANON__(Template::Context=HASH(0x18b8da0)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Document.pm line 162
    eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Document.pm line 160
    Template::Document::process(Template::Document=HASH(0x18bfe58), Template::Context=HASH(0x18b8da0)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Context.pm line 357
    eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Context.pm line 327
    Template::Context::process(Template::Context=HASH(0x18b8da0), Template::Document=HASH(0x18bfe58)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Service.pm line 94
    eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template/Service.pm line 91
    Template::Service::process(Template::Service=HASH(0x18b8980), "/usr/local/cpanel/base/frontend/paper_lantern/park/doaddparke"..., HASH(0x18b4448)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/x86_64-linux-64int/Template.pm line 64
    Template::process(Template=HASH(0x18b85d8), "/usr/local/cpanel/base/frontend/paper_lantern/park/doaddparke"..., HASH(0x18b4448), SCALAR(0x1405c50)) called at /usr/local/cpanel/Cpanel/Template.pm line 483
    Cpanel::Template::process_template("cpanel", HASH(0x18b4448), HASH(0x18b42b0)) called at cpanel.pl line 1104
    cpanel::cpanel::cptt_exectag("/usr/local/cpanel/base/frontend/paper_lantern/park/doaddparke"..., 1) called at cpanel.pl line 4491
    cpanel::cpanel::run_standard_mode() called at cpanel.pl line 927
    cpanel::cpanel::script("cpanel::cpanel", "./frontend/paper_lantern/park/doaddparked.html.tt") called at cpanel.pl line 321

I have also observed that the 'Edit DNS Zone' and 'DNS Clusters' pages in WHM now take over a minute to load (on all cluster members), so perhaps this is related? All cluster members are online and I have tried both a restart of the DNS servers and a complete server reboot.

The domain in question is already pointed to our server (via external DNS - 'Allow Remote Domains' is enabled in Tweak Settings).

Any clues toward what the issue might be? Is there another relevant log that I could look at?

 

[pwells]

An update on this, I found that two of the servers in the DNS cluster couldn't reach each other for some reason. I was not even able to ping between the servers.

This was throwing the following error which was causing this process to crash:

warn [Internal Warning while parsing [stdin] 88948] Use of uninitialized value in string eq at /usr/local/cpanel/Cpanel/DNSLib/PeerStatus.pm line 70.

The ideal solution is to work out why these servers can't communicate (disabling software firewalls didn't help - I suspect it's blocked in a hardware firewall somewhere), but for now I removed these servers from each other in the DNS Cluster and added both to another server, so that DNS updates are routed around the problem connection.

 

[cPanelLauren]

The ideal solution is to work out why these servers can't communicate (disabling software firewalls didn't help - I suspect it's blocked in a hardware firewall somewhere), but for now I removed these servers from each other in the DNS Cluster and added both to another server, so that DNS updates are routed around the problem connection.

If you investigate the HW firewall and still are unable to identify the cause of the issue you may want to open a ticket with us to investigate the issue further.