cPanel link from List Accounts page returning 503 'The server is too busy to handle your request'

[Simon Greenwood]

We have a client who is reporting that when they click on the cPanel icon in an account on the List Accounts page on their server they get the attached page. The error logs before the 503 error look like the below. Restarting cpservd appears to fix the error temporarily. There don't seem to be any other issue in the error log.

[2022-09-07 07:57:30 -0400]: “/usr/local/cpanel/scripts/restartsrv_cpsrvd ” called by (18394 - queueprocd - process - restartsrv)
[2022-09-07 07:57:30 -0400] info [cpsrvd] Restarting cpsrvd daemon process 13135 via /usr/local/cpanel/cpsrvd
[2022-09-07 07:57:30 -0400] info [cpsrvd] version 11.104.0.10 online
[2022-09-07 07:57:43 -0400] info [cpsrvd] version 11.104.0.10 online
[2022-09-07 07:59:26 -0400] warn [update_quota_cache] Cpanel::Exception::IO::FileWriteError/(XID wjdcvw) The system failed to write to the file “/home/xxxxxxx/.cpanel/email_accounts.json.lock-13e18514f45a9-18ed8fd95-1100a” because of an error: Disk quota exceeded
[2022-09-07 07:59:26 -0400] warn [update_quota_cache] Cpanel::Exception::IO::FileWriteError/(XID ybvfu3) The system failed to write to the file “/home/xxxxxxx/.cpanel/email_accounts.json.lock-1ee1236f713f3-18ed8fd95-1100a” because of an error: Disk quota exceeded
[2022-09-07 08:07:15 -0400] info [cpsrvd] Request Timeout: "-" 408 Timeout while creating a secure connection
[2022-09-07 08:09:59 -0400] info [cpanellogd] Backup file '/etc/apache2/logs/domlogs/xxxxxxxxxxxxxx.com.bkup' found, completing interrupted processing.
[2022-09-07 08:09:59 -0400] info [cpanellogd] Backup file '/etc/apache2/logs/domlogs/xxxxxxxxxxxxxx.com-ssl_log.bkup' found, completing interrupted processing.
[2022-09-07 08:15:04 -0400] warn [cpaneld] (XID jyr4fd) Documents are not permitted to contain null characters, or new lines. at cpsrvd.pl line 3292, <GEN463> line 2.
[2022-09-07 09:02:27 -0400] warn [update_quota_cache] Cpanel::Exception::IO::FileWriteError/(XID dxmeku) The system failed to write to the file “/home/xxxxxxx/.cpanel/email_accounts.json.lock-26c248f8e0de5-1bd93e195-773” because of an error: Disk quota exceeded
[2022-09-07 09:02:27 -0400] warn [update_quota_cache] Cpanel::Exception::IO::FileWriteError/(XID ch6mjf) The system failed to write to the file “/home/xxxxxxx/.cpanel/email_accounts.json.lock-bef75d143fbd-1bd93e195-773” because of an error: Disk quota exceeded
[2022-09-07 09:21:15 -0400] warn [whostmgrd] (XID 4ycztd) Documents are not permitted to contain null characters, or new lines. at cpsrvd.pl line 3292, <GEN1586> line 2.
[2022-09-07 09:26:36 -0400] warn [cpaneld] (XID q9rq4j) Documents are not permitted to contain null characters, or new lines. at cpsrvd.pl line 3292, <GEN1663> line 2.
[2022-09-07 09:57:19 -0400] warn [cpaneld] (XID vcj2qh) Documents are not permitted to contain null characters, or new lines. at cpsrvd.pl line 3292, <GEN2116> line 2.
[2022-09-07 10:01:16 -0400] warn [cpaneld] (XID vwapqv) Documents are not permitted to contain null characters, or new lines. at cpsrvd.pl line 3292, <GEN2200> line 2.
[2022-09-07 10:07:14 -0400] warn [update_quota_cache] Cpanel::Exception::IO::FileWriteError/(XID fe3zhn) The system failed to write to the file “/home/xxxxxxx/.cpanel/email_accounts.json.lock-118507cd70057-104721515-1a4c” because of an error: Disk quota exceeded
[2022-09-07 10:07:14 -0400] warn [update_quota_cache] Cpanel::Exception::IO::FileWriteError/(XID vzkpzq) The system failed to write to the file “/home/xxxxxxx/.cpanel/email_accounts.json.lock-22daef0a82d2f-104721515-1a4c” because of an error: Disk quota exceeded
[2022-09-07 10:29:40 -0400] info [cpsrvd] Internal Server Error: "-" 503 The server is too busy to handle your request. Please wait a few minutes and try again.
[2022-09-07 10:29:40 -0400] info [cpsrvd] Internal Server Error: "-" 503 The server is too busy to handle your request. Please wait a few minutes and try again.
[2022-09-07 10:29:40 -0400] info [cpsrvd] Internal Server Error: "-" 503 The server is too busy to handle your request. Please wait a few minutes and try again.

 

[HostNoc]

HI

Can you please your disk space usage and see if there any space available on DIsk?.You can check check disk space by using following command

df -h

Regards

 

[Simon Greenwood]

Disk is fine.

Filesystem Size Used Avail Use% Mounted on
devtmpfs 126G 0 126G 0% /dev
tmpfs 126G 12M 126G 1% /dev/shm
tmpfs 126G 4.1G 122G 4% /run
tmpfs 126G 0 126G 0% /sys/fs/cgroup
/dev/md2 1.8T 980G 691G 59% /
/dev/nvme0n1p1 510M 3.7M 507M 1% /boot/efi
/dev/loop0 3.9G 99M 3.6G 3% /tmp
tmpfs 26G 0 26G 0% /run/user/0

The error there is coming from the cPanel quota monitoring script, which makes me think it probably isn't the issue as it seems unlikely that it would cause something as mature as cPanel to trip over.

HI

Can you please your disk space usage and see if there any space available on DIsk?.You can check check disk space by using following command

df -h

Regards

 

[cPRex]

Whenever this has happened in the past, it's always been tricky to troubleshoot after the fact. *If* you can get into the server quickly, can you try these commands to see if there are a lot of cPanel processes running?

ps fauxwww | grep -c whostmgr[d]

ps fauxwww | grep -c cpsrv[d]

The output from either command will just be a number, and typically I'd expect it to be a low number less than 10.

 

[Simon Greenwood]

Good tip, we're just seeing it when the client reports it at the moment. Restarting cpservd seems to fix it for that matter and now I'm wondering if it coincides with update processes on the server.

Whenever this has happened in the past, it's always been tricky to troubleshoot after the fact. *If* you can get into the server quickly, can you try these commands to see if there are a lot of cPanel processes running?

ps fauxwww | grep -c whostmgr[d]

ps fauxwww | grep -c cpsrv[d]

The output from either command will just be a number, and typically I'd expect it to be a low number less than 10.

 

[cPRex]

It's completely possible that error happens briefly during an update.