Timeout errors with Cloudflare CDN when running xml php script cron

[Sunlander]

Hi,

I am using the free Cloudflare CDN to help speed up my website but I have an issue with Timeout errors (which occurs when I run a single php script cronjob to import xml files. I am trying to troubleshoot and have followed your instructions here to examine the server logs:

Tutorial - Troubleshooting high server loads on Linux servers

I have attached a file which shows some of the outputs.

In another thread you mention it could be due to Max Request Workers being too low so I increased this to 10000 (is this too high? would this high number cause this issue?).

Is there an example of what optimal settings should look like on servers that run regular cron jobs to import xml files? What might be causing these timeout issues?

Any help would be greatly appreciated

 

[cPanelLauren]

Have you checked the apache error log when the timeout occurs? You can find it at:

/etc/apache2/logs/error_log

It doesn't look like you're experiencing high load or memory issues and I'd be hesitant to say you're reaching max request workers without evidence from the log confirming as much.

 

[Sunlander]

Hi Lauren,

sorry for the delay as I don't seem to receive a notification email when replies come in

I have checked the last 2 pages of the error log after just running the script via the URL the timeout occurs but it didn't seem to show anything related in the error log. In fact the error log shows loads of the same IP address trying to find files on the server. Is that an internal process?

 

[Sunlander]

Regarding the IP address, I have researched this and it appears they are hacking attempts so I have blocked that and a number of others in Bruteforce. I am guessing they are not responsible for timeouts?

 

[Sunlander]

Hi does this mean anything:

[Fri May 17 10:10:18.630635 2019] [proxy_fcgi:error] [pid 10851:tid 47024857384704] (70007)The timeout specified has expired: [client 162.158.155.160:34626] AH01075: Error disp$r dispatching request to : (polling)

It has just appeared in the error logs

Checking the IP address it points to Cloudflare

 

[cPanelLauren]

Is anything noted in the php fpm logs? They're located here dependent on the PHP version you're using:

/opt/cpanel/ea-phpXX/root/usr/var/log/php-fpm/error.log

 

[Sunlander]

Hi,

I have just checked that and this is what it has in that file for right now:

[18-May-2019 08:11:10] NOTICE: [pool mysite_com] child 20320 exited with code 0 after 311.058257 seconds from start
[18-May-2019 08:11:10] NOTICE: [pool mysite_com] child 20465 started
[18-May-2019 08:11:47] NOTICE: [pool mysite_com] child 20322 exited with code 0 after 348.322598 seconds from start
[18-May-2019 08:11:47] NOTICE: [pool mysite_com] child 20469 started
[18-May-2019 08:11:55] NOTICE: [pool mysite_com] child 20321 exited with code 0 after 356.655723 seconds from start
[18-May-2019 08:11:55] NOTICE: [pool mysite_com] child 20470 started
[18-May-2019 08:12:53] NOTICE: [pool mysite_com] child 20339 exited with code 0 after 352.915030 seconds from start
[18-May-2019 08:12:53] NOTICE: [pool mysite_com] child 20531 started
[18-May-2019 08:12:57] NOTICE: [pool mysite_com] child 20342 exited with code 0 after 343.531573 seconds from start
[18-May-2019 08:12:57] NOTICE: [pool mysite_com] child 20535 started
[18-May-2019 08:23:26] NOTICE: [pool mysite_com] child 20570 exited with code 0 after 548.916736 seconds from start
[18-May-2019 08:23:26] NOTICE: [pool mysite_com] child 20807 started
[18-May-2019 08:24:06] NOTICE: [pool mysite_com] child 20618 exited with code 0 after 539.453222 seconds from start
[18-May-2019 08:24:06] NOTICE: [pool mysite_com] child 20818 started
[18-May-2019 08:24:10] NOTICE: [pool mysite_com] child 20619 exited with code 0 after 543.441128 seconds from start
[18-May-2019 08:24:10] NOTICE: [pool mysite_com] child 20819 started
[18-May-2019 08:24:14] NOTICE: [pool mysite_com] child 20620 exited with code 0 after 547.178831 seconds from start
[18-May-2019 08:24:14] NOTICE: [pool mysite_com] child 20820 started
[18-May-2019 08:24:17] NOTICE: [pool mysite_com] child 20621 exited with code 0 after 550.431994 seconds from start
[18-May-2019 08:24:17] NOTICE: [pool mysite_com] child 20821 started
[18-May-2019 08:32:18] NOTICE: [pool mysite_com] child 20821 exited with code 0 after 480.158361 seconds from start
[18-May-2019 08:32:18] NOTICE: [pool mysite_com] child 20998 started
[18-May-2019 08:32:22] NOTICE: [pool mysite_com] child 20820 exited with code 0 after 487.475604 seconds from start
[18-May-2019 08:32:22] NOTICE: [pool mysite_com] child 20999 started
[18-May-2019 08:33:14] NOTICE: [pool mysite_com] child 20855 exited with code 0 after 466.679081 seconds from start
[18-May-2019 08:33:14] NOTICE: [pool mysite_com] child 21046 started
[18-May-2019 08:39:04] NOTICE: [pool mysite_com] child 20998 exited with code 0 after 406.882880 seconds from start
[18-May-2019 08:39:04] NOTICE: [pool mysite_com] child 21239 started
[18-May-2019 08:39:10] NOTICE: [pool mysite_com] child 20999 exited with code 0 after 408.870257 seconds from start
[18-May-2019 08:39:10] NOTICE: [pool mysite_com] child 21240 started
[18-May-2019 08:40:42] NOTICE: [pool mysite_com] child 21046 exited with code 0 after 447.687935 seconds from start
[18-May-2019 08:40:42] NOTICE: [pool mysite_com] child 21272 started
[18-May-2019 08:49:26] NOTICE: [pool mysite_com] child 21367 exited with code 0 after 287.338704 seconds from start
[18-May-2019 08:49:26] NOTICE: [pool mysite_com] child 21533 started
[18-May-2019 08:49:26] NOTICE: [pool mysite_com] child 21366 exited with code 0 after 288.098493 seconds from start
[18-May-2019 08:49:26] NOTICE: [pool mysite_com] child 21534 started
[18-May-2019 08:56:02] NOTICE: [pool mysite_com] child 21533 exited with code 0 after 396.750069 seconds from start
[18-May-2019 08:56:02] NOTICE: [pool mysite_com] child 21696 started
[18-May-2019 08:56:50] NOTICE: [pool mysite_com] child 21534 exited with code 0 after 443.993388 seconds from start
[18-May-2019 08:56:50] NOTICE: [pool mysite_com] child 21701 started
[18-May-2019 08:59:33] NOTICE: [pool mysite_com] child 21580 exited with code 0 after 515.501005 seconds from start
[18-May-2019 08:59:33] NOTICE: [pool mysite_com] child 21787 started

That means absolutely nothing to me

 

[cPanelLauren]

Hi @Sunlander

That info doesn't indicate any issues, just data on the specific process/child processes.
Can you please open a ticket using the link in my signature? Once open please reply with the Ticket ID here so that we can update this thread with the resolution once the ticket is resolved.


Thanks!