Server restarting at random times

[mbekezm]

Holah

I have a problem with the server, i noticed several times when i was working on ssh , the server kept on restarting and kicking me out, after checking logs i got the following from the apache error log

[Sun May 31 23:12:47.806133 2015] [mpm_worker:notice] [pid 1080:tid 140354985400256] AH00297: SIGUSR1 received.  Doing graceful restart

Thats the line where it restarts, here are more of the logs from above

[Sun May 31 19:01:53.743176 2015] [so:warn] [pid 1080:tid 140354985400256] AH01574: module geoip_module is already loaded, skipping
[Sun May 31 19:01:54.003696 2015] [mpm_worker:notice] [pid 1080:tid 140354985400256] AH00292: Apache/2.4.12 (Unix) OpenSSL/1.0.1e-fips mod_bwlimited/1.4 configured -- resuming normal operations
[Sun May 31 19:01:54.003741 2015] [core:notice] [pid 1080:tid 140354985400256] AH00094: Command line: '/usr/local/apache/bin/httpd -D SSL'
[Sun May 31 19:32:51.709917 2015] [core:error] [pid 2618:tid 140354703562496] [client 188.165.15.14:46114] AH00124: Request exceeded the limit of 10 internal redirects due to probable configuration error. Use 'LimitInternalRecursion' to increase the limit if necessary. Use 'LogLevel debug' to get a backtrace.
[Sun May 31 19:32:51.709990 2015] [core:error] [pid 2618:tid 140354703562496] [client 188.165.15.14:46114] AH00124: Request exceeded the limit of 10 internal redirects due to probable configuration error. Use 'LimitInternalRecursion' to increase the limit if necessary. Use 'LogLevel debug' to get a backtrace.
[Sun May 31 19:43:55.455321 2015] [core:error] [pid 2618:tid 140354756011776] [client 66.249.69.26:35335] AH00124: Request exceeded the limit of 10 internal redirects due to probable configuration error. Use 'LimitInternalRecursion' to increase the limit if necessary. Use 'LogLevel debug' to get a backtrace.
[Sun May 31 19:43:55.455378 2015] [core:error] [pid 2618:tid 140354756011776] [client 66.249.69.26:35335] AH00124: Request exceeded the limit of 10 internal redirects due to probable configuration error. Use 'LimitInternalRecursion' to increase the limit if necessary. Use 'LogLevel debug' to get a backtrace.
[Sun May 31 19:43:55.526324 2015] [core:error] [pid 2614:tid 140354703562496] [client 66.249.69.18:41875] AH00124: Request exceeded the limit of 10 internal redirects due to probable configuration error. Use 'LimitInternalRecursion' to increase the limit if necessary. Use 'LogLevel debug' to get a backtrace.
[Sun May 31 19:43:55.526393 2015] [core:error] [pid 2614:tid 140354703562496] [client 66.249.69.18:41875] AH00124: Request exceeded the limit of 10 internal redirects due to probable configuration error. Use 'LimitInternalRecursion' to increase the limit if necessary. Use 'LogLevel debug' to get a backtrace.
[Sun May 31 20:29:11.247894 2015] [core:error] [pid 2614:tid 140354661603072] [client 141.0.11.6:49873] AH00124: Request exceeded the limit of 10 internal redirects due to probable configuration error. Use 'LimitInternalRecursion' to increase the limit if necessary. Use 'LogLevel debug' to get a backtrace.
[Sun May 31 20:29:11.247967 2015] [core:error] [pid 2614:tid 140354661603072] [client 141.0.11.6:49873] AH00124: Request exceeded the limit of 10 internal redirects due to probable configuration error. Use 'LimitInternalRecursion' to increase the limit if necessary. Use 'LogLevel debug' to get a backtrace.
[Sun May 31 21:15:37.038884 2015] [mpm_worker:notice] [pid 1080:tid 140354985400256] AH00297: SIGUSR1 received.  Doing graceful restart
[Sun May 31 21:15:37.105936 2015] [so:warn] [pid 1080:tid 140354985400256] AH01574: module geoip_module is already loaded, skipping
[Sun May 31 21:15:38.066344 2015] [mpm_worker:notice] [pid 1080:tid 140354985400256] AH00292: Apache/2.4.12 (Unix) OpenSSL/1.0.1e-fips mod_bwlimited/1.4 configured -- resuming normal operations
[Sun May 31 21:15:38.066390 2015] [core:notice] [pid 1080:tid 140354985400256] AH00094: Command line: '/usr/local/apache/bin/httpd -D SSL'
[Sun May 31 21:34:05.796543 2015] [access_compat:error] [pid 13650:tid 140354703562496] [client 207.46.13.36:4567] AH01797: client denied by server configuration: /home/paramore/public_html/wp-content/uploads/2014/09/error_log
[Sun May 31 22:00:13.315155 2015] [:error] [pid 13652:tid 140354640623360] [client 194.6.233.49:43947] File does not exist: /home/shorelin/public_html/wp-login.php
[Sun May 31 22:42:10.283142 2015] [:error] [pid 13653:tid 140354567194368] [client 176.60.201.93:59043] File does not exist: /home/selekane/public_html/xmlrpc.php, referer: google.com?=domain
[Sun May 31 23:12:47.806133 2015] [mpm_worker:notice] [pid 1080:tid 140354985400256] AH00297: SIGUSR1 received.  Doing graceful restart
[Sun May 31 23:12:47.873638 2015] [so:warn] [pid 1080:tid 140354985400256] AH01574: module geoip_module is already loaded, skipping
[Sun May 31 23:12:48.011787 2015] [mpm_worker:notice] [pid 1080:tid 140354985400256] AH00292: Apache/2.4.12 (Unix) OpenSSL/1.0.1e-fips mod_bwlimited/1.4 configured -- resuming normal operations
[Sun May 31 23:12:48.011851 2015] [core:notice] [pid 1080:tid 140354985400256] AH00094: Command line: '/usr/local/apache/bin/httpd -D SSL'

Any ideas what could be wrong ?

 

[dalem]

it likely a hardware issue
check your /var/log/messages
& dmesg logs

Apache restarting is not going to reboot the entire machine

 

[mbekezm]

Thank you for your response..

After checking those those logs this is what they contain from around the same time frame

May 31 23:04:21 svr pure-ftpd: ([email protected]) [INFO] New connection from 127.0.0.1
May 31 23:04:21 svr pure-ftpd: ([email protected]) [INFO] Logout.
May 31 23:09:22 svr pure-ftpd: ([email protected]) [INFO] New connection from 127.0.0.1
May 31 23:09:22 svr pure-ftpd: ([email protected]) [INFO] Logout.
May 31 23:10:01 svr kernel: [17772618.555090] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=188.78.103.43 DST=198.71.82.100 LEN=60 TOS=0x08 PREC=0x20 TTL=46 ID=56226 DF PROTO=TCP SPT=59174 DPT=23 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:10:01 svr kernel: [17772618.623206] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=188.78.103.43 DST=198.71.82.119 LEN=60 TOS=0x08 PREC=0x20 TTL=46 ID=11184 DF PROTO=TCP SPT=49819 DPT=23 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:10:01 svr kernel: [17772618.814742] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=188.78.103.43 DST=198.71.82.131 LEN=60 TOS=0x08 PREC=0x20 TTL=46 ID=48761 DF PROTO=TCP SPT=51321 DPT=23 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:10:01 svr kernel: [17772618.872187] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=188.78.103.43 DST=198.71.82.132 LEN=60 TOS=0x08 PREC=0x20 TTL=46 ID=8315 DF PROTO=TCP SPT=53075 DPT=23 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:10:01 svr kernel: [17772618.875366] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=188.78.103.43 DST=198.71.82.135 LEN=60 TOS=0x08 PREC=0x20 TTL=46 ID=61041 DF PROTO=TCP SPT=40532 DPT=23 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:10:04 svr kernel: [17772621.542930] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=188.78.103.43 DST=198.71.82.100 LEN=60 TOS=0x08 PREC=0x20 TTL=46 ID=56227 DF PROTO=TCP SPT=59174 DPT=23 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:10:10 svr kernel: [17772627.574799] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=188.78.103.43 DST=198.71.82.100 LEN=60 TOS=0x08 PREC=0x20 TTL=46 ID=56228 DF PROTO=TCP SPT=59174 DPT=23 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:10:10 svr kernel: [17772627.627373] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=188.78.103.43 DST=198.71.82.119 LEN=60 TOS=0x08 PREC=0x20 TTL=46 ID=11186 DF PROTO=TCP SPT=49819 DPT=23 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:10:10 svr kernel: [17772627.815909] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=188.78.103.43 DST=198.71.82.131 LEN=60 TOS=0x08 PREC=0x20 TTL=46 ID=48763 DF PROTO=TCP SPT=51321 DPT=23 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:11:00 svr kernel: [17772677.431015] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=23.238.137.204 DST=198.71.82.100 LEN=40 TOS=0x08 PREC=0x40 TTL=106 ID=256 PROTO=TCP SPT=6000 DPT=3306 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:11:00 svr kernel: [17772677.439048] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=23.238.137.204 DST=198.71.82.119 LEN=40 TOS=0x08 PREC=0x40 TTL=106 ID=256 PROTO=TCP SPT=6000 DPT=3306 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:11:00 svr kernel: [17772677.445268] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=23.238.137.204 DST=198.71.82.135 LEN=40 TOS=0x08 PREC=0x40 TTL=106 ID=256 PROTO=TCP SPT=6000 DPT=3306 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:11:00 svr kernel: [17772677.445351] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=23.238.137.204 DST=198.71.82.131 LEN=40 TOS=0x08 PREC=0x40 TTL=106 ID=256 PROTO=TCP SPT=6000 DPT=3306 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:11:00 svr kernel: [17772677.445412] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=23.238.137.204 DST=198.71.82.132 LEN=40 TOS=0x08 PREC=0x40 TTL=106 ID=256 PROTO=TCP SPT=6000 DPT=3306 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:11:08 svr kernel: [17772685.233113] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=61.240.144.66 DST=198.71.82.100 LEN=40 TOS=0x08 PREC=0x40 TTL=234 ID=11750 PROTO=TCP SPT=60000 DPT=11211 WINDOW=1024 RES=0x00 SYN URGP=0
May 31 23:12:39 svr kernel: [17772776.547426] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=61.160.213.32 DST=198.71.82.131 LEN=40 TOS=0x00 PREC=0x00 TTL=109 ID=2560 PROTO=TCP SPT=33122 DPT=3128 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:12:39 svr kernel: [17772776.554764] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=61.160.213.32 DST=198.71.82.135 LEN=40 TOS=0x00 PREC=0x00 TTL=108 ID=2560 PROTO=TCP SPT=33122 DPT=3128 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:12:39 svr kernel: [17772776.558848] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=61.160.213.32 DST=198.71.82.132 LEN=40 TOS=0x08 PREC=0x20 TTL=107 ID=2560 PROTO=TCP SPT=33122 DPT=3128 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:12:39 svr kernel: [17772776.652309] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=61.160.213.32 DST=198.71.82.100 LEN=40 TOS=0x08 PREC=0x20 TTL=108 ID=2560 PROTO=TCP SPT=33122 DPT=3128 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:12:39 svr kernel: [17772776.657749] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=61.160.213.32 DST=198.71.82.119 LEN=40 TOS=0x08 PREC=0x20 TTL=107 ID=2560 PROTO=TCP SPT=33122 DPT=3128 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:13:30 svr lfd[761]: SYSLOG check [egt6NRuFV3TYai5O5U1xq7z]
May 31 23:14:09 svr kernel: [17772866.492423] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=112.220.63.83 DST=198.71.82.119 LEN=40 TOS=0x08 PREC=0x40 TTL=233 ID=14495 PROTO=TCP SPT=58980 DPT=5900 WINDOW=1024 RES=0x00 SYN URGP=0
May 31 23:14:23 svr pure-ftpd: ([email protected]) [INFO] New connection from 127.0.0.1
May 31 23:14:23 svr pure-ftpd: ([email protected]) [INFO] Logout.
May 31 23:15:04 svr kernel: [17772921.724453] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=71.6.165.200 DST=198.71.82.100 LEN=40 TOS=0x10 PREC=0x00 TTL=114 ID=32668 PROTO=TCP SPT=1572 DPT=2628 WINDOW=64716 RES=0x00 SYN URGP=0
May 31 23:15:52 svr kernel: [17772970.046078] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=113.108.21.16 DST=198.71.82.100 LEN=40 TOS=0x08 PREC=0x20 TTL=46 ID=0 DF PROTO=TCP SPT=22205 DPT=1723 WINDOW=8192 RES=0x00 SYN URGP=0
May 31 23:15:52 svr kernel: [17772970.057767] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=113.108.21.16 DST=198.71.82.119 LEN=40 TOS=0x00 PREC=0x00 TTL=47 ID=0 DF PROTO=TCP SPT=22206 DPT=1723 WINDOW=8192 RES=0x00 SYN URGP=0
May 31 23:15:52 svr kernel: [17772970.063705] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=113.108.21.16 DST=198.71.82.131 LEN=40 TOS=0x00 PREC=0x00 TTL=47 ID=0 DF PROTO=TCP SPT=22206 DPT=1723 WINDOW=8192 RES=0x00 SYN URGP=0
May 31 23:15:52 svr kernel: [17772970.067510] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=113.108.21.16 DST=198.71.82.135 LEN=40 TOS=0x00 PREC=0x00 TTL=47 ID=0 DF PROTO=TCP SPT=22200 DPT=1723 WINDOW=8192 RES=0x00 SYN URGP=0
May 31 23:15:53 svr kernel: [17772970.142100] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=113.108.21.16 DST=198.71.82.132 LEN=40 TOS=0x08 PREC=0x20 TTL=46 ID=0 DF PROTO=TCP SPT=22202 DPT=1723 WINDOW=8192 RES=0x00 SYN URGP=0
May 31 23:19:24 svr pure-ftpd: ([email protected]) [INFO] New connection from 127.0.0.1
May 31 23:19:24 svr pure-ftpd: ([email protected]) [INFO] Logout.
May 31 23:19:58 svr kernel: [17773216.056599] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=117.199.125.202 DST=198.71.82.119 LEN=60 TOS=0x08 PREC=0x20 TTL=47 ID=33061 DF PROTO=TCP SPT=52546 DPT=23 WINDOW=5840 RES=0x00 SYN URGP=0
May 31 23:20:01 svr kernel: [17773219.055437] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=117.199.125.202 DST=198.71.82.119 LEN=60 TOS=0x08 PREC=0x20 TTL=47 ID=33062 DF PROTO=TCP SPT=52546 DPT=23 WINDOW=5840 RES=0x00 SYN URGP=0
May 31 23:21:52 svr kernel: [17773329.253809] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=198.23.142.125 DST=198.71.82.119 LEN=40 TOS=0x08 PREC=0x20 TTL=238 ID=4154 PROTO=TCP SPT=46544 DPT=8080 WINDOW=1024 RES=0x00 SYN URGP=0
May 31 23:22:31 svr kernel: [17773368.245357] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=198.23.142.125 DST=198.71.82.100 LEN=40 TOS=0x08 PREC=0x20 TTL=242 ID=62298 PROTO=TCP SPT=46544 DPT=8080 WINDOW=1024 RES=0x00 SYN URGP=0
May 31 23:23:31 svr lfd[761]: SYSLOG check [jvVtZF06zRtuFcvsaLF]
May 31 23:23:38 svr kernel: [17773435.400110] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=93.120.214.44 DST=198.71.82.100 LEN=60 TOS=0x08 PREC=0x20 TTL=46 ID=29377 DF PROTO=TCP SPT=33461 DPT=23 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:23:41 svr kernel: [17773438.394196] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=93.120.214.44 DST=198.71.82.100 LEN=60 TOS=0x08 PREC=0x20 TTL=46 ID=29378 DF PROTO=TCP SPT=33461 DPT=23 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:23:48 svr kernel: [17773445.997764] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=61.160.213.32 DST=198.71.82.131 LEN=40 TOS=0x00 PREC=0x00 TTL=109 ID=2560 PROTO=TCP SPT=33122 DPT=3128 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:23:48 svr kernel: [17773446.008881] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=61.160.213.32 DST=198.71.82.132 LEN=40 TOS=0x08 PREC=0x20 TTL=107 ID=2560 PROTO=TCP SPT=33122 DPT=3128 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:23:48 svr kernel: [17773446.102501] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=61.160.213.32 DST=198.71.82.100 LEN=40 TOS=0x08 PREC=0x20 TTL=108 ID=2560 PROTO=TCP SPT=33122 DPT=3128 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:23:48 svr kernel: [17773446.106333] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=61.160.213.32 DST=198.71.82.135 LEN=40 TOS=0x00 PREC=0x00 TTL=108 ID=2560 PROTO=TCP SPT=33122 DPT=3128 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:23:48 svr kernel: [17773446.114961] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=61.160.213.32 DST=198.71.82.119 LEN=40 TOS=0x08 PREC=0x20 TTL=107 ID=2560 PROTO=TCP SPT=33122 DPT=3128 WINDOW=16384 RES=0x00 SYN URGP=0
May 31 23:23:52 svr kernel: [17773449.618803] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=82.56.2.149 DST=198.71.82.100 LEN=60 TOS=0x08 PREC=0x40 TTL=45 ID=22173 DF PROTO=TCP SPT=60066 DPT=8080 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:23:55 svr kernel: [17773452.610554] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=82.56.2.149 DST=198.71.82.100 LEN=60 TOS=0x08 PREC=0x40 TTL=45 ID=22174 DF PROTO=TCP SPT=60066 DPT=8080 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:23:57 svr kernel: [17773454.676742] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=82.56.2.149 DST=198.71.82.100 LEN=60 TOS=0x08 PREC=0x40 TTL=45 ID=52061 DF PROTO=TCP SPT=60090 DPT=8080 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:24:05 svr kernel: [17773462.438957] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=195.170.42.29 DST=198.71.82.135 LEN=60 TOS=0x08 PREC=0x20 TTL=38 ID=39755 DF PROTO=TCP SPT=3008 DPT=23 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:24:08 svr kernel: [17773465.438682] Firewall: *TCP_IN Blocked* IN=venet0 OUT= MAC= SRC=195.170.42.29 DST=198.71.82.135 LEN=60 TOS=0x08 PREC=0x20 TTL=38 ID=39756 DF PROTO=TCP SPT=3008 DPT=23 WINDOW=5808 RES=0x00 SYN URGP=0
May 31 23:24:25 svr pure-ftpd: ([email protected]) [INFO] New connection from 127.0.0.1
May 31 23:24:25 svr pure-ftpd: ([email protected]) [INFO] Logout.

 

[dalem]

that has no useful information

 

[cPanelMichael]

when i was working on ssh , the server kept on restarting and kicking me out

Hello,

Is this a VPS? If so, could you report this issue to your VPS hosting provider? It's possible they are restarting your VPS due to usage, as generally Apache issues won't reboot the entire machine.

Thank you.