Zombie fcgid processes don' t die

**Sannin** · 03-02-2012, 09:57 AM

Hello

After some changes i did to my server, there are some php processes that don 't get killed automatically.

First change i did is that i compiled apache with easyapache. I added xcache module and i updated php version to 5.3.10, although i believe i have xcache disabled. I read some similar threads, but the zombie processes are not created by graceful httpd restarted and i can't kill them with a full httpd restart. Some examples:

ps auxf:

Code:

user3 25371  0.0  1.8  28080 14428 ?        S    17:21   0:00 /usr/bin/php    <-------   Zombie???
root     25513  0.0  7.7  66580 59656 ?        Ss   17:27   0:00 /usr/local/apache/bin/httpd -k start -DSSL
nobody   25515  0.0  7.4  65192 56824 ?        S    17:27   0:00  \_ /usr/local/apache/bin/httpd -k start -DSSL
root     25516  0.0  0.7   8932  5512 ?        S    17:27   0:00  \_ /usr/bin/perl /usr/local/cpanel/bin/leechprotect
nobody   25517  0.0  7.4  66336 56752 ?        S    17:27   0:00  \_ /usr/local/apache/bin/httpd -k start -DSSL
user1 25550  0.2  2.1  33028 16564 ?        S    17:27   0:02  |   \_ /usr/bin/php
user2 25848  0.1  3.4  40308 26532 ?        S    17:39   0:00  |   \_ /usr/bin/php
nobody   25519  0.1  7.8 291120 59736 ?        Sl   17:27   0:01  \_ /usr/local/apache/bin/httpd -k start -DSSL
nobody   25551  0.1  7.8 291484 60140 ?        Sl   17:27   0:02  \_ /usr/local/apache/bin/httpd -k start -DSSL

post_virtualhost_global.conf:

Code:

<IfModule mod_fcgid.c> 
FcgidMaxProcesses 15 
FcgidMaxProcessesPerClass 10 
FcgidIOTimeout 180 
FcgidMinProcessesPerClass 1 
FcgidIdleTimeout 180 
FcgidIdleScanInterval 90 
FcgidBusyTimeout 180 
FcgidBusyScanInterval 90 
FcgidErrorScanInterval 10 
FcgidZombieScanInterval 3 
FcgidProcessLifeTime 3600
FcgidMaxRequestLen 1073741824
FcgidMaxRequestsPerProcess 500
</IfModule>

xcache config:

Code:

; Directory in which the loadable extensions (modules) reside.
extension_dir = "/usr/local/lib/php/extensions/no-debug-non-zts-20090626"
extension = "xcache.so"
extension = "suhosin.so"
extension = "pdo.so"
extension = "pdo_sqlite.so"
extension = "sqlite.so"
extension = "pdo_mysql.so"
xcache.admin.enable_auth="off"
xcache.admin.pass=""
xcache.admin.user=""
xcache.cacher="Off"
xcache.coredump_directory=""
xcache.count="1"
xcache.coveragedump_directory=""
xcache.coverager="Off"
xcache.gc_interval="0"
xcache.mmap_path="/tmp/xcache"
xcache.optimizer="Off"
xcache.readonly_protection="Off"
xcache.size="0"
xcache.slots="8K"
xcache.test="Off"
xcache.ttl="0"
xcache.var_count="1"
xcache.var_gc_interval="300"
xcache.var_maxttl="0"
xcache.var_size="0"
xcache.var_slots="8K"
xcache.var_ttl="0"
xcache.shm_scheme="mmap"

Second change i made was installing asl-lite script. That script installed the atomicorp repository and along with asl-lite it installed these packages too:

Code:

cat /var/log/yum.log
Jan 06 18:38:07 Updated: glibc-common-2.5-65.el5_7.1.i386
Jan 06 18:38:11 Updated: kernel-headers-2.6.18-274.12.1.el5.i386
Jan 06 18:38:11 Updated: nash-5.1.19.6-71.el5_7.1.i386
Jan 06 18:38:14 Updated: sos-1.7-9.54.el5_7.1.noarch
Jan 06 18:38:24 Updated: glibc-2.5-65.el5_7.1.i686
Jan 06 18:38:25 Updated: glibc-headers-2.5-65.el5_7.1.i386
Jan 06 18:38:25 Updated: krb5-libs-1.6.1-63.el5_7.i386
Jan 06 18:38:25 Updated: openldap-2.3.43-12.el5_7.10.i386
Jan 06 18:38:25 Updated: kpartx-0.4.7-46.el5_7.2.i386
Jan 06 18:38:26 Updated: glibc-devel-2.5-65.el5_7.1.i386
Jan 06 18:38:26 Updated: krb5-devel-1.6.1-63.el5_7.i386
Jan 06 18:38:27 Updated: ntp-4.2.2p1-15.el5.centos.1.i386
Jan 06 18:38:29 Updated: device-mapper-multipath-0.4.7-46.el5_7.2.i386
Jan 06 18:38:30 Updated: ntp-4.2.2p1-15.el5.centos.1.i386
Jan 30 01:54:56 Updated: kernel-headers-2.6.18-274.17.1.el5.i386
Jan 30 01:54:58 Updated: libxml2-2.6.26-2.1.12.el5_7.2.i386
Jan 30 01:54:59 Updated: openssl-0.9.8e-20.el5_7.1.i686
Jan 30 01:54:59 Updated: libxml2-python-2.6.26-2.1.12.el5_7.2.i386
Jan 30 01:55:00 Updated: libxml2-devel-2.6.26-2.1.12.el5_7.2.i386
Jan 30 01:55:02 Updated: openssl-devel-0.9.8e-20.el5_7.1.i386
Feb 24 21:14:18 Updated: glibc-common-2.5-65.el5_7.3.i386
Feb 24 21:14:19 Installed: pcre-devel-6.6-6.el5_6.1.i386
Feb 24 21:14:28 Updated: glibc-2.5-65.el5_7.3.i686
Feb 24 21:14:29 Updated: openssl-0.9.8e-20.el5_7.1.0.1.centos.i686
Feb 24 21:14:29 Updated: 2:libpng-1.2.10-15.el5_7.i386
Feb 24 21:14:30 Updated: glibc-headers-2.5-65.el5_7.3.i386
Feb 24 21:14:32 Updated: openssl-devel-0.9.8e-20.el5_7.1.0.1.centos.i386
Feb 24 21:14:32 Updated: 2:libpng-devel-1.2.10-15.el5_7.i386
Feb 24 21:14:33 Updated: glibc-devel-2.5-65.el5_7.3.i386
Feb 24 21:15:00 Updated: selinux-policy-2.4.6-316.el5_7.1.noarch
Feb 24 21:15:00 Updated: kernel-headers-2.6.18-274.18.1.el5.i386
Feb 24 21:15:13 Updated: selinux-policy-targeted-2.4.6-316.el5_7.1.noarch
Mar 02 09:43:06 Installed: bigloo-libs-3.0c-1.el5.art.i386
Mar 02 09:43:06 Installed: mysqlclient15-5.0.90-1.el5.art.i386
Mar 02 09:43:07 Installed: unixODBC-2.2.11-7.1.i386
Mar 02 09:43:08 Installed: roadsend-php-libs-2.9.8-9.el5.art.i386
Mar 02 09:43:08 Installed: 1:asl-lite-2.2.7-1.el5.art.i386
Mar 02 09:43:42 Installed: ORBit2-2.14.3-5.el5.i386
Mar 02 09:43:43 Installed: libbonobo-2.16.0-1.1.el5_5.1.i386
Mar 02 09:43:43 Installed: libart_lgpl-2.3.17-4.i386
Mar 02 09:43:43 Installed: libXrender-0.9.1-3.1.i386
Mar 02 09:43:43 Installed: cairo-1.2.4-5.el5.i386
Mar 02 09:43:44 Installed: avahi-0.6.16-10.el5_6.i386
Mar 02 09:43:44 Installed: libXmu-1.0.2-5.i386
Mar 02 09:43:44 Installed: libXrandr-1.1.1-3.3.i386
Mar 02 09:43:44 Installed: libXi-1.0.1-4.el5_4.i386
Mar 02 09:43:44 Installed: apr-1.2.7-11.el5_6.5.i386
Mar 02 09:43:44 Installed: 1:audiofile-0.2.6-5.i386
Mar 02 09:43:44 Installed: libXfixes-4.0.1-2.1.i386
Mar 02 09:43:44 Installed: libXcursor-1.1.7-1.1.i386
Mar 02 09:43:45 Installed: libXaw-1.0.2-8.1.i386
Mar 02 09:43:45 Installed: 1:xorg-x11-xauth-1.0.1-2.1.i386
Mar 02 09:43:45 Installed: avahi-glib-0.6.16-10.el5_6.i386
Mar 02 09:43:45 Installed: pycairo-1.2.0-1.1.i386
Mar 02 09:43:45 Installed: libXft-2.1.10-1.1.i386
Mar 02 09:43:45 Installed: pyorbit-2.14.1-3.el5.i386
Mar 02 09:43:45 Installed: 1:dmidecode-2.11-1.el5.i386
Mar 02 09:43:45 Installed: libxslt-1.1.17-2.el5_2.2.i386
Mar 02 09:43:45 Installed: gmp-4.1.4-10.el5.i386
Mar 02 09:43:46 Installed: cryptsetup-luks-1.0.3-8.el5.i386
Mar 02 09:43:46 Installed: libXevie-1.0.1-3.1.i386
Mar 02 09:43:46 Installed: libXTrap-1.0.0-3.1.i386
Mar 02 09:43:46 Installed: 1:cups-libs-1.3.7-26.el5_6.1.i386
Mar 02 09:43:46 Installed: sgpio-1.2.0_10-2.el5.i386
Mar 02 09:43:47 Installed: gdb-7.0.1-37.el5_7.1.i386
Mar 02 09:43:47 Installed: postgresql-libs-8.1.23-1.el5_7.3.i386
Mar 02 09:43:47 Installed: apr-util-1.2.7-11.el5_5.2.i386
Mar 02 09:43:47 Installed: libgfortran-4.1.2-51.el5.i386
Mar 02 09:43:47 Installed: libXtst-1.0.1-3.1.i386
Mar 02 09:43:47 Installed: libXxf86misc-1.0.1-3.1.i386
Mar 02 09:43:48 Installed: libXinerama-1.0.1-2.1.i386
Mar 02 09:43:48 Installed: alsa-lib-1.0.17-1.el5.i386
Mar 02 09:43:48 Installed: 1:esound-0.2.36-3.i386
Mar 02 09:43:48 Installed: libXfontcache-1.0.2-3.1.i386
Mar 02 09:43:48 Installed: xorg-x11-server-utils-7.1-5.el5_6.2.i386
Mar 02 09:43:48 Installed: xorg-x11-xinit-1.0.2-15.el5.i386
Mar 02 09:43:49 Installed: python-numeric-23.7-2.2.2.el5_6.1.i386
Mar 02 09:43:49 Installed: iscsi-initiator-utils-6.2.0.872-10.el5.i386
Mar 02 09:43:49 Installed: startup-notification-0.8-4.1.i386
Mar 02 09:43:50 Installed: lvm2-2.02.84-6.el5_7.2.i386
Mar 02 09:43:50 Installed: shared-mime-info-0.19-5.el5.i386
Mar 02 09:43:50 Installed: libXres-1.0.1-3.1.i386
Mar 02 09:43:50 Installed: pciutils-3.1.7-3.el5.i386
Mar 02 09:43:51 Installed: gcc-gfortran-4.1.2-51.el5.i386
Mar 02 09:43:52 Installed: 1:doxygen-1.4.7-1.1.i386
Mar 02 09:43:54 Installed: 1:valgrind-3.5.0-5.el5.i386
Mar 02 09:43:55 Installed: texinfo-4.8-14.el5.i386
Mar 02 09:43:55 Installed: ctags-5.6-1.1.i386
Mar 02 09:43:55 Installed: swig-1.3.29-2.el5.i386
Mar 02 09:43:56 Installed: patchutils-0.2.31-2.2.2.i386
Mar 02 09:43:56 Installed: diffstat-1.41-1.2.3.el5.i386
Mar 02 09:43:56 Installed: byacc-1.9-29.2.2.i386
Mar 02 09:43:56 Installed: indent-2.2.9-14.fc6.i386
Mar 02 09:43:56 Installed: splint-3.1.1-16.el5.i386
Mar 02 09:43:57 Installed: oprofile-0.9.4-15.el5.centos.i386
Mar 02 09:43:57 Installed: python-ldap-2.2.0-2.1.i386
Mar 02 09:43:57 Installed: ltrace-0.5-13.45svn.el5_7.12.i386
Mar 02 09:43:57 Installed: cscope-15.5-15.1.el5_3.1.i386
Mar 02 09:43:59 Installed: bitstream-vera-fonts-1.10-7.noarch
Mar 02 09:44:05 Installed: xorg-x11-fonts-base-7.1-2.1.el5.noarch
Mar 02 09:44:05 Installed: gnome-mime-data-2.4.2-3.1.i386
Mar 02 09:44:05 Installed: perl-URI-1.35-3.noarch
Mar 02 09:44:06 Installed: hicolor-icon-theme-0.9-2.1.noarch
Mar 02 09:44:16 Installed: kernel-devel-2.6.18-274.18.1.el5.i686
Mar 02 09:44:16 Installed: pstack-1.2-7.2.2.i386
Mar 02 09:44:16 Installed: automake15-1.5-16.el5.2.noarch
Mar 02 09:44:16 Installed: redhat-rpm-config-8.0.45-32.el5.centos.noarch
Mar 02 09:44:16 Installed: automake14-1.4p6-13.el5.1.noarch
Mar 02 09:44:16 Installed: automake17-1.7.9-7.el5.2.noarch
Mar 02 09:44:17 Installed: automake16-1.6.3-8.el5.1.noarch
Mar 02 09:44:17 Installed: pango-1.14.9-8.el5.centos.3.i386
Mar 02 09:44:20 Installed: gtk2-2.10.4-21.el5_7.7.i386
Mar 02 09:44:20 Installed: GConf2-2.14.0-9.el5.i386
Mar 02 09:44:21 Installed: libglade2-2.6.0-2.i386
Mar 02 09:44:21 Installed: libgnomecanvas-2.14.0-4.1.i386
Mar 02 09:44:21 Installed: gnome-keyring-0.6.0-1.fc6.i386
Mar 02 09:44:21 Installed: pygtk2-2.10.1-12.el5.i386
Mar 02 09:44:21 Installed: pygtk2-libglade-2.10.1-12.el5.i386
Mar 02 09:44:22 Installed: gail-1.9.2-3.el5_4.i386
Mar 02 09:44:22 Installed: at-spi-1.7.11-3.el5.i386
Mar 02 09:44:22 Installed: pyspi-0.6.1-1.el5.i386
Mar 02 09:44:22 Installed: libwnck-2.16.0-4.fc6.i386
Mar 02 09:44:24 Installed: notification-daemon-0.3.5-9.el5.i386
Mar 02 09:44:24 Installed: libnotify-0.4.2-6.el5.i386
Mar 02 09:44:24 Installed: xorg-x11-server-Xvfb-1.1.1-48.76.el5_7.5.i386
Mar 02 09:44:26 Installed: subversion-1.6.11-7.el5_6.4.i386
Mar 02 09:44:27 Installed: libgnome-2.16.0-6.el5.i386
Mar 02 09:44:27 Installed: hal-0.5.8.1-62.el5.i386
Mar 02 09:44:28 Installed: gnome-vfs2-2.16.2-8.el5.i386
Mar 02 09:44:29 Installed: libbonoboui-2.16.0-1.fc6.i386
Mar 02 09:44:29 Installed: libgnomeui-2.16.0-5.el5.i386
Mar 02 09:44:29 Installed: dmraid-1.0.0.rc13-65.el5.i386
Mar 02 09:44:29 Installed: mkinitrd-5.1.19.6-71.el5_7.1.i386
Mar 02 09:44:29 Installed: gnome-mount-0.5-3.el5.i386
Mar 02 09:44:29 Installed: dmraid-events-1.0.0.rc13-65.el5.i386
Mar 02 09:44:29 Installed: pm-utils-0.99.3-10.el5.centos.i386
Mar 02 09:44:40 Installed: kernel-2.6.18-274.18.1.el5.i686
Mar 02 09:44:40 Installed: systemtap-runtime-1.3-9.el5.i386
Mar 02 09:44:44 Installed: systemtap-1.3-9.el5.i386
Mar 02 09:44:45 Installed: gnome-python2-gnomevfs-2.16.0-1.fc6.i386
Mar 02 09:44:45 Installed: gnome-python2-2.16.0-1.fc6.i386
Mar 02 09:44:45 Installed: gnome-python2-gconf-2.16.0-1.fc6.i386
Mar 02 09:44:45 Installed: dogtail-0.6.1-4.el5.noarch
Mar 02 09:44:45 Installed: gnome-python2-bonobo-2.16.0-1.fc6.i386
Mar 02 09:48:20 Erased: asl-lite

I didn' t like those changes so i removed asl-lite and the repository but i can't remove the other packages. I don' t believe this is the problem though.

I am forced to manually kill the zombie processes not to get my memory full, can you help me figure out the problem?

**cPChris** · 03-02-2012, 06:23 PM

Hello,

Can you provide the output of the file `/usr/local/apache/conf/php.conf`?

**Sannin** · 03-02-2012, 06:56 PM

Of cource...

Code:

cat /usr/local/apache/conf/php.conf
# This file was automatically generated by the Cpanel PHP Configuration system
# If you wish to change the way PHP is being handled by Apache on your system,
# use the /usr/local/cpanel/bin/rebuild_phpconf script or the WHM interface.
#
# Manual edits of this file will be lost when Apache is updated.


# Fastcgi configuration for PHP5
LoadModule fcgid_module modules/mod_fcgid.so
MaxRequestsPerProcess 500
AddHandler fcgid-script .php5 .php4 .php .php3 .php2 .phtml
FCGIWrapper /usr/local/cpanel/cgi-sys/php5 .php5
FCGIWrapper /usr/local/cpanel/cgi-sys/php5 .php4
FCGIWrapper /usr/local/cpanel/cgi-sys/php5 .php
FCGIWrapper /usr/local/cpanel/cgi-sys/php5 .php3
FCGIWrapper /usr/local/cpanel/cgi-sys/php5 .php2
FCGIWrapper /usr/local/cpanel/cgi-sys/php5 .phtml

# End of autogenerated PHP configuration.

Btw, i found out that more people have this problem recently. Maybe a bug in easyapache?

http://forums.cpanel.net/f189/lost-a...180571-p2.html

**Sannin** · 03-02-2012, 07:24 PM

Some more info:

According to directive FcgidProcessLifeTime 3600, the php process should have been killed at 3600 seconds, but it keeps going and going, either as a forked process under apache or as an abandoned one.

**Sannin** · 03-04-2012, 10:46 AM

I made a ticket about this. It is a known issue and it is fixed in Easy Apache 3.10, so i guess i have to wait for the next update.

**plague** · 03-05-2012, 11:12 AM

I made a ticket about this. It is a known issue and it is fixed in Easy Apache 3.10, so i guess i have to wait for the next update.

Thank you for your feedback, Sannin. Had the same issue on two servers, one was running FCGI just fine and was rebuild with EA 2 weeks ago, when we face the problem the first time, and now on a new server.
Machines where FCGI was installed long time ago doesn't show this problem.

**funmaking** · 03-09-2012, 05:38 AM

Hi there,

I have installed the Apache with the 3.10.2 version and the problem is the same. There are some processes with have not finished (imap, strange id with numbers, etc.

Is it possible to fix this issue? Thanks!

**Quemeros** · 03-09-2012, 09:08 AM

One more confirmation, problem stille here with EA 3.10.2, i do upgrade RPM package's first to, and nothig, all the same.

**brainyron** · 03-09-2012, 11:09 AM

I, too, must report that this issue is not fixed for me.

**Joriz** · 03-11-2012, 12:19 PM

It seems to be back on some of our servers. Even with post_virtualhost_global.conf added.
Now we restart Apache by a cron job every day to prevent all those zombie processes.

Did anyone found a solution?

**ikillbill** · 03-13-2012, 05:55 AM

just re-compiled apache with easyapache 3.10.2 10 minutes ago

issue is not fixed

**Sannin** · 03-14-2012, 01:27 AM

I can confirm that issue is not fixed for me either. I have reopened my cpanel ticket when i have more news i will post them.

I found a workaround from another thread (credits to the guy that wrote it there :P). I use this cronjob every 30 minutes, to get rid of the abandoned processes:

Code:

ps auxwwwf | grep '[0-9] /usr/bin/php' | awk '{ print $2 }' | xargs kill -9

You may need to use it more often than 30 minutes, depending on your fcgid settings.

**cPanelMichael** · 03-14-2012, 08:21 AM

Hello

For anyone else experiencing this issue, please first check to ensure you have updated Apache/PHP using the latest version of EasyApache (version 3.10.2 at the time of writing this).

If you continue to experience this issue, please submit a bug report using the following URL:

Submit A Bug Report

It's important that anyone experiencing the issue submits a bug report because the more reports we receive, the more we can tag any internal case that is opened for the issue.

Thank you.

**ikillbill** · 03-20-2012, 11:41 AM

bug issued~~~

could everyone please issue your bug reports!

**ahhyes** · 03-22-2012, 05:03 PM

Originally Posted by ikillbill

bug issued~~~

could everyone please issue your bug reports!

+1 to this issue.

We're running php as fastcgi and php processes are just piling up, after a few hours, the server is tanking. We had not updated the machine in a while. As soon as we had updated, this problem appeared...

I notice today that easyapache is at Easy::Apache v3.11.2, does this fix the issue?

Forums

Thread: Zombie fcgid processes don' t die

LinkBack

Thread Tools

Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Re: Zombie fcgid processes don' t die

Similar Threads

Zombie Processes

imap processes that will not die

Spamassassin causing zombie Exim processes

Processes zombie - That is normal or one bug.

Cpanel Zombie Processes

cPanel & WHM

Enkompass

Help

Community

Company

Connect with Us