The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

httpd <defunct>

Discussion in 'General Discussion' started by acenetryan, Dec 30, 2009.

  1. acenetryan

    acenetryan Well-Known Member
    PartnerNOC

    Joined:
    Aug 21, 2005
    Messages:
    197
    Likes Received:
    1
    Trophy Points:
    18
    We've recently been having a problem across multiple servers where Apache becomes unresponsive and sometimes takes minutes (if at all) to clear up.

    First, we'll notice via our monitoring alerts that Apache is not responding on the server.

    Upon logging in, we can see that all httpd child processes have gone defunct:

    Code:
    nobody   17176  0.0  0.0      0     0 ?        Z    09:18   0:00 [httpd] <defunct>
    Some defunct processes are normal. It just means that the child has died and I ran a ps aux before the parent could reclaim it. This happens anytime an httpd request is served. However, in these circumstances ALL httpd process go defunct and the parent appears to no longer be listening for new ones.

    On some servers, we can wait 10-20 seconds and the parent process will start listening again, all of the child processes which were defunct will be reclaimed, and new ones will start up.

    On other servers, we can wait for as long as 5 minutes and the child processes will remain defunct. Honestly, I can't say whether we just didn't wait long enough for the children to clear out. We don't care to wait to observe such a behavior when clients' sites are down and a manual killing of the parent process and a restart takes us 10 seconds. Perhaps if we wait longer things will clear up on their own as they do on other machines, but we're not going to wait around and see with sites down. These are production machines exhibiting this behavior.

    We've checked chkservd logs and it does not appear to be directly correlated to chkservd restarts. To be safe, we've turned off httpd monitoring via chkservd but it has not helped.

    We do notice that during these defunct outages there is a graceful restart requested as noted by the Apache error_log.

    Code:
    [Wed Dec 30 07:55:36 2009] [notice] Apache/2.0.63 (Unix) mod_ssl/2.0.63 OpenSSL/0.9.8e-fips-rhel5 mod_auth_passthrough/2.1
    mod_bwlimited/1.4 FrontPage/5.0.2.2635 configured -- resuming normal operations
    However, we've tried performing many manual graceful restarts so we can reproduce this behavior. Each time, we are unable to get the restart to produce these hanging defunct processes. Obviously a graceful restart creates some defunct processes as the children die off, but they are quickly gone and new child processes are spawned. When we run the graceful restarts manually, the service is always restarted successfully within a second or two with no noticeable disruption to service and without the slew of defunct processes sitting around.

    We've also tried strace'ing the parent process during these times, but all we see are the children interrupted by a system call:

    Code:
    poll([{fd=2851, events=POLLOUT}], 1, 3000) = -1 EINTR (Interrupted system call)
    --- SIGCHLD (Child exited) @ 0 (0) ---
    poll([{fd=2851, events=POLLOUT}], 1, 3000) = -1 EINTR (Interrupted system call)
    --- SIGCHLD (Child exited) @ 0 (0) ---
    poll([{fd=2851, events=POLLOUT}], 1, 3000) = -1 EINTR (Interrupted system call)
    --- SIGCHLD (Child exited) @ 0 (0) ---
    poll([{fd=2851, events=POLLOUT}], 1, 3000) = -1 EINTR (Interrupted system call)
    --- SIGCHLD (Child exited) @ 0 (0) ---
    
    and the parent just hangs waiting:

    Code:
    --- SIGUSR1 (User defined signal 1) @ 0 (0) ---
    rt_sigreturn(0xa)                       = -1 EINTR (Interrupted system call)
    poll([{fd=2851, events=POLLOUT}], 1, 3000 <unfinished ...>
    
    I'm posting a ticket right now, but I wanted to document the issue here as well.
     
  2. acenetryan

    acenetryan Well-Known Member
    PartnerNOC

    Joined:
    Aug 21, 2005
    Messages:
    197
    Likes Received:
    1
    Trophy Points:
    18
    Forgot to mention, we also thought this may have something to do with a graceful restart interfering with log rotation and the problem compounding from there. We disabled log rotation on some of the problematic boxes, but with the holiday season things really slowed down and we weren't able to tell whether things improved because of our changes or the lower traffic to the boxes.
     
  3. cPanelDon

    cPanelDon cPanel Quality Assurance Analyst
    Staff Member

    Joined:
    Nov 5, 2008
    Messages:
    2,557
    Likes Received:
    7
    Trophy Points:
    38
    Location:
    Houston, Texas, U.S.A.
    cPanel Access Level:
    DataCenter Provider
    Twitter:
    When possible, please PM me the ticket ID number of your support request; I would like to review the details of the situation in-depth.
     
  4. ChrisRHS

    ChrisRHS Well-Known Member

    Joined:
    Jul 12, 2006
    Messages:
    292
    Likes Received:
    5
    Trophy Points:
    18
    Hi there,

    Glad I am not the only one experiencing this. My server load will shoot up to 100+ within seconds because of httpd processes. Some are defunct, most however are locked in a sending reply. Normal load on this server is around 1~2, which is fine. This happens a few times a day, and can have my server down for up to 10 minutes before the monitoring script restarts apache, then all is good.

    I've contacted cPanel regarding this, however, they were not able to figure anything out.

    This is also happening on more than one of my cPanel servers.
     
  5. radiofm

    radiofm Registered

    Joined:
    Mar 31, 2009
    Messages:
    2
    Likes Received:
    0
    Trophy Points:
    1
    Location:
    Poland
    Hello

    my server also from few days have problem with httpd.

    httpd restart few times a day.

    i try to rebuild apache but result is still the same - every day httpd failed a few times.



    Robert
     
  6. ashutariyal

    ashutariyal Registered

    Joined:
    Mar 25, 2008
    Messages:
    4
    Likes Received:
    0
    Trophy Points:
    1
    ^ can any one post solution for this problem coz i am facing the same problem too and after restarting the server it solve but it comes again after some time.. and lot of
    PHP:
     <defunct> [/Balso running on the server.

    Regards,
     
  7. acenetryan

    acenetryan Well-Known Member
    PartnerNOC

    Joined:
    Aug 21, 2005
    Messages:
    197
    Likes Received:
    1
    Trophy Points:
    18
    We notice a significant improvement when we disable Log Rotation for Apache. I suggest trying this. There were still a few stragglers in our farm that exhibit this behavior after disabling it, but even for those machines we notice that graceful Apache restarts take less time than with Log Rotation enabled.
     
  8. ashutariyal

    ashutariyal Registered

    Joined:
    Mar 25, 2008
    Messages:
    4
    Likes Received:
    0
    Trophy Points:
    1
    we have 2 forums on our dedicated server (i7 Eight Core with 12 GB Ram) but from the beginning with this server we are facing the problem (
    PHP:
     <defunct>[/B]) and many times a day apache stop automaticallyi am posting here coz i know many user facing this type of problem.. so mate now i have found the solution that don't compile php with apache as cgi..

    now i have compiled php with apache only (cgi is not enabled) and everything going smooth.

    Thanks friends..
     
  9. MMarko

    MMarko Well-Known Member

    Joined:
    Apr 18, 2005
    Messages:
    316
    Likes Received:
    0
    Trophy Points:
    16
    Check if you maybe have eaccelerator 0.9.6 rc1 and if you have it downgrade it to 0.9.3
     
  10. mctekk

    mctekk Registered

    Joined:
    Mar 24, 2004
    Messages:
    4
    Likes Received:
    0
    Trophy Points:
    1
    Im facing the same thing anybody has a solution? And no i dont have eacceleartor.

    Thanks
     
  11. cPanelDon

    cPanelDon cPanel Quality Assurance Analyst
    Staff Member

    Joined:
    Nov 5, 2008
    Messages:
    2,557
    Likes Received:
    7
    Trophy Points:
    38
    Location:
    Houston, Texas, U.S.A.
    cPanel Access Level:
    DataCenter Provider
    Twitter:
    Are any other non-default Apache modules in-use?

    What Apache MPM is being used?

    The following commands may used to view the Apache version information including the MPM, compiled-in modules, and dynamically-loaded modules:
    Code:
    # /usr/local/apache/bin/httpd -V
    # /usr/local/apache/bin/httpd -l
    # /usr/local/apache/bin/httpd -M
    # ls -ahl /usr/local/apache/libexec /usr/local/apache/modules
    Depending on the configuration, the following information may also help:
    Code:
    # lwp-request -mHEAD localhost | grep "^Server:"
    What is the configured PHP handler (as seen via output from the following command)?
    Code:
    # /usr/local/cpanel/bin/rebuild_phpconf --current
     
  12. mctekk

    mctekk Registered

    Joined:
    Mar 24, 2004
    Messages:
    4
    Likes Received:
    0
    Trophy Points:
    1
    Hey @cPanelDon, normal apache configuration nothing out of the ordenary, take a look

    /usr/local/apache/bin/httpd -V
    Server version: Apache/2.2.11 (Unix)
    Server built: Jul 11 2009 14:10:25
    Cpanel::Easy::Apache v3.2.0 rev4762
    Server's Module Magic Number: 20051115:21
    Server loaded: APR 1.3.3, APR-Util 1.3.4
    Compiled using: APR 1.3.3, APR-Util 1.3.4
    Architecture: 64-bit
    Server MPM: Prefork
    threaded: no
    forked: yes (variable process count)
    Server compiled with....
    -D APACHE_MPM_DIR="server/mpm/prefork"
    -D APR_HAS_SENDFILE
    -D APR_HAS_MMAP
    -D APR_HAVE_IPV6 (IPv4-mapped addresses enabled)
    -D APR_USE_SYSVSEM_SERIALIZE
    -D APR_USE_PTHREAD_SERIALIZE
    -D SINGLE_LISTEN_UNSERIALIZED_ACCEPT
    -D APR_HAS_OTHER_CHILD
    -D AP_HAVE_RELIABLE_PIPED_LOGS
    -D DYNAMIC_MODULE_LIMIT=128
    -D HTTPD_ROOT="/usr/local/apache"
    -D SUEXEC_BIN="/usr/local/apache/bin/suexec"
    -D DEFAULT_PIDLOG="logs/httpd.pid"
    -D DEFAULT_SCOREBOARD="logs/apache_runtime_status"
    -D DEFAULT_LOCKFILE="logs/accept.lock"
    -D DEFAULT_ERRORLOG="logs/error_log"
    -D AP_TYPES_CONFIG_FILE="conf/mime.types"
    -D SERVER_CONFIG_FILE="conf/httpd.conf"


    Compiled in modules:
    core.c
    mod_authn_file.c
    mod_authn_default.c
    mod_authz_host.c
    mod_authz_groupfile.c
    mod_authz_user.c
    mod_authz_default.c
    mod_auth_basic.c
    mod_include.c
    mod_filter.c
    mod_log_config.c
    mod_logio.c
    mod_env.c
    mod_expires.c
    mod_headers.c
    mod_setenvif.c
    mod_proxy.c
    mod_proxy_connect.c
    mod_proxy_ftp.c
    mod_proxy_http.c
    mod_proxy_ajp.c
    mod_proxy_balancer.c
    mod_ssl.c
    prefork.c
    http_core.c
    mod_mime.c
    mod_status.c
    mod_autoindex.c
    mod_asis.c
    mod_info.c
    mod_suexec.c
    mod_cgi.c
    mod_negotiation.c
    mod_dir.c
    mod_actions.c
    mod_userdir.c
    mod_alias.c
    mod_rewrite.c
    mod_so.c

    Loaded Modules:
    core_module (static)
    authn_file_module (static)
    authn_default_module (static)
    authz_host_module (static)
    authz_groupfile_module (static)
    authz_user_module (static)
    authz_default_module (static)
    auth_basic_module (static)
    include_module (static)
    filter_module (static)
    log_config_module (static)
    logio_module (static)
    env_module (static)
    expires_module (static)
    headers_module (static)
    setenvif_module (static)
    proxy_module (static)
    proxy_connect_module (static)
    proxy_ftp_module (static)
    proxy_http_module (static)
    proxy_ajp_module (static)
    proxy_balancer_module (static)
    ssl_module (static)
    mpm_prefork_module (static)
    http_module (static)
    mime_module (static)
    status_module (static)
    autoindex_module (static)
    asis_module (static)
    info_module (static)
    suexec_module (static)
    cgi_module (static)
    negotiation_module (static)
    dir_module (static)
    actions_module (static)
    userdir_module (static)
    alias_module (static)
    rewrite_module (static)
    so_module (static)
    php5_module (shared)
    Syntax OK


    total 19M
    drwxr-xr-x 2 root root 4.0K Jan 20 19:59 .
    drwxr-xr-x 17 root root 4.0K Aug 29 15:54 ..
    -rw-r--r-- 1 root root 8.9K Jul 11 2009 httpd.exp
    -rwxr-xr-x 1 root root 19M Jan 20 19:59 libphp5.so
    -rwxr-xr-x 1 root root 10K Jul 11 2009 mod_auth_passthrough.so
    -rwxr-xr-x 1 root root 9.4K Jul 11 2009 mod_bwlimited.so
    -rwxr-xr-x 1 root root 5.7K Jul 11 2009 mod_disable_suexec.so
    -rwxr-xr-x 1 root root 50K Jul 11 2009 mod_frontpage.so
    -rwxr-xr-x 1 root root 11K Dec 1 20:03 mod_rpaf-2.0.so -> disabled

    Available handlers: dso cgi none
    DEFAULT PHP: 5
    PHP4 SAPI: none
    PHP5 SAPI: dso
    SUEXEC: enabled
     
  13. cPanelDon

    cPanelDon cPanel Quality Assurance Analyst
    Staff Member

    Joined:
    Nov 5, 2008
    Messages:
    2,557
    Likes Received:
    7
    Trophy Points:
    38
    Location:
    Houston, Texas, U.S.A.
    cPanel Access Level:
    DataCenter Provider
    Twitter:
    I would consider updating Apache to the latest available version; currently 2.2.14 (versus the existing install of 2.2.11); for reference, here is the official Apache httpd change log:
    http://www.apache.org/dist/httpd/CHANGES_2.2.14
    http://www.apache.org/dist/httpd/CHANGES_2.2
     
  14. WebGraf

    WebGraf Member

    Joined:
    Feb 13, 2010
    Messages:
    18
    Likes Received:
    0
    Trophy Points:
    1
    after graceful restart Apache do not respond above 2 minutes. Then start.
    why?

    Code:
    root@server1 [~]# httpd -V
    Server version: Apache/2.2.14 (Unix)
    Server built:   Feb 19 2010 15:21:11
    Cpanel::Easy::Apache v3.2.0 rev5009
    Server's Module Magic Number: 20051115:23
    Server loaded:  APR 1.3.9, APR-Util 1.3.9
    Compiled using: APR 1.3.9, APR-Util 1.3.9
    Architecture:   32-bit
    Server MPM:     Prefork
      threaded:     no
        forked:     yes (variable process count)
    Server compiled with....
     -D APACHE_MPM_DIR="server/mpm/prefork"
     -D APR_HAS_SENDFILE
     -D APR_HAS_MMAP
     -D APR_HAVE_IPV6 (IPv4-mapped addresses enabled)
     -D APR_USE_SYSVSEM_SERIALIZE
     -D APR_USE_PTHREAD_SERIALIZE
     -D SINGLE_LISTEN_UNSERIALIZED_ACCEPT
     -D APR_HAS_OTHER_CHILD
     -D AP_HAVE_RELIABLE_PIPED_LOGS
     -D DYNAMIC_MODULE_LIMIT=128
     -D HTTPD_ROOT="/usr/local/apache"
     -D SUEXEC_BIN="/usr/local/apache/bin/suexec"
     -D DEFAULT_PIDLOG="logs/httpd.pid"
     -D DEFAULT_SCOREBOARD="logs/apache_runtime_status"
     -D DEFAULT_LOCKFILE="logs/accept.lock"
     -D DEFAULT_ERRORLOG="logs/error_log"
     -D AP_TYPES_CONFIG_FILE="conf/mime.types"
     -D SERVER_CONFIG_FILE="conf/httpd.conf"
    
    Code:
    root@server1 [~]# httpd -l
    Compiled in modules:
      core.c
      mod_authn_file.c
      mod_authn_default.c
      mod_authz_host.c
      mod_authz_groupfile.c
      mod_authz_user.c
      mod_authz_default.c
      mod_auth_basic.c
      mod_include.c
      mod_filter.c
      mod_log_config.c
      mod_logio.c
      mod_env.c
      mod_expires.c
      mod_headers.c
      mod_unique_id.c
      mod_setenvif.c
      mod_version.c
      mod_proxy.c
      mod_proxy_connect.c
      mod_proxy_ftp.c
      mod_proxy_http.c
      mod_proxy_scgi.c
      mod_proxy_ajp.c
      mod_proxy_balancer.c
      mod_ssl.c
      prefork.c
      http_core.c
      mod_mime.c
      mod_status.c
      mod_autoindex.c
      mod_asis.c
      mod_info.c
      mod_suexec.c
      mod_cgi.c
      mod_negotiation.c
      mod_dir.c
      mod_actions.c
      mod_userdir.c
      mod_alias.c
      mod_rewrite.c
      mod_so.c
    
    Code:
    root@server1 [~]# httpd -M
    Loaded Modules:
     core_module (static)
     authn_file_module (static)
     authn_default_module (static)
     authz_host_module (static)
     authz_groupfile_module (static)
     authz_user_module (static)
     authz_default_module (static)
     auth_basic_module (static)
     include_module (static)
     filter_module (static)
     log_config_module (static)
     logio_module (static)
     env_module (static)
     expires_module (static)
     headers_module (static)
     unique_id_module (static)
     setenvif_module (static)
     version_module (static)
     proxy_module (static)
     proxy_connect_module (static)
     proxy_ftp_module (static)
     proxy_http_module (static)
     proxy_scgi_module (static)
     proxy_ajp_module (static)
     proxy_balancer_module (static)
     ssl_module (static)
     mpm_prefork_module (static)
     http_module (static)
     mime_module (static)
     status_module (static)
     autoindex_module (static)
     asis_module (static)
     info_module (static)
     suexec_module (static)
     cgi_module (static)
     negotiation_module (static)
     dir_module (static)
     actions_module (static)
     userdir_module (static)
     alias_module (static)
     rewrite_module (static)
     so_module (static)
     auth_passthrough_module (shared)
     bwlimited_module (shared)
     frontpage_module (shared)
     php5_module (shared)
     security2_module (shared)
    Syntax OK
    
    Code:
    root@server1 [~]# ls -ahl /usr/local/apache/libexec /usr/local/apache/modules
    /bin/ls: /usr/local/apache/libexec: No such file or directory
    /usr/local/apache/modules:
    total 19M
    drwxr-xr-x  2 root root 4.0K Feb 19 15:28 ./
    drwxr-xr-x 17 root root 4.0K Feb 19 16:48 ../
    -rw-r--r--  1 root root 8.9K Feb 19 15:20 httpd.exp
    -rwxr-xr-x  1 root root  18M Feb 19 15:28 libphp5.so*
    -rwxr-xr-x  1 root root 7.5K Feb 19 15:21 mod_auth_passthrough.so*
    -rwxr-xr-x  1 root root 6.7K Feb 19 15:21 mod_bwlimited.so*
    -rwxr-xr-x  1 root root 4.1K Feb 19 15:21 mod_disable_suexec.so*
    -rwxr-xr-x  1 root root  43K Feb 19 15:22 mod_frontpage.so*
    -rwxr-xr-x  1 root root 995K Feb 19 15:22 mod_security2.so*
    -rwxr-xr-x  1 root root  49K Feb 19 15:21 mod_suphp.so*
    
    Code:
    root@server1 [~]# lwp-request -mHEAD localhost | grep "^Server:"
    Server: Apache/2.2.14 (Unix) mod_ssl/2.2.14 OpenSSL/0.9.8e-fips-rhel5 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635 PHP/5.2.12
    
     
    #14 WebGraf, Feb 19, 2010
    Last edited by a moderator: Feb 19, 2010
  15. WebGraf

    WebGraf Member

    Joined:
    Feb 13, 2010
    Messages:
    18
    Likes Received:
    0
    Trophy Points:
    1
    Is This restart needed for collection of dens in statistics? How I must propose the night-time of collection of statistics? And is it possible to do without the restart of apache?
     
  16. cPanelDon

    cPanelDon cPanel Quality Assurance Analyst
    Staff Member

    Joined:
    Nov 5, 2008
    Messages:
    2,557
    Likes Received:
    7
    Trophy Points:
    38
    Location:
    Houston, Texas, U.S.A.
    cPanel Access Level:
    DataCenter Provider
    Twitter:
    I am unable to determine why based on the provided information; however, to diagnose and investigate I would consider escalating the issue via your license provider. If further escalation is needed your license provider can submit a ticket on your behalf to ensure priority. Please see the following page: Support Options

    Unless using piped logs in Apache it is necessary to perform a graceful restart, such as what cpanellogd initiates, in order to correctly rotate domain access logs without data loss; if rotating logs with a restart is not desirable I would consider using the piped logs feature, as detailed in a different thread (mentioned further below).

    Log and statistics processing is an automatic process unless the server administrator disables it via WHM. If needing to set blackout hours for processing I would consider checking the options set via WHM at the following menu path:
    WHM: Main >> Server Configuration >> Statistics Software Configuration >> Schedule Configuration
    Look for "Statistics Schedule" and then click "Configure Statistic Process Time Schedule"

    Yes; please refer to the following forums thread for verbose information on how this can be accomplished using piped domain access logs in Apache: cPanel 11.25 Log Processing - cPanel Forums
     
  17. WebGraf

    WebGraf Member

    Joined:
    Feb 13, 2010
    Messages:
    18
    Likes Received:
    0
    Trophy Points:
    1
    #17 WebGraf, Feb 20, 2010
    Last edited: Feb 20, 2010
  18. arn

    arn Member

    Joined:
    Aug 3, 2002
    Messages:
    19
    Likes Received:
    0
    Trophy Points:
    1
    Was there ever a resolution to this? I've been having the same problem.

    Where Apache will go down for several minutes. At first I thought it was related to the log rotation issue, but I see my problem is closer to this where httpd won't restart in a timely fashion.

    See here:

    Code:
    [Sun Apr 11 07:07:45 2010] [notice] Graceful restart requested, doing restart
    [Sun Apr 11 07:14:27 2010] [notice] Apache/2.0.63 (Unix) mod_ssl/2.0.63 OpenSSL/0.9.8e-fips-rhel5 mod_bwlimited/1.4 PHP/5.2.9 configured -- resuming normal operations
    
    It took almost 7 minutes for Apache to restart, during which the site was down.

    I'm on cPanel 11.25.0.-R44675, and have been trying different configs of Apache to see if it helps. It was happening on 2.2 and now on 2.0. I don't have eaccelerator installed anymore.

    arn
     
  19. cPanelDon

    cPanelDon cPanel Quality Assurance Analyst
    Staff Member

    Joined:
    Nov 5, 2008
    Messages:
    2,557
    Likes Received:
    7
    Trophy Points:
    38
    Location:
    Houston, Texas, U.S.A.
    cPanel Access Level:
    DataCenter Provider
    Twitter:
    Have you tried the piped logging option for Apache?

     
  20. arn

    arn Member

    Joined:
    Aug 3, 2002
    Messages:
    19
    Likes Received:
    0
    Trophy Points:
    1
    Piped logs fail for me, also bringing down apache

    Code:
    
    log file:
    
    piped log program '/usr/local/cpanel/bin/splitlogs --main=web5.xeeno.com --mainout=/usr/local/apache/logs/access_log' failed unexpectedly
    [Tue Apr 20 01:44:56 2010] [notice] child pid 27092 exit signal File size limit exceeded (25)
    piped log program '/usr/local/cpanel/bin/splitlogs --main=web5.xeeno.com --mainout=/usr/local/apache/logs/access_log' failed unexpectedly
    [Tue Apr 20 01:44:57 2010] [notice] child pid 27093 exit signal File size limit exceeded (25)
    piped log program '/usr/local/cpanel/bin/splitlogs --main=web5.xeeno.com --mainout=/usr/local/apache/logs/access_log' failed unexpectedly
    [Tue Apr 20 01:44:58 2010] [notice] child pid 27094 exit signal File size limit exceeded (25)
    piped log program '/usr/local/cpanel/bin/splitlogs --main=web5.xeeno.com --mainout=/usr/local/apache/logs/access_log' failed unexpectedly
    [Tue Apr 20 01:44:59 2010] [notice] child pid 27095 exit signal File size limit exceeded (25)
    piped log program '/usr/local/cpanel/bin/splitlogs --main=web5.xeeno.com --mainout=/usr/local/apache/logs/access_log' failed unexpectedly
    [Tue Apr 20 01:45:00 2010] [notice] child pid 27096 exit signal File size limit exceeded (25)
    piped log program '/usr/local/cpanel/bin/splitlogs --main=web5.xeeno.com --mainout=/usr/local/apache/logs/access_log' failed unexpectedly
    [Tue Apr 20 01:45:01 2010] [notice] child pid 27097 exit signal File size limit exceeded (25)
    piped log program '/usr/local/cpanel/bin/splitlogs --main=web5.xeeno.com --mainout=/usr/local/apache/logs/access_log' failed unexpectedly
    etc...
    
    my domlogs dir
    
    root@web5 [/usr/local/apache/domlogs]# ls -la 
    total 2747540
    -rw-r--r--  1 root     root              0 Apr 20 01:25 -
    -rw-r--r--  1 root     root              0 Apr 20 01:29 -"
    -rw-r--r--  1 root     root              0 Apr 20 01:30 ,
    -rw-r--r--  1 root     root              0 Apr 20 01:23 ;
    drwx--x--x  4 root     wheel         24576 Apr 20 01:47 ./
    drwx--x--x 29 toucharc toucharc       4096 Apr 15 16:52 ../
    -rw-r--r--  1 root     root              0 Apr 20 01:24 "
    -rw-r--r--  1 root     root              0 Apr 20 01:47 "-"
    -rw-r--r--  1 root     root              0 Apr 20 01:25 )
    -rw-r--r--  1 root     root              0 Apr 20 01:25 ]
    -rw-r--r--  1 root     root              0 Apr 20 01:25 0
    -rw-r--r--  1 root     root              0 Apr 20 01:41 \=0
    -rw-r--r--  1 root     root              0 Apr 20 01:45 _0
    -rw-r--r--  1 root     root              0 Apr 20 01:35 .0
    -rw-r--r--  1 root     root              0 Apr 20 01:24 .0;
    -rw-r--r--  1 root     root              0 Apr 20 01:31 .0"
    -rw-r--r--  1 root     root              0 Apr 20 01:41 0;
    -rw-r--r--  1 root     root              0 Apr 20 01:33 0]
    -rw-r--r--  1 root     root              0 Apr 20 01:31 00
    -rw-r--r--  1 root     root              0 Apr 20 01:39 0.0;
    -rw-r--r--  1 root     root              0 Apr 20 01:30 00]
    -rw-r--r--  1 root     root              0 Apr 20 01:33 00_302631_299157.jpg
    -rw-r--r--  1 root     root              0 Apr 20 01:28 00315
    -rw-r--r--  1 root     root              0 Apr 20 01:26 00317
    -rw-r--r--  1 root     root              0 Apr 20 01:30 00401
    -rw-r--r--  1 root     root              0 Apr 20 01:41 00x90&btype\=3&bpos\=default&ver\=2.0&btotal\=1&btarget\=_blank&bborder\=0
    -rw-r--r--  1 root     root              0 Apr 20 01:27 01
    -rw-r--r--  1 root     root              0 Apr 20 01:23 010
    -rw-r--r--  1 root     root              0 Apr 20 01:41 0100401
    -rw-r--r--  1 root     root              0 Apr 20 01:45 0150175168280506_216238295505_11994358_3211262_n-150x150.jpg
    -rw-r--r--  1 root     root              0 Apr 20 01:40 0175167950506_216238295505_11994350_8291551_n-150x150.jpg
    -rw-r--r--  1 root     root              0 Apr 20 01:38 0175168180506_216238295505_11994355_961967_n-150x150.jpg
    -rw-r--r--  1 root     root              0 Apr 20 01:41 03
    .....
    -rw-r--r--  1 root     root              0 Apr 20 01:36 s\=default&ver\=2.0&btotal\=1&btarget\=_blank&bborder\=0
    -rw-r--r--  1 root     root              0 Apr 20 01:28 sh;
    -rw-r--r--  1 root     root              0 Apr 20 01:28 showad&uid\=100000&bmode\=off&gpos\=center&bzone\=below_story&bsize\=525x175&btype\=3&bpos\=default&ver\=2.0&btotal\=1&btarget\=_top&bborder\=0
    -rw-r--r--  1 root     root              0 Apr 20 01:41 showad&uid\=100000&bmode\=off&gpos\=center&bzone\=forums_top&bsize\=200x90&btype\=3&bpos\=default&ver\=2.0&btotal\=1&btarget\=_blank&bborder\=0
    -rw-r--r--  1 root     root              0 Apr 20 01:35 showthread.php?t\=37452"
    -rw-r--r--  1 root     root              0 Apr 20 01:29 SIE
    -rw-r--r--  1 root     root              0 Apr 20 01:46 strategy-game-rogue-planet&size\=131k&name\=rogueplanet+002&p\=rogue+planet+ipod&oid\=f7eeb2aef6439466&fr2\=&no\=8&tt\=48&sigr\=12u8ims8a&sigi\=11u1na6ac&sigb\=12va8tpgl"
    -rw-r--r--  1 root     root              0 Apr 20 01:25 T
    -rw-r--r--  1 root     root              0 Apr 20 01:33 t%3D20811+zuzanna+fake+boobs&cd\=3&hl\=en&ct\=clnk&gl\=us&client\=firefox-a"
    -rw-r--r--  1 root     root              0 Apr 20 01:39 tal\=1&btarget\=_blank&bborder\=0
    -rw-r--r--  1 root     root              0 Apr 20 01:28 target\=_top&bborder\=0
    -rw-r--r--  1 root     root              0 Apr 20 01:39 t\=_blank&bborder\=0
    -rw-r--r--  1 root     root              0 Apr 20 01:34 tel
    -rw-r--r--  1 root     root              0 Apr 20 01:24 tible;
    ....
    -rw-r--r--  1 root     root              0 Apr 20 01:30 wthread.php?t\=37492&page\=667"
    -rw-r--r--  1 root     root              0 Apr 20 01:28 wthread.php?t\=46849&page\=4"
    -rw-r--r--  1 root     root              0 Apr 20 01:32 wthread.php?threadid\=52523"
    -rw-r--r--  1 root     root              0 Apr 20 01:31 X;
    -rw-r--r--  1 root     root              0 Apr 20 01:37 x100&btype\=3&bpos\=default&ver\=2.0&btotal\=1&btarget\=_blank&bborder\=0
    -rw-r--r--  1 root     root              0 Apr 20 01:41 x150.png
    -rw-r--r--  1 root     root              0 Apr 20 01:24 x480-75.jpg
    -rw-r--r--  1 root     root              0 Apr 20 01:26 yer-noswfobject.js?ver\=2.0
    -rw-r--r--  1 root     root              0 Apr 20 01:24 zone\=forums_top&bsize\=200x90&btype\=3&bpos\=default&ver\=2.0&btotal\=1&btarget\=_blank&bborder\=0
    
    
     
Loading...

Share This Page