Page 1 of 2 12 LastLast
Results 1 to 15 of 20

Thread: tailwatchd - chkservd on server status: hang

  1. #1
    Registered Member
    Join Date
    Nov 2007
    Posts
    904

    Thumbs up tailwatchd - chkservd on server status: hang

    hi guys,

    i am keep getting emails regarding "tailwatchd - chkservd on xxxxxx.xxxxxxx.xxxx status: hang"

    The chkservd sub-process with pid 7078 was running for 301 seconds. The sub-process was terminated as it exceeded the time between checks of 300 seconds. Please check /var/log/chkservd.log and /usr/local/cpanel/logs/tailwatchd_log to discover the cause.

    and i have checked the logs of /usr/local/cpanel/logs/tailwatchd_log

    Please find below output

    Code:
    [2012-02-11 13:58:16 +0530] [Cpanel::TailWatch] [INFO] /var/log/maillog opened with inode 325624
    [2012-02-11 13:58:16 +0530] [Cpanel::TailWatch] [INFO] /var/log/exim_mainlog opened with inode 325474
    [2012-02-11 13:58:16 +0530] [Cpanel::TailWatch] [INFO] Restored /var/log/maillog (size:153895090) to 153885825 (requested 153885825)
    [2012-02-11 13:58:16 +0530] [Cpanel::TailWatch] [INFO] Restored /var/log/exim_mainlog (size:72297657) to 72293870 (requested 72293870)
    [2012-02-11 13:58:16 +0530] [Cpanel::TailWatch] [INFO] Caught up /var/log/maillog to 153895090
    [2012-02-11 13:58:16 +0530] [Cpanel::TailWatch] [INFO] Reading back thirty lines of /var/log/maillog starting at 153878706
    [2012-02-11 13:58:16 +0530] [Cpanel::TailWatch] [INFO] Restoring /var/log/maillog to catch up position 153895090
    [2012-02-11 13:58:16 +0530] [Cpanel::TailWatch] [INFO] Restored /var/log/maillog to position 153895090
    [2012-02-11 13:58:16 +0530] [Cpanel::TailWatch] [INFO] Caught up /var/log/exim_mainlog to 72297657
    [2012-02-11 13:58:16 +0530] [Cpanel::TailWatch] [INFO] Reading back thirty lines of /var/log/exim_mainlog starting at 72281273
    [2012-02-11 13:58:16 +0530] [Cpanel::TailWatch] [INFO] Restoring /var/log/exim_mainlog to catch up position 72297657
    [2012-02-11 13:58:16 +0530] [Cpanel::TailWatch] [INFO] Restored /var/log/exim_mainlog to position 72297657
    [2012-02-11 13:58:16 +0530] [Cpanel::TailWatch::ChkServd] [INFO] Opening /var/log/chkservd.log in append mode
    [2012-02-11 13:59:58 +0530] [Cpanel::TailWatch] [INFO] Opened /usr/local/cpanel/logs/tailwatchd_log in append mode
    [2012-02-11 13:59:58 +0530] [Cpanel::TailWatch] [INFO] inotify support not available (Linux::Inotify2 missing or non-functional)
    any ideas are welcome!

  2. #2
    cPanel Staff cPanelMichael's Avatar
    Join Date
    Apr 2011
    Posts
    9,342
    cPanel/WHM Access Level

    Root Administrator

    Default Re: tailwatchd - chkservd on server status: hang

    Hello

    Quote Originally Posted by crazyaboutlinux View Post
    i am keep getting emails regarding "tailwatchd - chkservd on xxxxxx.xxxxxxx.xxxx status: hang"
    This notification is sent out when "tailwatchd::chkservd" hangs. I have seen a few instances where this has happened as a result of the "update_sa_rules" command hanging due to a SpamAssassin RPM installed on the system. Please check to see if you have a SpamAssassin RPM installed on your system:

    Code:
    # rpm -qa|grep -i spam
    If you do, I advise removing it, and reinstalling SpamAssassin via:

    Code:
    # /scripts/installspam
    To note, there is an internal case open to ensure cPanel is always running the instance of SpamAssassin that is installed by Perl.

    Thank you.
    cPResources: Support Options - Submit a ticket here - Additional Support Options - Forums Search - Mailing Lists - Documentation - Migration Services - Change Logs
    -- cPanelMichael - Migration Specialist, Technical Analyst, cPanel Technical Support

  3. #3
    Registered User
    Join Date
    Sep 2008
    Posts
    1

    Default Re: tailwatchd - chkservd on server status: hang

    Hello cPanelMichael,

    I applied what they say, but I still have this problem is not solved.
    The following e-mails continue to arrive;

    "The chkservd sub-process with pid 32278 was running for 309 seconds. The sub-process was terminated as it exceeded the time between checks of 300 seconds. Please check /var/log/chkservd.log and /usr/local/cpanel/logs/tailwatchd_log to discover the cause."

    What can I do to solve this problem?

    Thanks

  4. #4
    cPanel Staff cPanelTristan's Avatar
    Join Date
    Oct 2010
    Location
    somewhere over the rainbow
    Posts
    7,610
    cPanel/WHM Access Level

    Root Administrator

    Default Re: tailwatchd - chkservd on server status: hang

    Are you running CloudLinux with CageFS enabled? If so, then please try disabling CageFS. We had an internal case 54061 about CageFS causing issues with CloudLinux for chkservd and tailwatchd. It is supposed to be disabled in checks as of cPanel 11.30.6.0 and higher.
    cPResources: Support Options | More Support Options | Forums Search | cPanel.net Site Search | Mailing Lists(Alt) | Docs
    -- Tristan, Technical Analyst III, Forums Specialist, cPanel Tech Support

    Submit a ticket | Check an existing ticket

  5. #5
    Registered User
    Join Date
    Sep 2007
    Posts
    3

    Default Re: tailwatchd - chkservd on server status: hang

    Cloud linux is not installed on the server. The spam rpm is also installed but getting below notifications:-

    The chkservd sub-process with pid 18078 was running for 301 seconds. The sub-process was terminated as it exceeded the time between checks of 300 seconds. Please check /var/log/chkservd.log and /usr/local/cpanel/logs/tailwatchd_log to discover the cause.

    Please let me know the exact cause as this is occurring from past 2 days.


    Thank You

  6. #6
    Registered Member
    Join Date
    Dec 2010
    Posts
    57

    Default ****tailwatchd - chkservd on (Hostname) status: hang - How do I solve it?

    The chkservd sub-process with pid 13833 was running for 302 seconds. ****The sub-process was terminated as it exceeded the time between checks of 300 seconds. ****Please check /var/log/chkservd.log and /usr/local/cpanel/logs/tailwatchd_log to discover the cause.

    - I receive 100s of spam each hrs. Please tell me how do I stop it?

    What is the issue. I have normal OpenVZ with cPanel

    Thank You.

  7. #7
    cPanel Staff cPanelTristan's Avatar
    Join Date
    Oct 2010
    Location
    somewhere over the rainbow
    Posts
    7,610
    cPanel/WHM Access Level

    Root Administrator

    Default Re: tailwatchd - chkservd on server status: hang

    Hello,

    Unfortunately, it isn't possible to let you know the exact cause without login credentials to review your system, since the error message doesn't indicate what is causing it and the logs do not always show what is the cause (based on some prior tickets we've had on the issue).

    We did have two recent tickets where it was due to the update_sa_rules taking longer than the permitted 300 seconds that Michael mentioned, and in the past we've had tickets where it was due to CageFS. We have internal cases on each, and the CageFS issue is fixed already. The update_sa_rules case (57323) is slated to be available once your tier reaches 11.32

    If you wish to know what exactly is causing the issue, then please submit a ticket using WHM > Support Center > Contact cPanel or using the link in my signature. We would be happy to help track the resolution of the issue if you provide the ticket number here upon submitting one.

    Thanks!
    cPResources: Support Options | More Support Options | Forums Search | cPanel.net Site Search | Mailing Lists(Alt) | Docs
    -- Tristan, Technical Analyst III, Forums Specialist, cPanel Tech Support

    Submit a ticket | Check an existing ticket

  8. #8
    cPanel Staff cPanelMichael's Avatar
    Join Date
    Apr 2011
    Posts
    9,342
    cPanel/WHM Access Level

    Root Administrator

    Default Re: ****tailwatchd - chkservd on (Hostname) status: hang - How do I solve i

    Hello

    Please see the following thread, as it deals with the same message:

    tailwatchd - chkservd on server status: hang

    Thank you.
    cPResources: Support Options - Submit a ticket here - Additional Support Options - Forums Search - Mailing Lists - Documentation - Migration Services - Change Logs
    -- cPanelMichael - Migration Specialist, Technical Analyst, cPanel Technical Support

  9. #9
    Registered Member
    Join Date
    Feb 2012
    Posts
    18
    cPanel/WHM Access Level

    Root Administrator

    Question chkservd and tailwatchd

    I get this email notification at 1343 hrs local time:

    Code:
    The chkservd sub-process with pid 22115 was running for 301 seconds.  The sub-process was terminated as it exceeded the time between checks of 300 seconds.  Please check /var/log/chkservd.log and /usr/local/cpanel/logs/tailwatchd_log to discover the cause.
    A review of the logs gives no indication. Can anyone suggest a possible additional course of investigation? Time-relevant except of the logs follow.


    /var/log/chkservd.log from 1338 hrs onward:

    Code:
    [2012-02-21 13:38:49 -0800] Service check ....syslogd [[check command:+][tcp connect:N/A]]...sshd [[check command:+][tcp connect:N/A]]...spamd [Service Check Started
    Loading services .....cpanellogd....cpdavd....cpsrvd....exim....ftpd....httpd....imap....mysql....named....queueprocd....spamd....sshd....syslogd..Done
    [2012-02-21 13:44:12 -0800] Service check ....syslogd [[check command:+][tcp connect:N/A]]...sshd [[check command:+][tcp connect:N/A]]...spamd [[check command:+][tcp connect:N/A]]..
    .queueprocd [[check command:+][tcp connect:N/A]]...named [[check command:+][tcp connect:N/A]]...mysql [[check command:+][tcp connect:N/A]]...melange [[check command:N/A][tcp connect
    :N/A]]...imap [[socket_service_auth:1][check command:+][tcp connect:+]]...httpd [[check command:N/A][tcp connect:+]]...ftpd [[socket_service_auth:1][check command:+][tcp connect:+]]
    ...exim [[check command:+][tcp connect:+]]...entropychat [[check command:N/A][tcp connect:N/A]]...cpsrvd [[http_service_auth:1][check command:N/A][tcp connect:+]]...cpdavd [[http_se
    rvice_auth:1][check command:+][tcp connect:+]]...cpanellogd [[check command:+][tcp connect:N/A]]...Done
    Service Check Finished
    Service Check Started
    Loading services .....cpanellogd....cpdavd....cpsrvd....exim....ftpd....httpd....imap....mysql....named....queueprocd....spamd....sshd....syslogd..Done
    [2012-02-21 13:47:57 -0800] Service check ....syslogd [[check command:+][tcp connect:N/A]]...sshd [[check command:+][tcp connect:N/A]]...spamd [[check command:+][tcp connect:N/A]]...queueprocd [[check command:+][tcp connect:N/A]]...named [[check command:+][tcp connect:N/A]]...mysql [[check command:+][tcp connect:N/A]]...melange [[check command:N/A][tcp connect:N/A]]...imap [[socket_service_auth:1][check command:+][tcp connect:+]]...httpd [[check command:N/A][tcp connect:+]]...ftpd [[socket_service_auth:1][check command:+][tcp connect:+]]...exim [[check command:+][tcp connect:+]]...entropychat [[check command:N/A][tcp connect:N/A]]...cpsrvd [[http_service_auth:1][check command:N/A][tcp connect:+]]...cpdavd [[http_service_auth:1][check command:+][tcp connect:+]]...cpanellogd [[check command:+][tcp connect:N/A]]...Done
    Service Check Finished
    Service Check Started
    Loading services .....cpanellogd....cpdavd....cpsrvd....exim....ftpd....httpd....imap....mysql....named....queueprocd....spamd....sshd....syslogd..Done
    [2012-02-21 13:52:58 -0800] Service check ....syslogd [[check command:+][tcp connect:N/A]]...sshd [[check command:+][tcp connect:N/A]]...spamd [[check command:+][tcp connect:N/A]]...queueprocd [[check command:+][tcp connect:N/A]]...named [[check command:+][tcp connect:N/A]]...mysql [[check command:+][tcp connect:N/A]]...melange [[check command:N/A][tcp connect:N/A]]...imap [[socket_service_auth:1][check command:+][tcp connect:+]]...httpd [[check command:N/A][tcp connect:+]]...ftpd [[socket_service_auth:1][check command:+][tcp connect:+]]...exim [[check command:+][tcp connect:+]]...entropychat [[check command:N/A][tcp connect:N/A]]...cpsrvd [[http_service_auth:1][check command:N/A][tcp connect:+]]...cpdavd [[http_service_auth:1][check command:+][tcp connect:+]]...cpanellogd [[check command:+][tcp connect:N/A]]...Done
    Service Check Finished
    Service Check Started
    Loading services .....cpanellogd....cpdavd....cpsrvd....exim....ftpd....httpd....imap....mysql....named....queueprocd....spamd....sshd....syslogd..Done
    [2012-02-21 13:57:59 -0800] Service check ....syslogd [[check command:+][tcp connect:N/A]]...sshd [[check command:+][tcp connect:N/A]]...spamd [[check command:+][tcp connect:N/A]]...queueprocd [[check command:+][tcp connect:N/A]]...named [[check command:+][tcp connect:N/A]]...mysql [[check command:+][tcp connect:N/A]]...melange [[check command:N/A][tcp connect:N/A]]...imap [[socket_service_auth:1][check command:+][tcp connect:+]]...httpd [[check command:N/A][tcp connect:+]]...ftpd [[socket_service_auth:1][check command:+][tcp connect:+]]...exim [[check command:+][tcp connect:+]]...entropychat [[check command:N/A][tcp connect:N/A]]...cpsrvd [[http_service_auth:1][check command:N/A][tcp connect:+]]...cpdavd [[http_service_auth:1][check command:+][tcp connect:+]]...cpanellogd [[check command:+][tcp connect:N/A]]...Done
    Service Check Finished
    Service Check Started
    Loading services .....cpanellogd....cpdavd....cpsrvd....exim....ftpd....httpd....imap....mysql....named....queueprocd....spamd....sshd....syslogd..Done
    [2012-02-21 14:03:00 -0800] Service check ....syslogd [[check command:+][tcp connect:N/A]]...sshd [[check command:+][tcp connect:N/A]]...spamd [[check command:+][tcp connect:N/A]]...queueprocd [[check command:+][tcp connect:N/A]]...named [[check command:+][tcp connect:N/A]]...mysql [[check command:+][tcp connect:N/A]]...melange [[check command:N/A][tcp connect:N/A]]...imap [[socket_service_auth:1][check command:+][tcp connect:+]]...httpd [[check command:N/A][tcp connect:+]]...ftpd [[socket_service_auth:1][check command:+][tcp connect:+]]...exim [[check command:+][tcp connect:+]]...entropychat [[check command:N/A][tcp connect:N/A]]...cpsrvd [[http_service_auth:1][check command:N/A][tcp connect:+]]...cpdavd [[http_service_auth:1][check command:+][tcp connect:+]]...cpanellogd [[check command:+][tcp connect:N/A]]...Done
    Service Check Finished
    Service Check Started
    Loading services .....cpanellogd....cpdavd....cpsrvd....exim....ftpd....httpd....imap....mysql....named....queueprocd....spamd....sshd....syslogd..Done
    [2012-02-21 14:08:01 -0800] Service check ....syslogd [[check command:+][tcp connect:N/A]]...sshd [[check command:+][tcp connect:N/A]]...spamd [[check command:+][tcp connect:N/A]]...queueprocd [[check command:+][tcp connect:N/A]]...named [[check command:+][tcp connect:N/A]]...mysql [[check command:+][tcp connect:N/A]]...melange [[check command:N/A][tcp connect:N/A]]...imap [[socket_service_auth:1][check command:+][tcp connect:+]]...httpd [[check command:N/A][tcp connect:+]]...ftpd [[socket_service_auth:1][check command:+][tcp connect:+]]...exim [[check command:+][tcp connect:+]]...entropychat [[check command:N/A][tcp connect:N/A]]...cpsrvd [[http_service_auth:1][check command:N/A][tcp connect:+]]...cpdavd [[http_service_auth:1][check command:+][tcp connect:+]]...cpanellogd [[check command:+][tcp connect:N/A]]...Done
    Service Check Finished
    Service Check Started
    Loading services .....cpanellogd....cpdavd....cpsrvd....exim....ftpd....httpd....imap....mysql....named....queueprocd....spamd....sshd....syslogd..Done
    [2012-02-21 14:13:02 -0800] Service check ....syslogd [[check command:+][tcp connect:N/A]]...sshd [[check command:+][tcp connect:N/A]]...spamd [[check command:+][tcp connect:N/A]]...queueprocd [[check command:+][tcp connect:N/A]]...named [[check command:+][tcp connect:N/A]]...mysql [[check command:+][tcp connect:N/A]]...melange [[check command:N/A][tcp connect:N/A]]...imap [[socket_service_auth:1][check command:+][tcp connect:+]]...httpd [[check command:N/A][tcp connect:+]]...ftpd [[socket_service_auth:1][check command:+][tcp connect:+]]...exim [[check command:+][tcp connect:+]]...entropychat [[check command:N/A][tcp connect:N/A]]...cpsrvd [[http_service_auth:1][check command:N/A][tcp connect:+]]...cpdavd [[http_service_auth:1][check command:+][tcp connect:+]]...cpanellogd [[check command:+][tcp connect:N/A]]...Done
    Service Check Finished
    /usr/local/cpanel/logs/tailwatchd_log has no records dated after "[2012-02-19 04:02:39 -0800]". The last line is "Notification => __email removed__ via EMAIL [level => 1]"

  10. #10
    cPanel Staff cPanelTristan's Avatar
    Join Date
    Oct 2010
    Location
    somewhere over the rainbow
    Posts
    7,610
    cPanel/WHM Access Level

    Root Administrator

    Default Re: tailwatchd - chkservd on server status: hang

    The best way to track this down if the suggestions provided in this thread do not assist would be to submit a ticket using the link in my signature or WHM > Support Center > Contact cPanel area. Thanks!
    cPResources: Support Options | More Support Options | Forums Search | cPanel.net Site Search | Mailing Lists(Alt) | Docs
    -- Tristan, Technical Analyst III, Forums Specialist, cPanel Tech Support

    Submit a ticket | Check an existing ticket

  11. #11
    Technical Product Specialist cPanelDavidG's Avatar
    Join Date
    Nov 2006
    Location
    Houston, TX
    Posts
    11,296
    cPanel/WHM Access Level

    Root Administrator

    Default Re: tailwatchd - chkservd on server status: hang

    Quote Originally Posted by cPanelTristan View Post
    The update_sa_rules case (57323) is slated to be available once your tier reaches 11.32
    This case is resolved in version 11.32.1.3 and later which is now propagating.

  12. #12
    PbG
    PbG is offline
    Registered Member PbG's Avatar
    Join Date
    Mar 2003
    Posts
    239

    Default Re: tailwatchd - chkservd on server status: hang

    David Please advise which tree this version is on? Eg: Stable, Release, etc

    Quote Originally Posted by cPanelDavidG View Post
    This case is resolved in version 11.32.1.3 and later which is now propagating.

  13. #13
    cPanel Staff cPanelMichael's Avatar
    Join Date
    Apr 2011
    Posts
    9,342
    cPanel/WHM Access Level

    Root Administrator

    Default Re: tailwatchd - chkservd on server status: hang

    Quote Originally Posted by PbG View Post
    David Please advise which tree this version is on? Eg: Stable, Release, etc
    cPanel 11.32.1.4 is available on the "Current" tier. The tiers are merely an indication of update frequency, so it's better to focus on the actual version number. You can review the "Latest cPanel & WHM Builds (All Architectures)" at:

    layer2.cpanel.net

    Thank you.
    cPResources: Support Options - Submit a ticket here - Additional Support Options - Forums Search - Mailing Lists - Documentation - Migration Services - Change Logs
    -- cPanelMichael - Migration Specialist, Technical Analyst, cPanel Technical Support

  14. #14
    Registered User
    Join Date
    Dec 2011
    Posts
    1
    cPanel/WHM Access Level

    Website Owner

    Default Re: tailwatchd - chkservd on server status: hang

    I'm also receiving this The chkservd sub-process with pid 27689 was running for 301 seconds. The sub-process was terminated as it exceeded the time between checks of 300 seconds. Please check /var/log/chkservd.log and /usr/local/cpanel/logs/tailwatchd_log to discover the cause. I need someone to explain thoroughly how to stop this and if its a big issue. I'm sorry for not being so tech savvy.

  15. #15
    Registered Member
    Join Date
    Jun 2007
    Posts
    217
    cPanel/WHM Access Level

    DataCenter Provider

    Default Re: tailwatchd - chkservd on server status: hang

    So I have a question about this line in the email that is received:

    Code:
    The chkservd sub-process with pid 22115 was running for 301 seconds.  The sub-process was terminated ...
    If cPanel already knows the pid number (as evidenced in the email), why not also display what process that pid belongs to?

    That would really help in determining if it's exim, httpd, spamd, mysql, etc... By the time this email arrives, that pid no longer exists because it was terminated. So there's no way to know which process was actually terminated (and hopefully restarted). But if the pid is known prior to (or at the time) the HANG is determined, then you should be able to include the exact process name that is causing the problem right?

Page 1 of 2 12 LastLast

Similar Threads

  1. Replies: 1
    Last Post: 04-15-2011, 07:59 AM
  2. tailwatchd on (server) failed - hourly error message
    By zerokarma in forum cPanel & WHM Discussions
    Replies: 2
    Last Post: 02-22-2010, 01:38 PM
  3. capture text to file: Server Status > Apache Status
    By simpleupdates in forum cPanel & WHM Discussions
    Replies: 2
    Last Post: 12-07-2008, 09:43 PM
  4. Server Hang When I Run (fixeverything)
    By Platinum Tech in forum cPanel & WHM Discussions
    Replies: 0
    Last Post: 07-13-2004, 05:49 PM
  5. server hang
    By cpanel_venkat in forum cPanel & WHM Discussions
    Replies: 4
    Last Post: 04-24-2004, 06:59 AM

Tags for this Thread

bargain