The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Hundreds of CRONDs generated by Cpbackup CPU overload

Discussion in 'Data Protection' started by mygregory, May 19, 2005.

  1. mygregory

    mygregory Active Member

    Joined:
    May 28, 2004
    Messages:
    32
    Likes Received:
    0
    Trophy Points:
    6
    Hi All,

    This morning found a server in a very unhappy state. Had not received the cpbackup mailing at oneish in the morning, but the upcp did arrive. Login to SSH was hanging, Fortunately WHM let me in CPU was at 200. Info I did manage to get through WHM was the following CPU usage:

    Code:
    24718  	root  	0  	 1.1	 0.2  	0 top -n 2 -b -
    24722 	root 	0 	0.9	0.4 	/usr/bin/perl /scripts/restartsrv_eximstats --check
    24723 	root 	0 	0.7	0.1 	/bin/ps uxawwww
    24693 	nobody 	0 	0.3	1.3 	/usr/local/apache/bin/httpd -DSSL
    2096 	root 	0 	0.1	0.5 	chkservd
    1 	root 	0 	0.0	0.1 	init
    2 	root 	0 	0.0	0.0 	0 keventd
    3 	root 	0 	0.0	0.0 	0 kapmd
    4 	root 	19 	0.0	0.0 	0 ksoftirqd/0
    7 	root 	0 	0.0	0.0 	0 bdflush
    5 	root 	0 	0.0	0.0 	0 kswapd
    6 	root 	0 	0.0	0.0 	0 kscand
    8 	root 	0 	0.0	0.0 	0 kupdated
    9 	root 	0 	0.0	0.0 	0 mdrecoveryd
    13 	root 	0 	0.0	0.0 	0 kjournald
    554 	root 	0 	0.0	0.0 	0 kjournald
    555 	root 	0 	0.0	0.0 	0 kjournald
    556 	root 	0 	0.0	0.0 	0 kjournald
    557 	root 	0 	0.0	0.0 	0 kjournald
    558 	root 	0 	0.0	0.0 	0 kjournald
    855 	root 	0 	0.0	0.0 	0 eth0
    979 	root 	0 	0.0	0.0 	mdadm --monitor --scan -f
    2057 	root 	0 	0.0	0.3 	/usr/sbin/sshd
    2180 	root 	0 	0.0	1.3 	/usr/local/apache/bin/httpd -DSSL
    2193 	root 	0 	0.0	0.1 	crond
    2210 	root 	0 	0.0	0.2 	/bin/sh /usr/bin/mysqld_safe --datadir=/var/lib/mysql --pid-file=/var/lib/mysql/host.domain.com.pid
    2302 	mysql 	0 	0.0	2.3 	/usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/host.domain.com.pid --skip-locking
    2329 	mysql 	0 	0.0	2.3 	/usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/host.domain.com.pid --skip-locking
    2330 	mysql 	0 	0.0	2.3 	/usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/host.domain.com.pid --skip-locking
    2331 	mysql 	0 	0.0	2.3 	/usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/host.domain.com.pid --skip-locking
    2332 	mysql 	0 	0.0	2.3 	/usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/host.domain.com.pid --skip-locking
    2333 	mysql 	0 	0.0	2.3 	/usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/host.domain.com.pid --skip-locking
    2334 	mysql 	0 	0.0	2.3 	/usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/host.domain.com.pid --skip-locking
    2335 	mysql 	0 	0.0	2.3 	/usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/host.domain.com.pid --skip-locking
    2336 	mysql 	0 	0.0	2.3 	/usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/host.domain.com.net.pid --skip-locking
    2337 	mysql 	0 	0.0	2.3 	/usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/host.domain.com.net.pid --skip-locking
    2390 	cpanel 	0 	0.0	0.3 	/usr/bin/stunnel-4.04local /usr/local/cpanel/etc/stunnel/default/stunnel.conf
    2429 	root 	0 	0.0	0.0 	/sbin/mingetty tty2
    2430 	root 	0 	0.0	0.0 	/sbin/mingetty tty3
    2431 	root 	0 	0.0	0.0 	/sbin/mingetty tty4
    2432 	root 	0 	0.0	0.0 	/sbin/mingetty tty5
    2433 	root 	0 	0.0	0.0 	/sbin/mingetty tty6
    2447 	root 	0 	0.0	1.5 	cpsrvd - waiting for connections
    2476 	mailnull 	0 	0.0	0.7 	/usr/bin/perl /usr/local/cpanel/bin/eximstats
    2477 	mysql 	0 	0.0	2.3 	/usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/host.domain.com.pid --skip-locking
    2508 	root 	0 	0.0	0.3 	pure-ftpd (SERVER)
    2512 	root 	0 	0.0	0.1 	/usr/sbin/pure-authd -s /var/run/ftpd.sock -r /usr/sbin/pureauth
    6795 	mailnull 	0 	0.0	0.3 	/usr/sbin/exim -bd -q60m
    6800 	mailnull 	0 	0.0	0.3 	/usr/sbin/exim -tls-on-connect -bd -oX 465
    6810 	root 	0 	0.0	3.8 	/usr/bin/spamd -d --allowed-ips=127.0.0.1 --pidfile=/var/run/spamd.pid --max-children=5
    6831 	root 	0 	0.0	0.2 	antirelayd
    6832 	root 	0 	0.0	3.9 	spamd child
    6833 	root 	0 	0.0	3.9 	spamd child
    6834 	root 	0 	0.0	3.9 	spamd child
    6835 	root 	0 	0.0	3.9 	spamd child
    6836 	root 	0 	0.0	3.9 	spamd child
    6899 	root 	0 	0.0	1.3 	cppop - accepting on port 110
    6944 	root 	0 	0.0	0.1 	xinetd -stayalive -pidfile /var/run/xinetd.pid
    17281 	root 	0 	0.0	0.0 	/sbin/mingetty tty1
    18138 	nobody 	0 	0.0	1.6 	/usr/local/apache/bin/httpd -DSSL
    18139 	nobody 	0 	0.0	1.6 	/usr/local/apache/bin/httpd -DSSL
    18140 	nobody 	0 	0.0	1.6 	/usr/local/apache/bin/httpd -DSSL
    18141 	nobody 	0 	0.0	1.6 	/usr/local/apache/bin/httpd -DSSL
    18142 	nobody 	0 	0.0	1.9 	/usr/local/apache/bin/httpd -DSSL
    18195 	nobody 	0 	0.0	1.6 	/usr/local/apache/bin/httpd -DSSL
    18352 	nobody 	0 	0.0	1.8 	/usr/local/apache/bin/httpd -DSSL
    18355 	nobody 	0 	0.0	1.6 	/usr/local/apache/bin/httpd -DSSL
    18356 	nobody 	0 	0.0	1.6 	/usr/local/apache/bin/httpd -DSSL
    18537 	nobody 	0 	0.0	1.6 	/usr/local/apache/bin/httpd -DSSL
    8260 	root 	0 	0.0	0.1 	syslogd -m 0
    8264 	root 	0 	0.0	0.0 	klogd -x
    22932 	root 	0 	0.0	0.1 	CROND
    23043 	mailnull 	0 	0.0	0.3 	/usr/sbin/sendmail -FCronDaemon -i -odi -oem root
    23117 	root 	0 	0.0	0.1 	CROND
    23118 	root 	0 	0.0	0.1 	CROND
    
    hundreds of the above  line...
    
    23291 	root 	0 	0.0	0.1 	CROND
    23297 	mysql 	0 	0.0	2.3 	/usr/sbin/mysqld --basedir=/ --datadir=/var/lib/mysql --user=mysql --pid-file=/var/lib/mysql/host.domain.com.pid --skip-locking
    23306 	root 	0 	0.0	0.1 	CROND
    23307 	root 	0 	0.0	0.1 	CROND
    23324 	root 	0 	0.0	0.1 	CROND...
    
    hundreds of the above line...
    
    23325 	root 	0 	0.0	0.1 	CRON
    24686 	root 	0 	0.0	0.1 	CROND
    24694 	nobody 	0 	0.0	1.3 	/usr/local/apache/bin/httpd -DSSL
    24695 	root 	0 	0.0	0.4 	sshd: root [priv]
    24696 	sshd 	0 	0.0	0.3 	sshd: root [net]
    24697 	nobody 	0 	0.0	1.3 	/usr/local/apache/bin/httpd -DSSL
    24700 	root 	0 	0.0	0.1 	CROND
    24701 	root 	0 	0.0	0.1 	CROND
    24715 	cpanel 	0 	0.0	0.3 	/usr/bin/stunnel-4.04local /usr/local/cpanel/etc/stunnel/default/stunnel.conf
    24716 	root 	0 	0.0	1.6 	whostmgrd - serving 127.0.0.1
    24717 	root 	0 	0.0	3.2 	/usr/local/cpanel/whostmgr/bin/whostmgr2 ./top
    24721 	mailnull 	0 	0.0	0.0 	0 exim
    
    As you can see, many many cronds generated. The mail log shows that queue processing was refused first time at 2AM because of CPU levels but at 1AM it was fine, at 3:00 cpu was double and at 4:00 triple.

    Ergo between 1 and 2 am things started getting out of hand. Only cron at that time is cpbackup (though logcheck also runs on the hour and the usual bandmin etc. at small intervals)

    WHM 10.1.0 cPanel 10.2.0-R82
    CentOS 3.4 i686 - WHM X v3.1.0

    Anyone seen this before?

    Could audit be the culprit? Or the fact that I was trying out the WHM=> backups=> Mount disk at backup time then unmount feature. I then turned it off, so now backup disk is mounted all the time. :confused:

    Thanks.
     
  2. chirpy

    chirpy Well-Known Member

    Joined:
    Jun 15, 2002
    Messages:
    13,475
    Likes Received:
    20
    Trophy Points:
    38
    Location:
    Go on, have a guess
    audit (if you mean laus) can definitely be the culprit, it's know to cause servers to crash with similar symptoms to yours:

    rpm -ev laus
    echo alias "char-major-10-224 off" >> /etc/modules.conf
    service crond stop
    rmmod audit
    service crond start
     
  3. mygregory

    mygregory Active Member

    Joined:
    May 28, 2004
    Messages:
    32
    Likes Received:
    0
    Trophy Points:
    6
    Thanks.

    Is there any good reason for keeping laus/audit? I understand it can provide reliable log information (if that is indeed what it does).

    :confused:
     
  4. chirpy

    chirpy Well-Known Member

    Joined:
    Jun 15, 2002
    Messages:
    13,475
    Likes Received:
    20
    Trophy Points:
    38
    Location:
    Go on, have a guess
    None that I've found. It seems more trouble than its worth and if you're not actively using it for something, then there seems little point in taking the performance hit and server crashes.
     

Share This Page