MySQL continuously restarting restartsrv2 mysqlconnectioncheck

[daWeazy]

This has been happening non-stop since about 4:00PST. I have upgraded kernel, rebooted, locked down /tmp, /var/tmp, verfied my.cnf for the proper .sock file location, forced updated cpanel, recompiled apache, upgrade php, rebooted, almost perfectly in that order. What the heck is going on. Mysql restarts every 30 seconds or something crazy, and I cant seem to find any errors in the log files. HELP!!

root 28167 0.0 1.2 12812 11496 ? S 02:40 0:00 /usr/local/cpanel/whostmgr/bin/whostmgr doresetmysqlroot
root 28195 0.0 0.0 0 0 ? Z 02:40 0:00 [whostmgr] <defunct>
root 28222 0.0 0.2 4212 2560 ? S 02:40 0:00 /usr/bin/perl /scripts/restartsrv2 mysql
root 28294 0.0 0.3 4792 3220 ? S 02:40 0:00 /usr/bin/perl /scripts/restartsrv_mysql --check
root 28295 0.0 0.2 4112 2636 ? S 02:40 0:00 /usr/bin/perl /scripts/mysqlconnectioncheck
root 28296 0.0 0.0 0 0 ? Z 02:40 0:00 [mysql] <defunct>
root 28298 0.0 1.2 12812 11496 ? S 02:40 0:00 /usr/local/cpanel/whostmgr/bin/whostmgr doresetmysqlroot
root 28334 0.0 0.0 0 0 ? Z 02:40 0:00 [whostmgr] <defunct>
root 28368 0.0 0.2 4208 2556 ? S 02:41 0:00 /usr/bin/perl /scripts/restartsrv2 mysql
root 28440 0.0 0.3 4796 3224 ? S 02:41 0:00 /usr/bin/perl /scripts/restartsrv_mysql --check
root 28441 0.0 0.2 4112 2636 ? S 02:41 0:00 /usr/bin/perl /scripts/mysqlconnectioncheck
root 28442 0.0 0.0 0 0 ? Z 02:41 0:00 [mysql] <defunct>
root 28444 0.0 1.2 12812 11496 ? S 02:41 0:00 /usr/local/cpanel/whostmgr/bin/whostmgr doresetmysqlroot
root 28474 0.0 0.0 0 0 ? Z 02:41 0:00 [whostmgr] <defunct>
root 28498 0.0 0.2 4208 2556 ? S 02:41 0:00 /usr/bin/perl /scripts/restartsrv2 mysql
root 28567 0.0 0.3 4796 3224 ? S 02:41 0:00 /usr/bin/perl /scripts/restartsrv_mysql --check
root 28568 0.0 0.2 4112 2636 ? S 02:41 0:00 /usr/bin/perl /scripts/mysqlconnectioncheck
root 28569 0.0 0.0 0 0 ? Z 02:41 0:00 [mysql] <defunct>
root 28571 0.0 1.2 12812 11496 ? S 02:41 0:00 /usr/local/cpanel/whostmgr/bin/whostmgr doresetmysqlroot
root 28598 0.0 0.0 0 0 ? Z 02:42 0:00 [whostmgr] <defunct>
root 28623 0.0 0.2 4204 2552 ? S 02:42 0:00 /usr/bin/perl /scripts/restartsrv2 mysql
root 28693 0.0 0.3 4796 3224 ? S 02:42 0:00 /usr/bin/perl /scripts/restartsrv_mysql --check
root 28694 0.0 0.2 4112 2636 ? S 02:42 0:00 /usr/bin/perl /scripts/mysqlconnectioncheck
root 28695 0.0 0.0 0 0 ? Z 02:42 0:00 [mysql] <defunct>
root 28697 0.1 1.2 12812 11496 ? S 02:42 0:00 /usr/local/cpanel/whostmgr/bin/whostmgr doresetmysqlroot
root 28724 0.0 0.0 0 0 ? Z 02:42 0:00 [whostmgr] <defunct>
root 28748 0.1 0.2 4204 2552 ? S 02:42 0:00 /usr/bin/perl /scripts/restartsrv2 mysql
root 28819 0.2 0.3 4796 3224 ? S 02:43 0:00 /usr/bin/perl /scripts/restartsrv_mysql --check
root 28820 0.1 0.2 4112 2636 ? S 02:43 0:00 /usr/bin/perl /scripts/mysqlconnectioncheck

[daWeazy]

funny I just figured out the fix. Rebuild RPM mysql-server with the Force option fixed this issue. Very strange. Now this makes me wonder how mysql became corrupted.... Any ideas?

[daWeazy]

problem came back... HELP!

[Blue|Fusion]

Shoot me a PM or IM and i could take a look at it.

[cpanelben]

chkservd calls /script/restartsrv_mysql --check, which calls /scripts/mysqlconnectioncheck. If mysql does not respond, then it is assumed that mysql is down. chkservd then call /scripts/restartsrv2 mysql. The key is to determine if mysql is up and running. Then to find out why it may not be responding. And in your case, why it would fail after a short period of time. Not much of a short answer, but maybe it'll help you sort it out.

[Blue|Fusion]

try the following:
service cpanel stop
service mysql stop

use ps -ax and ensure all of processes you posted above are killed, if not kill them manually

service mysql start
service cpanel start

[daWeazy]

I have performed all these solutions and nothing works. Trust me I have spent hours reading all the posts relating to mysql crashing in this forum.

[daWeazy]

chkservd calls /script/restartsrv_mysql --check, which calls /scripts/mysqlconnectioncheck. If mysql does not respond, then it is assumed that mysql is down. chkservd then call /scripts/restartsrv2 mysql. The key is to determine if mysql is up and running. Then to find out why it may not be responding. And in your case, why it would fail after a short period of time. Not much of a short answer, but maybe it'll help you sort it out.

This sure is a wierd issue. I am pretty good with sorting out problems like this, but this one is a major pain in my ass. the logs just show: mysql started ok, mysql stopped ok etc.. no real error messages. I am starting to think this chkservd might be broken is there a way to like reinstall all cpanel services? I dont know what to do all my sites are down. Then dns breaks. Its just bad.

[Blue|Fusion]

/scripts/upcp --force will rebuild cPanel

[nikhilr]

Same mysql restarting problem. Server crashes.
This happens when we try restarting mysql. But if mysql is started with --skip-grant-tables this does not happen.

Regards
SSR

[easyhoster1]

Same mysql restarting problem. Server crashes.
This happens when we try restarting mysql. But if mysql is started with --skip-grant-tables this does not happen.

Regards
SSR

We had the same problem and had to rebuild the server. Looks like the root MySQL password is corrupted and could not reset it from WHM. Can you access phpadmin from WHM?

[adtekinc]

same problem. any resolution ?

thousands of mysql related processes running until it locks the server after 3 hours.

[Donna]

/scripts/mysqlup --force

reset pass via WHM then reboot.

[adtekinc]

/scripts/mysqlup --force

so far, so good. up 30 mins and less than 100 processes.

thanks donna - your a life saver

[Donna]

Anytime.... took me a bit to sort out as I was trying to setup a server for a new client and no matter what else I did it wouldn't install mysql. Found that option fixed it rather easily