cPanel & WHM update process is non-responsive and terminated

obak · Nov 30, 2015

Dear,

I can't update cPanel-WHM to newer version. It is hanged up since last 1 months. I am getting daily the following email (also see the attachment screenshot):

Code:

The cPanel & WHM update process is non-responsive and will be terminated.
The system ran the “/usr/local/cpanel/scripts/upcp” script as PID “27743” for longer than 6 hours. The system will terminate this process and run the script again.

Update log preview:
----------------------------------------------------------------------------------------------------
=> Log opened from /usr/local/cpanel/scripts/upcp (23951) at Mon Nov 30 03:37:01 2015
[2015-11-30 03:37:01 -0500] W previous PID (27743) has been running more than 6 hours. Killing processes.
This notice was generated on “Monday, November 30, 2015” at “8:37:01 AM UTC”.

See the update process screenshot too from WHM control panel.

What can I do now? Do I need to use "Graceful Server Reboot"? Will this solve it?
If I use "Graceful Server Reboot" then will the server run automatically with all services as a live server (without any manual task)?

Please help.

24x7server · Nov 30, 2015

Hello,

Yes, You can reboot your server using "Graceful Server Reboot" options of WHM, But I will suggest you please login your server and check what going on the server. You can update here following command output so that we can assist you on this.

Code:

df -h
df -i

The following command will display the log files in order from oldest to newest, Check new file and update here last logs from that file.

Code:

/bin/ls -Altr /var/cpanel/updatelogs[CODE]

obak · Dec 1, 2015

Thank for reply 24x7server.

If I use "Graceful Server Reboot" then will the server start automatically with all services running (that means back to live working web server)? Or do I have to do more thing to run the server?

Here is the output you asked:

Code:

# df -h
Filesystem      Size  Used Avail Use% Mounted on
rootfs           49G   27G   20G  58% /
/dev/root        49G   27G   20G  58% /
devtmpfs         16G  272K   16G   1% /dev
/dev/md3        1.8T   18G  1.7T   2% /home
tmpfs            16G     0   16G   0% /dev/shm
/dev/loop0      485M   11M  449M   3% /tmp
/dev/loop0      485M   11M  449M   3% /var/tmp


# df -i
Filesystem        Inodes  IUsed     IFree IUse% Mounted on
rootfs           3203072 162409   3040663    6% /
/dev/root        3203072 162409   3040663    6% /
devtmpfs         4107341   2418   4104923    1% /dev
/dev/md3       118865920  78147 118787773    1% /home
tmpfs            4107455      1   4107454    1% /dev/shm
/dev/loop0        128016     27    127989    1% /tmp
/dev/loop0        128016     27    127989    1% /var/tmp

Code:

[/var/cpanel/updatelogs]# cat update.1448959022.log
--------------------------------------------------------------------------------                                                                             --------------------
=> Log opened from /usr/local/cpanel/scripts/upcp (6233) at Tue Dec  1 03:37:02                                                                              2015
[2015-12-01 03:37:02 -0500] W previous PID (23983) has been running more than 6                                                                              hours. Killing processes.
[2015-12-01 03:37:04 -0500]   Detected cron=1 (cron mode set from command line)
[2015-12-01 03:37:04 -0500]   1% complete
[2015-12-01 03:37:04 -0500]   Running Standardized hooks
[2015-12-01 03:37:04 -0500]   2% complete
[2015-12-01 03:37:04 -0500]   mtime on upcp is 1438410028 (Sat Aug  1 02:20:28 2                                                                             015)
--------------------------------------------------------------------------------                                                                             --------------------
=> Log opened from /usr/local/cpanel/scripts/updatenow (6323) at Tue Dec  1 03:3                                                                             7:04 2015
[2015-12-01 03:37:05 -0500]   Retrieved public key from vendor: cpanel, category                                                                             : release, url: https://securedownloads.cpanel.net/cPanelPublicKey.asc
[2015-12-01 03:37:05 -0500]   Retrieved public key from vendor: cpanel, category                                                                             : development, url: https://securedownloads.cpanel.net/cPanelDevelopmentKey.asc
[2015-12-01 03:37:05 -0500]   Retrieved public key from vendor: cpanel, category                                                                             : development-sts, url: https://securedownloads.cpanel.net/STSTestKey.asc
[2015-12-01 03:37:05 -0500]   Detected version '11.50.0.30' from version file.
[2015-12-01 03:37:05 -0500]   Running version '11.50.0.30' of updatenow.
[2015-12-01 03:37:05 -0500]   cPanel & WHM updates are disabled via cron.
[2015-12-01 03:37:05 -0500]   No sync will occur.
=> Log closed Tue Dec  1 03:37:05 2015
[2015-12-01 03:37:05 -0500]   17% complete
=> Log closed Tue Dec  1 03:37:05 2015
--------------------------------------------------------------------------------                                                                             --------------------
=> Log opened from /usr/local/cpanel/scripts/maintenance (6340) at Tue Dec  1 03                                                                             :37:05 2015
[2015-12-01 03:37:05 -0500]   21% complete
[2015-12-01 03:37:05 -0500]   Purging cpupdate.conf of invalid entries
[2015-12-01 03:37:05 -0500]   Processing: Assuring needed symlinks in 3rdparty/b                                                                             in are in place.
[2015-12-01 03:37:05 -0500]    - Processing command `/usr/local/cpanel/scripts/l                                                                             ink_3rdparty_binaries`
[2015-12-01 03:37:05 -0500]   Processing: Setting clock
[2015-12-01 03:37:05 -0500]    - Processing command `/usr/local/cpanel/scripts/r                                                                             date`
[2015-12-01 03:37:01 -0500]   22% complete
[2015-12-01 03:37:01 -0500]   Processing: Updating cPanel signing keys.
[2015-12-01 03:37:01 -0500]    - Processing command `/usr/local/cpanel/scripts/u                                                                             pdatesigningkey`
[2015-12-01 03:37:01 -0500]   Processing: Checking for immutable files
[2015-12-01 03:37:01 -0500]    - Processing command `/usr/local/cpanel/scripts/c                                                                             heck_immutable_files`
[2015-12-01 03:37:01 -0500]      [6356] Not testing for immutable files, because                                                                              the test was last run approximately 3 days ago (less than 10 days)
[2015-12-01 03:37:01 -0500]   23% complete

24x7server · Dec 1, 2015

Hello

,

Yes, You can restart your server using " Graceful Server Reboot" Options. Once your reboot it your server will be reboot and all services will be online after server reboot. There is no need to restart any service manually on the server.

cPanelMichael · Dec 1, 2015

Hello

You should not have to reboot the server to troubleshoot the issue. Could you verify if your server is under high load or high disk I/O during the cPanel update process? This thread can help you investigate the issue:

Troubleshooting high server loads on Linux servers

Thank you.

obak · Dec 2, 2015

@cPanelMichael , here are some logos. Please review and suggest me what can I do now....

Speciall see the "# free -m" logs

Code:

# sar -q

12:00:01 AM   runq-sz  plist-sz   ldavg-1   ldavg-5  ldavg-15
12:10:01 AM         5       397      3.25      3.14      3.14
12:20:01 AM         6       391      7.76      6.93      4.89
12:30:01 AM         7       384      3.10      3.65      4.06
12:40:01 AM         5       382      3.03      3.16      3.60
12:50:01 AM         5       369      3.06      3.05      3.33
01:00:01 AM         6       397      5.35      3.63      3.44
01:10:01 AM         5       387      3.39      3.29      3.33
01:20:01 AM        15       377      5.65      3.82      3.48
01:30:01 AM         5       384      3.25      3.45      3.48
01:40:01 AM         5       365      2.98      3.10      3.28
01:50:01 AM         6       387      3.16      3.17      3.28
02:00:01 AM         6       372      3.32      3.30      3.29
02:10:01 AM         5       383      3.19      3.15      3.22
02:20:01 AM         5       390      3.36      3.40      3.30
02:30:01 AM         6       367      3.14      3.47      3.50
02:40:01 AM         5       368      3.04      3.18      3.33
02:50:01 AM         5       367      3.05      3.13      3.23
03:00:01 AM         8       399      3.12      3.22      3.27
03:10:01 AM         5       388      3.01      3.10      3.20
03:20:01 AM         5       382      3.25      3.14      3.16
03:30:01 AM         5       366      3.19      3.19      3.18
03:40:01 AM         5       356      3.10      3.14      3.14
03:50:01 AM         5       366      3.02      3.06      3.12
04:00:01 AM         5       378      3.15      3.14      3.14
04:10:01 AM         5       405      3.38      3.23      3.18
04:20:01 AM         5       360      3.09      3.13      3.14
04:30:01 AM         8       383      3.41      5.16      4.50
04:40:01 AM         5       367      3.33      3.82      4.10
04:50:01 AM         5       366      3.00      3.16      3.61
05:00:01 AM         5       410      3.01      3.15      3.42
05:10:01 AM         5       381      3.17      3.13      3.29
05:20:01 AM         6       372      3.06      3.15      3.25
05:30:01 AM         7       374      5.68      5.29      4.17
05:40:01 AM         5       380      3.17      3.42      3.67
05:50:01 AM         5       369      3.02      3.18      3.43
06:00:01 AM         6       396      3.12      3.18      3.33
06:10:01 AM         5       397      3.05      3.09      3.21
06:20:01 AM         5       399      3.29      3.12      3.16
06:30:01 AM        20       391      5.32      3.66      3.32
06:40:01 AM         5       390      3.15      3.28      3.30
06:50:01 AM         5       403      4.01      3.57      3.40
07:00:01 AM         5       405      3.12      3.14      3.25
07:10:01 AM         5       379      3.09      3.12      3.19
07:20:01 AM         5       389      3.40      3.19      3.20
07:30:01 AM         5       362      3.12      3.18      3.19
07:40:01 AM         5       372      3.10      3.52      3.54
07:50:01 AM         5       391      3.01      3.18      3.36
08:00:01 AM         6       407      4.61      3.56      3.46
08:10:01 AM         5       371      3.16      3.19      3.31
08:20:01 AM         5       381      3.06      3.31      3.35
08:30:01 AM         7       368      3.01      3.09      3.21
08:40:01 AM         5       396      3.22      4.00      3.82
08:50:01 AM         5       379      3.03      3.21      3.47
09:00:01 AM         6       400      3.36      3.24      3.36
09:10:01 AM         5       397      3.21      3.19      3.29
09:20:01 AM         5       400      3.40      3.38      3.31
09:30:01 AM         5       394      3.28      3.23      3.25
09:40:01 AM         5       416      3.10      3.20      3.22

09:40:01 AM   runq-sz  plist-sz   ldavg-1   ldavg-5  ldavg-15
09:50:01 AM         5       387      3.17      3.16      3.20
10:00:01 AM         5       407      3.26      3.26      3.28
10:10:01 AM         5       409      3.15      3.18      3.23
10:20:01 AM         5       400      3.16      3.18      3.22
10:30:01 AM         6       406      3.43      3.28      3.23
Average:            6       385      3.42      3.39      3.39

-----------------------------------------------------------------
# top c

top - 10:29:51 up 360 days, 22:19,  1 user,  load average: 3.33, 3.25, 3.22
Mem:  32859644k total, 32381004k used,   478640k free,   414468k buffers
Swap:  1046520k total,   145500k used,   901020k free, 29132552k cached
Mem:  32859644k total, 32379724k used,   479920k free,   414468k buffers
  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
9012 root      20   0 73000 3532 2768 R 100.0  0.0  98168:36 /bin/rpm -qf --queryformat %{VERSION}\n /etc/redhat-release
17164 root      20   0 77232 4068 2828 R 100.0  0.0  99516:19 /bin/rpm -vvv --rebuilddb
24013 root      20   0 73000 3560 2804 R 99.4  0.0  59335:06 /bin/rpm -qf --queryformat %{VERSION}\n /etc/redhat-release
23437 root      20   0 54056  12m 1848 S 26.4  0.0   0:00.21 /usr/local/cpanel/scripts/restartsrv_dovecot
22836 root      20   0 15304 1520  988 R  2.5  0.0   0:00.45 top c
3165 mysql     20   0 3785m 514m 6432 S  1.3  1.6  11167:33 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --
23438 rtvonlin  20   0     0    0    0 Z  1.3  0.0   0:00.01 [php] <defunct>
23439 rtvonlin  20   0  112m 9344 5868 S  1.3  0.0   0:00.01 /usr/bin/php /home/rtvonline/public_html/ps/rid/rc.php
    1 root      20   0 19276  824  736 S  0.0  0.0   1:38.61 /sbin/init
    2 root      20   0     0    0    0 S  0.0  0.0   0:01.15 [kthreadd]
    3 root      20   0     0    0    0 S  0.0  0.0  23:53.82 [ksoftirqd/0]
    5 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kworker/0:0H]
    7 root      RT   0     0    0    0 S  0.0  0.0   1:12.57 [migration/0]
    8 root      20   0     0    0    0 S  0.0  0.0   0:00.00 [rcu_bh]
    9 root      20   0     0    0    0 S  0.0  0.0 209:36.21 [rcu_sched]
   10 root      RT   0     0    0    0 S  0.0  0.0   0:28.25 [migration/1]
   11 root      20   0     0    0    0 S  0.0  0.0 135:30.31 [ksoftirqd/1]
   13 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kworker/1:0H]
   14 root      RT   0     0    0    0 S  0.0  0.0   0:40.68 [migration/2]
   15 root      20   0     0    0    0 S  0.0  0.0  38:47.16 [ksoftirqd/2]
   17 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kworker/2:0H]
   18 root      RT   0     0    0    0 S  0.0  0.0   0:44.22 [migration/3]
   19 root      20   0     0    0    0 S  0.0  0.0 110:35.48 [ksoftirqd/3]
   21 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kworker/3:0H]
   22 root      RT   0     0    0    0 S  0.0  0.0   0:36.77 [migration/4]
   23 root      20   0     0    0    0 S  0.0  0.0  30:13.70 [ksoftirqd/4]
   25 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kworker/4:0H]
   26 root      RT   0     0    0    0 S  0.0  0.0   1:56.70 [migration/5]
   27 root      20   0     0    0    0 S  0.0  0.0 138:27.69 [ksoftirqd/5]
   29 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kworker/5:0H]
   30 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [khelper]
   31 root      20   0     0    0    0 S  0.0  0.0   0:00.00 [kdevtmpfs]
   32 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [netns]
  530 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [writeback]
  532 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kintegrityd]
  533 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [bioset]
  535 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kblockd]
  645 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [ata_sff]
  655 root      20   0     0    0    0 S  0.0  0.0   0:00.02 [khubd]
  665 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [md]
  668 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [edac-poller]
  773 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [rpciod]
  665 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [md]
  668 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [edac-poller]
  773 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [rpciod]
  775 root      20   0     0    0    0 S  0.0  0.0   4:22.08 [kworker/5:1]
  776 root     -51   0     0    0    0 S  0.0  0.0   0:00.00 [irq/72-AMD-Vi]
  777 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kvm-irqfd-clean]
  780 root      20   0 73000 3568 2816 S  0.0  0.0   0:00.00 /bin/rpm -qf --queryformat %{VERSION}\n /etc/redhat-release
  881 root      20   0     0    0    0 S  0.0  0.0   6:19.84 [kswapd0]
  882 root      25   5     0    0    0 S  0.0  0.0   0:00.00 [ksmd]
  951 root      20   0     0    0    0 S  0.0  0.0   0:00.00 [fsnotify_mark]
  975 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [nfsiod]
  982 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [cifsiod]
  998 root      20   0     0    0    0 S  0.0  0.0   0:00.00 [jfsIO]
----------------------------------------------------------------------------
# sar -p

12:00:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:10:01 AM     all     41.03      0.03     10.92      0.19      0.00     47.83
12:20:01 AM     all     45.49      0.01     29.18      0.06      0.00     25.26
12:30:01 AM     all     41.36      0.01     10.92      0.09      0.00     47.62
12:40:01 AM     all     41.03      0.01     10.76      0.08      0.00     48.13
12:50:01 AM     all     40.89      0.01     10.84      0.10      0.00     48.16
01:00:01 AM     all     40.84      0.01     10.86      0.07      0.00     48.22
01:10:01 AM     all     41.61      0.01     10.82      0.10      0.00     47.46
01:20:01 AM     all     41.45      0.01     12.05      0.09      0.00     46.40
01:30:01 AM     all     41.40      0.01     12.12      0.09      0.00     46.38
01:40:01 AM     all     41.02      0.01     10.75      0.09      0.00     48.14
01:50:01 AM     all     41.01      0.01     10.90      0.09      0.00     47.98
02:00:01 AM     all     41.65      0.01     10.94      0.09      0.00     47.32
02:10:01 AM     all     41.53      0.03     10.91      0.18      0.00     47.35
02:20:01 AM     all     40.97      0.01     10.94      0.09      0.00     48.00
02:30:01 AM     all     42.09      0.01     15.05      0.08      0.00     42.78
02:40:01 AM     all     40.98      0.01     10.75      0.09      0.00     48.17
02:50:01 AM     all     40.92      0.01     10.73      0.09      0.00     48.25
03:00:01 AM     all     40.97      0.01     10.76      0.09      0.00     48.17
03:10:01 AM     all     41.15      0.01     10.83      0.11      0.00     47.91
03:20:01 AM     all     41.52      0.01     10.83      0.08      0.00     47.56
03:30:01 AM     all     41.45      0.01     11.41      0.10      0.00     47.04
03:40:01 AM     all     41.05      0.03     10.97      0.16      0.00     47.79
03:50:01 AM     all     40.76      0.01     10.97      0.09      0.00     48.17
04:00:01 AM     all     41.73      0.01     10.98      0.09      0.00     47.19
04:10:01 AM     all     41.64      0.01     10.91      0.11      0.00     47.34
04:20:01 AM     all     40.85      0.03     10.84      0.18      0.00     48.10
04:30:01 AM     all     44.39      0.01     25.21      0.06      0.00     30.33
04:40:01 AM     all     41.78      0.01     11.02      0.09      0.00     47.10
04:50:01 AM     all     41.21      0.01     10.85      0.11      0.00     47.83
05:00:01 AM     all     41.23      0.01     10.76      0.11      0.00     47.89
05:10:01 AM     all     41.53      0.01     10.87      0.11      0.00     47.47
05:20:01 AM     all     41.51      0.01     10.96      0.11      0.00     47.41
05:30:01 AM     all     43.21      0.01     20.89      0.08      0.00     35.81
05:40:01 AM     all     41.60      0.01     10.86      0.11      0.00     47.43
05:50:01 AM     all     41.68      0.01     10.85      0.14      0.00     47.32
06:00:01 AM     all     41.95      0.01     10.86      0.12      0.00     47.06
06:10:01 AM     all     41.41      0.01     10.87      0.12      0.00     47.59
06:20:01 AM     all     40.85      0.03     10.73      0.20      0.00     48.19
06:30:01 AM     all     41.55      0.01     12.27      0.09      0.00     46.08
06:40:01 AM     all     41.47      0.01     11.45      0.10      0.00     46.97
06:50:01 AM     all     41.51      0.01     10.97      0.09      0.00     47.42
07:00:01 AM     all     41.34      0.01     10.85      0.09      0.00     47.72
07:10:01 AM     all     41.32      0.02     10.89      0.09      0.00     47.68
07:20:01 AM     all     41.34      1.30     10.92      0.10      0.00     46.34
07:30:01 AM     all     41.14      0.01     10.88      0.09      0.00     47.89
07:40:01 AM     all     42.71      0.01     18.34      0.07      0.00     38.87
07:50:01 AM     all     41.01      0.01     10.92      0.11      0.00     47.96
08:00:01 AM     all     41.16      0.01     10.76      0.08      0.00     47.99
08:10:01 AM     all     41.33      0.04     10.79      0.16      0.00     47.68
08:20:01 AM     all     40.98      0.01     10.81      0.08      0.00     48.12
08:30:01 AM     all     41.01      0.01     10.87      0.08      0.00     48.02
08:40:01 AM     all     43.51      0.01     18.67      0.07      0.00     37.75
08:50:01 AM     all     41.37      0.01     10.97      0.08      0.00     47.57
09:00:01 AM     all     41.13      0.01     10.88      0.10      0.00     47.88
09:10:01 AM     all     41.38      0.01     10.95      0.12      0.00     47.54
09:20:01 AM     all     41.55      0.01     10.80      0.09      0.00     47.56
09:30:01 AM     all     41.56      0.01     10.83      0.10      0.00     47.51
09:40:01 AM     all     41.61      0.01     11.43      0.11      0.00     46.84

09:40:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
09:50:01 AM     all     41.31      0.01     10.75      0.09      0.00     47.84
10:00:01 AM     all     41.30      0.01     10.76      0.10      0.00     47.83
10:10:01 AM     all     41.44      0.03     10.98      0.22      0.00     47.33
10:20:01 AM     all     41.82      0.01     10.85      0.17      0.00     47.16
10:30:01 AM     all     41.61      0.01     10.85      0.12      0.00     47.42
Average:        all     41.53      0.03     11.94      0.11      0.00     46.40


------------------------------------------------------------------------------


# free -m

             total       used       free     shared    buffers     cached
Mem:         32089      31581        508          0        404      28450
-/+ buffers/cache:       2726      29362
Swap:         1021        142        879


------------------------------------------------------------------------------
# top c        (after hit 'M')


top - 10:34:55 up 360 days, 22:24,  1 user,  load average: 3.07, 3.15, 3.19
Tasks: 304 total,   4 running, 294 sleeping,   0 stopped,   6 zombie
Cpu(s): 41.3%us, 11.0%sy,  0.0%ni, 47.6%id,  0.1%wa,  0.0%hi,  0.1%si,  0.0%st

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
9012 root      20   0 73000 3532 2768 R 99.9  0.0  98173:40 /bin/rpm -qf --queryformat %{VERSION}\n /etc/redhat-release
17164 root      20   0 77232 4068 2828 R 99.9  0.0  99521:23 /bin/rpm -vvv --rebuilddb
24013 root      20   0 73000 3560 2804 R 99.6  0.0  59340:10 /bin/rpm -qf --queryformat %{VERSION}\n /etc/redhat-release
3165 mysql     20   0 3785m 514m 6432 S  6.6  1.6  11167:38 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --
23675 nobody    20   0 77692 7764 1964 S  0.3  0.0   0:00.03 /usr/local/apache/bin/httpd -k start -DSSL
23914 nobody    20   0 77700 7772 1964 S  0.3  0.0   0:00.02 /usr/local/apache/bin/httpd -k start -DSSL
24004 root      20   0 15208 1488  988 R  0.3  0.0   0:00.11 top c
25002 cpanelco  20   0 13756 5860 4472 S  0.3  0.0  52:08.70 /usr/local/cpanel/3rdparty/sbin/p0f -i any -u cpanelconnecttrack -d -s /var/cpanel/userhomes/cpa
    1 root      20   0 19276  824  736 S  0.0  0.0   1:38.61 /sbin/init
    2 root      20   0     0    0    0 S  0.0  0.0   0:01.15 [kthreadd]
    3 root      20   0     0    0    0 S  0.0  0.0  23:53.82 [ksoftirqd/0]
    5 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kworker/0:0H]
    7 root      RT   0     0    0    0 S  0.0  0.0   1:12.57 [migration/0]
    8 root      20   0     0    0    0 S  0.0  0.0   0:00.00 [rcu_bh]
    9 root      20   0     0    0    0 S  0.0  0.0 209:36.24 [rcu_sched]
   10 root      RT   0     0    0    0 S  0.0  0.0   0:28.25 [migration/1]
   11 root      20   0     0    0    0 S  0.0  0.0 135:30.31 [ksoftirqd/1]
   13 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kworker/1:0H]
   14 root      RT   0     0    0    0 S  0.0  0.0   0:40.68 [migration/2]
   15 root      20   0     0    0    0 S  0.0  0.0  38:47.16 [ksoftirqd/2]
   17 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kworker/2:0H]
   18 root      RT   0     0    0    0 S  0.0  0.0   0:44.22 [migration/3]
   19 root      20   0     0    0    0 S  0.0  0.0 110:35.48 [ksoftirqd/3]
   21 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kworker/3:0H]
   22 root      RT   0     0    0    0 S  0.0  0.0   0:36.77 [migration/4]
   23 root      20   0     0    0    0 S  0.0  0.0  30:13.70 [ksoftirqd/4]
   25 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kworker/4:0H]
   26 root      RT   0     0    0    0 S  0.0  0.0   1:56.70 [migration/5]
   27 root      20   0     0    0    0 S  0.0  0.0 138:27.69 [ksoftirqd/5]
   29 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kworker/5:0H]
   30 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [khelper]
   31 root      20   0     0    0    0 S  0.0  0.0   0:00.00 [kdevtmpfs]
   32 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [netns]
  530 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [writeback]
  532 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kintegrityd]
  533 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [bioset]
  535 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kblockd]
  645 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [ata_sff]
  655 root      20   0     0    0    0 S  0.0  0.0   0:00.02 [khubd]
  665 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [md]
  668 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [edac-poller]
  773 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [rpciod]
  775 root      20   0     0    0    0 S  0.0  0.0   4:22.08 [kworker/5:1]
  776 root     -51   0     0    0    0 S  0.0  0.0   0:00.00 [irq/72-AMD-Vi]
  777 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [kvm-irqfd-clean]
  780 root      20   0 73000 3568 2816 S  0.0  0.0   0:00.00 /bin/rpm -qf --queryformat %{VERSION}\n /etc/redhat-release
  881 root      20   0     0    0    0 S  0.0  0.0   6:19.84 [kswapd0]
  882 root      25   5     0    0    0 S  0.0  0.0   0:00.00 [ksmd]
  951 root      20   0     0    0    0 S  0.0  0.0   0:00.00 [fsnotify_mark]
  975 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [nfsiod]
  982 root       0 -20     0    0    0 S  0.0  0.0   0:00.00 [cifsiod]
  998 root      20   0     0    0    0 S  0.0  0.0   0:00.00 [jfsIO]
  999 root      20   0     0    0    0 S  0.0  0.0   0:00.00 [jfsCommit]
1000 root      20   0     0    0    0 S  0.0  0.0   0:00.00 [jfsCommit]
1001 root      20   0     0    0    0 S  0.0  0.0   0:00.00 [jfsCommit]

---------------------------------------------------------------------------------------------
# iostat -x 1 10


avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           8.99    0.02    4.93    0.32    0.00   85.74

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               2.70    24.92   48.47    4.74  6556.47   268.78   128.28     0.02    0.37   0.91   4.86
sdb               2.79    24.92   48.12    4.74  6515.11   268.77   128.34     0.03    0.59   1.03   5.43
md3               0.00     0.00    0.14    0.25    26.22    33.72   156.01     0.00    0.00   0.00   0.00
md2               0.00     0.00    0.17   28.57    19.09   228.29     8.61     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          50.92    0.00   41.21    0.00    0.00    7.87

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.00     0.00    0.00    3.00     0.00    24.00     8.00     0.02    5.33   5.33   1.60
sdb               0.00     0.00    0.00    3.00     0.00    24.00     8.00     0.02    5.33   5.33   1.60
md3               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
md2               0.00     0.00    0.00    1.00     0.00     8.00     8.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          50.42    0.00   42.40    0.00    0.00    7.18

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.00    45.00    0.00    5.00     0.00   400.00    80.00     0.03    5.60   5.60   2.80
sdb               0.00    45.00    0.00    5.00     0.00   400.00    80.00     0.02    4.00   4.00   2.00
md3               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
md2               0.00     0.00    0.00   48.00     0.00   384.00     8.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          48.91    0.00   42.74    0.00    0.00    8.35

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.00     0.00    0.00    3.00     0.00    24.00     8.00     0.01    4.00   4.00   1.20
sdb               0.00     0.00    0.00    3.00     0.00    24.00     8.00     0.01    4.00   4.00   1.20
md3               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
md2               0.00     0.00    0.00    1.00     0.00     8.00     8.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          46.93    0.00   43.12    0.00    0.00    9.95

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.00     0.00    0.00    3.00     0.00    24.00     8.00     0.00    1.33   1.33   0.40
sdb               0.00     0.00    0.00    3.00     0.00    24.00     8.00     0.02    5.33   5.33   1.60
md3               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
md2               0.00     0.00    0.00    2.00     0.00    16.00     8.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          51.17    0.00   44.15    0.00    0.00    4.68

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.00     0.00    0.00   11.00     0.00    88.00     8.00     0.03    2.91   2.91   3.20
sdb               0.00     0.00    0.00   11.00     0.00    88.00     8.00     0.03    2.91   2.91   3.20
md3               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
md2               0.00     0.00    0.00    6.00     0.00    48.00     8.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          47.01    0.00   44.68    0.00    0.00    8.31

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.00     0.00    0.00    3.00     0.00    24.00     8.00     0.02    6.67   6.67   2.00
sdb               0.00     0.00    0.00    3.00     0.00    24.00     8.00     0.02    5.33   5.33   1.60
md3               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
md2               0.00     0.00    0.00    2.00     0.00    16.00     8.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          48.67    0.00   39.83    0.17    0.00   11.33

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.00    42.00    0.00   11.00     0.00   424.00    38.55     0.04    3.27   3.27   3.60
sdb               0.00    42.00    0.00   11.00     0.00   424.00    38.55     0.03    2.55   2.55   2.80
md3               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
md2               0.00     0.00    0.00   50.00     0.00   400.00     8.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          46.83    0.00   43.67    0.00    0.00    9.50

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.00     0.00    0.00    3.00     0.00    24.00     8.00     0.02    5.33   5.33   1.60
sdb               0.00     0.00    0.00    3.00     0.00    24.00     8.00     0.00    1.33   1.33   0.40
md3               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
md2               0.00     0.00    0.00    2.00     0.00    16.00     8.00     0.00    0.00   0.00   0.00

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          53.07    0.00   41.63    0.17    0.00    5.14

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.00    34.00    0.00    6.00     0.00   320.00    53.33     0.04    6.67   6.67   4.00
sdb               0.00    34.00    0.00    6.00     0.00   320.00    53.33     0.04    6.67   6.67   4.00
md3               0.00     0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
md2               0.00     0.00    0.00   37.00     0.00   296.00     8.00     0.00    0.00   0.00   0.00

cPanelMichael · Dec 2, 2015

Could you confirm if the issue still persists when forcing an update of cPanel via the "/scripts/upcp --force" command?

Thank you.

obak · Dec 3, 2015

@cPanelMichael I tried that command and see the result bellow:

Code:

# /scripts/upcp --force

cPanel Update (upcp) is already running. Please wait for the previous upcp (pid 20280) to complete, then try again. You can use the command 'ps --pid 20280' to check if the process is running. You may wish to use '--force'

cPanelMichael · Dec 3, 2015

You can use a command such as "ps auxf" to find upcp and it's subprocesses and manually kill them via:

Code:

kill -9 PID

Then, try forcing an update of cPanel again after the processes have terminated.

Thank you.

obak · Dec 5, 2015

@cPanelMichael , I have run the following command and found these lines.

Code:

# ps aux | grep upcp
root      1753  0.0  0.0  57252 12684 ?        Ss   03:03   0:00 cPanel Update (upcp) - Slave
root      1775  0.0  0.0  53768  9940 ?        S    03:03   0:00 /usr/local/cpanel/3rdparty/bin/perl /usr/local/cpanel/whostmgr/docroot/cgi/tail_upcp2.cgi
root     15605  0.0  0.0  57216 13612 ?        Ss   Oct15   4:23 cPanel Update (upcp) - Master
root     15703  0.0  0.0  57216 12696 ?        Ss   Oct15   0:00 cPanel Update (upcp) - Slave
root     21778  0.0  0.0  39628  5620 ?        Ss   Sep24   0:00 cPanel Update (upcp) - Slave
root     24167  0.0  0.0 103288   828 pts/0    S+   03:36   0:00 grep upcp
root     29044  0.0  0.0  57216 13616 ?        Ss   Nov05   2:14 cPanel Update (upcp) - Master
root     29153  0.0  0.0  57216 12700 ?        Ss   Nov05   0:00 cPanel Update (upcp) - Slave

Is the second column (after 'root' text) PID?
Now which PID I have to kill?

Thank you

cPanelMichael · Dec 7, 2015

You can kill all of those processes, except for the "grep upcp" process because that's simply the command you are using to search the active processes.

Thank you.

obak · Dec 9, 2015

@cPanelMichael , I killed all of these process. After that I run the "Upgrade to Latest Version" from WHM web control panel again. But the problem is same, it hang-up after 2%. What can I do now?

Here are the logs of process ("Upgrade to Latest Version") that hang-up after 2%:

Code:

----------------------------------------------------------------------------------------------------
=> Log opened from cPanel Update (upcp) - Slave (30778) at Wed Dec  9 08:05:28 2015
[2015-12-09 08:05:28 -0500]   Detected cron=0 (env var CPANEL_IS_CRON was present before this process started.)
[2015-12-09 08:05:28 -0500]   Running Standardized hooks
[2015-12-09 08:05:28 -0500]   mtime on upcp is 1438410028 (Sat Aug  1 02:20:28 2015)
----------------------------------------------------------------------------------------------------
=> Log opened from /usr/local/cpanel/scripts/updatenow (30780) at Wed Dec  9 08:05:29 2015
[2015-12-09 08:05:29 -0500]   Retrieved public key from vendor: cpanel, category: release, url: https://securedownloads.cpanel.net/cPanelPublicKey.asc
[2015-12-09 08:05:30 -0500]   Retrieved public key from vendor: cpanel, category: development, url: https://securedownloads.cpanel.net/cPanelDevelopmentKey.asc
[2015-12-09 08:05:30 -0500]   Retrieved public key from vendor: cpanel, category: development-sts, url: https://securedownloads.cpanel.net/STSTestKey.asc
[2015-12-09 08:05:30 -0500]   Detected version '11.50.0.30' from version file.
[2015-12-09 08:05:30 -0500]   Running version '11.50.0.30' of updatenow.
[2015-12-09 08:05:30 -0500]   --force passed on command line. Upgrade will disregard update config settings.
[2015-12-09 08:05:30 -0500]   Using mirror '52.2.150.118' for host 'httpupdate.cpanel.net'.
[2015-12-09 08:05:30 -0500]   Successfully verified signature for cpanel (key types: release).
[2015-12-09 08:05:30 -0500]   Target version set to '11.52.1.3'
[2015-12-09 08:05:30 -0500]   Target version set to '11.50.3.1'
[2015-12-09 08:05:30 -0500]   Need to upgrade to the LTS version before switching to another major version
[2015-12-09 08:05:30 -0500]   Switching to 11.50.3.1 to determine if we can reach that version without failure.

Note that, on the above log, there is a line "Need to upgrade to the LTS version before switching to another major version". Is this the problem? If yes, what is it and how to update it?

Thanks

cPanelMichael · Dec 9, 2015

That's not an issue, it's just a notification that it's changing build tiers before proceeding. Could you open a support ticket using the link in my signature so we can take a closer look? You can post the ticket number here so we can update this thread with the outcome.

Thank you.

obak · Dec 10, 2015

Here is the ticket id: 7405245 and 7405249

cPanelMichael · Dec 10, 2015

To update, the issue occurred due to a corrupted RPM database. cPanel updates now complete well after repairing the RPM database:

Code:

mkdir /root/old_rpm_dbs/
mv /var/lib/rpm/__db* /root/old_rpm_dbs/
rpm --rebuilddb

Thank you.

Thread starter	Similar threads	Forum	Replies	Date
	New: cPanel & WHM update failure in upcp script	Installation & Updates	2	Jan 18, 2023
P	cPanel & WHM update failure in upcp script	Installation & Updates	7	Nov 16, 2022
C	cPanel & WHM update failure in upcp script	Installation & Updates	7	Nov 8, 2022
R	cPanel & WHM update failure in upcp script	Installation & Updates	16	Oct 15, 2022
H	My cpanel & WHM update blockers How i can fix it	Installation & Updates	1	Oct 15, 2022

Search

Search

cPanel & WHM update process is non-responsive and terminated

obak

Member

Attachments

24x7server

Well-Known Member

obak

Member

24x7server

Well-Known Member

cPanelMichael

Administrator

obak

Member

cPanelMichael

Administrator

obak

Member

cPanelMichael

Administrator

obak

Member

cPanelMichael

Administrator

obak

Member

cPanelMichael

Administrator

obak

Member

cPanelMichael

Administrator