Load spikes during rpm -qa kernelcare

Feb 22, 2017
7
2
3
Colombia
cPanel Access Level
Reseller Owner
Hi Guys,

Does anybody knows what the following command does, and why it may be causing load spikes?:

Code:
rpm -qa --queryformat~{RELEASE}\n kernelcare
The server does not have a kernelcare license by the way.

Thanks!
 

cPanelLauren

Product Owner
Staff member
Nov 14, 2017
13,298
1,279
313
Houston
Hello @Camilo Herrera


Where did you copy this from? This is just querying for the kernelcare rpm on the system - if you don't have kernelcare (or even kernelcare symlink protection) it shouldn't be running. What is the output of the following:

Code:
rpm -qa kernelcare
kernelcare-2.16-1.x86_64
 
Feb 22, 2017
7
2
3
Colombia
cPanel Access Level
Reseller Owner
Hello @Camilo Herrera


Where did you copy this from? This is just querying for the kernelcare rpm on the system - if you don't have kernelcare (or even kernelcare symlink protection) it shouldn't be running. What is the output of the following:

Code:
rpm -qa kernelcare
kernelcare-2.16-1.x86_64
Hello Lauren,

The output is empty. During the load spike we ran
Code:
iotop -oa
and it was there at 99% on the IO colum, we have seen this behavior somewhat common after cPanel updates.
 

cPanelLauren

Product Owner
Staff member
Nov 14, 2017
13,298
1,279
313
Houston
Hi @Camilo Herrera


That's IOwait you're looking at - the amount of time a read/write takes on the disk if there's a lot of activity it's going to take a bit longer. Some IO wait is normal during an update or resource intensive activities. If you're not running KernelCare though it seems that at some point the system is looking for it most likely to determine its installation status. I'm curious now what your IO wait is all the time, are you on a VPS or a hardware server?

What's the output of the following:

Code:
sar -p
 
Feb 22, 2017
7
2
3
Colombia
cPanel Access Level
Reseller Owner
Hi @Camilo Herrera


That's IOwait you're looking at - the amount of time a read/write takes on the disk if there's a lot of activity it's going to take a bit longer. Some IO wait is normal during an update or resource intensive activities. If you're not running KernelCare though it seems that at some point the system is looking for it most likely to determine its installation status. I'm curious now what your IO wait is all the time, are you on a VPS or a hardware server?

What's the output of the following:

Code:
sar -p
It is a hardware server, this is the command output:

Code:
Linux 3.10.0-329.7.2.lve1.4.2.el7.x86_64 (xxx)  03/01/2019      _x86_64_        (8 CPU)

12:00:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
12:10:01 AM     all     10.41      0.11      1.38      3.04      0.00     85.06
12:20:01 AM     all      4.43      0.10      0.74      1.76      0.00     92.97
12:30:01 AM     all      9.00      0.11      1.18      8.23      0.00     81.48
12:40:01 AM     all      7.62      0.12      1.16      5.80      0.00     85.31
12:50:01 AM     all      7.54      0.10      1.06      2.32      0.00     88.98
01:00:01 AM     all      8.40      0.12      1.04      1.94      0.00     88.50
01:10:01 AM     all      7.23      0.43      1.45     11.10      0.00     79.79
01:20:01 AM     all      9.18      0.45      1.87     14.63      0.00     73.86
01:30:02 AM     all     11.52      0.38      2.26     20.74      0.00     65.11
01:40:01 AM     all      7.28      0.37      2.00     16.75      0.00     73.60
01:50:02 AM     all     10.63      0.38      2.14     22.88      0.00     63.96
02:00:02 AM     all      8.57      0.40      1.80     16.24      0.00     73.00
02:10:03 AM     all      7.47      0.51      2.26     15.31      0.00     74.45
02:20:01 AM     all      8.28      0.38      1.82     17.46      0.00     72.05
02:30:02 AM     all     10.17      0.48      1.68     15.34      0.00     72.34
02:40:02 AM     all      8.64      0.41      1.77     19.11      0.00     70.08
02:50:02 AM     all     13.01      0.44      2.36     14.90      0.00     69.29
03:00:02 AM     all     14.96      0.45      2.34     16.99      0.00     65.26
03:10:01 AM     all      7.28      0.47      1.94     13.54      0.00     76.77
03:20:01 AM     all      3.93      0.49      1.42     15.52      0.00     78.64
03:30:02 AM     all      7.26      0.37      1.75     20.61      0.00     70.01
03:40:01 AM     all     10.99      0.16      1.48     12.66      0.00     74.72
03:50:01 AM     all      4.68      0.10      0.77      3.84      0.00     90.61
04:00:01 AM     all      7.03      0.16      1.04      5.66      0.00     86.11
04:10:01 AM     all      5.43      0.10      0.87      3.79      0.00     89.81
04:20:01 AM     all      4.89      0.11      0.82      2.30      0.00     91.87
04:30:01 AM     all      6.21      0.11      0.93      2.90      0.00     89.85
04:40:01 AM     all     17.03      0.10      1.15      4.64      0.00     77.08
04:50:01 AM     all      7.05      0.10      0.90      1.87      0.00     90.08
05:00:01 AM     all      7.32      0.10      1.00      1.91      0.00     89.68

05:00:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
05:10:01 AM     all      6.76      0.11      1.41     33.30      0.00     58.42
05:20:01 AM     all      5.30      0.10      1.42     19.13      0.00     74.04
05:30:01 AM     all      9.00      0.10      1.71     17.17      0.00     72.01
05:40:01 AM     all      5.89      0.12      0.85      4.45      0.00     88.69
05:50:02 AM     all      3.97      0.10      0.74      1.75      0.00     93.44
06:00:02 AM     all      4.02      0.12      0.82      2.97      0.00     92.08
06:10:01 AM     all      5.72      0.13      0.93      4.20      0.00     89.03
06:20:02 AM     all      6.77      0.14      1.06      4.98      0.00     87.05
06:30:01 AM     all      8.46      0.10      1.33      2.39      0.00     87.72
06:40:01 AM     all     10.79      0.11      1.52      3.59      0.00     83.99
06:50:01 AM     all     12.62      0.10      1.85      2.20      0.00     83.23
07:00:01 AM     all      9.45      0.10      1.33      2.89      0.00     86.23
07:10:01 AM     all      7.81      0.10      1.18      4.24      0.00     86.68
07:20:01 AM     all      8.00      1.79      1.68      7.36      0.00     81.17
07:30:01 AM     all     14.63      1.74      2.24     10.34      0.00     71.05
07:40:01 AM     all      7.87      0.78      1.37      9.40      0.00     80.58
07:50:01 AM     all     14.20      0.13      2.05      5.00      0.00     78.63
08:00:01 AM     all     11.40      0.11      1.63      4.59      0.00     82.27
08:10:01 AM     all      9.92      0.10      1.51      6.57      0.00     81.90
08:20:01 AM     all      8.49      0.10      1.28      4.16      0.00     85.97
08:30:01 AM     all      7.60      0.10      1.25      5.36      0.00     85.69
08:40:01 AM     all      8.44      0.10      1.48      7.62      0.00     82.35
08:50:01 AM     all      8.02      0.10      1.41      7.88      0.00     82.59
09:00:01 AM     all      6.77      0.11      1.31      6.49      0.00     85.33
09:10:01 AM     all      5.86      0.10      1.21      5.66      0.00     87.17
09:20:01 AM     all      8.79      0.11      1.53      6.79      0.00     82.79
09:30:01 AM     all     12.40      0.11      1.89      9.29      0.00     76.30
09:40:01 AM     all     11.63      0.11      1.75      8.60      0.00     77.91
09:50:02 AM     all     13.58      0.12      2.04      7.05      0.00     77.21
10:00:01 AM     all     12.13      0.11      1.93      6.72      0.00     79.11

10:00:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
10:10:01 AM     all     10.50      0.10      1.71      6.48      0.00     81.21
10:20:01 AM     all     15.76      0.11      2.24      7.07      0.00     74.82
10:30:01 AM     all     18.27      0.11      2.35     12.58      0.00     66.68
10:40:01 AM     all     11.22      0.11      1.82     10.41      0.00     76.44
10:50:01 AM     all     14.69      0.11      2.20      8.83      0.00     74.17
11:00:01 AM     all     11.66      0.11      2.01      7.89      0.00     78.33
11:10:01 AM     all      8.31      0.11      1.52      7.08      0.00     82.98
11:20:01 AM     all      9.19      0.11      1.69      7.62      0.00     81.39
11:30:02 AM     all      9.62      0.11      1.69      8.35      0.00     80.23
11:40:02 AM     all     13.86      0.10      2.13     12.56      0.00     71.35
11:50:01 AM     all     10.30      0.11      1.88      8.49      0.00     79.22
Average:        all      9.20      0.23      1.54      8.92      0.00     80.11
Maybe it is something else causing the load and the high iowait, guess we are going to need some further investigation.
 

cPanelLauren

Product Owner
Staff member
Nov 14, 2017
13,298
1,279
313
Houston
Hi @Camilo Herrera

Maybe it is something else causing the load and the high iowait, guess we are going to need some further investigation.
After seeing that I do agree, that's some pretty high IO wait on the server during those time frames.