CentOS -> AlmaLinux 8 Issue

Innosonian · Apr 17, 2023

Hi,

Attempted to upgrade to AlmaLinux 8 as instructed by WHM when I signed in today. Went through the process with no issues until I got to the reboot stage. Did that and now my server seems to have closed down.

I use AWS, so I've restarted the instance to see if that will push things along, but nothing. I cannot access WHM and I don't seem to be able to SSH into it either.

This is the last part of the system logs for the instance:

----

[[0;32m OK [0m] Started memcached daemon.
[[0;32m OK [0m] Started GSSAPI Proxy Daemon.
[[0;32m OK [0m] Reached target NFS client services.
[[0;32m OK [0m] Reached target Remote File Systems (Pre).
[[0;32m OK [0m] Reached target Remote File Systems.
[[0;32m OK [0m] Started Dynamic System Tuning Daemon.
[ 12.685182] cloud-init[1197]: Cloud-init v. 22.1-6.el8_7.2.alma running 'init' at Mon, 17 Apr 2023 14:20:43 +0000. Up 12.38 seconds.
[ 12.698843] cloud-init[1197]: ci-info: +++++++++++++++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++++++++++++++
[ 12.718237] cloud-init[1197]: ci-info: +--------+------+------------------------------+---------------+--------+-------------------+
[ 12.727786] cloud-init[1197]: ci-info: | Device | Up | Address | Mask | Scope | Hw-Address |
[ 12.740113] cloud-init[1197]: ci-info: +--------+------+------------------------------+---------------+--------+-------------------+
[ 12.750531] cloud-init[1197]: ci-info: | eth0 | True | 10.0.3.37 | 255.255.240.0 | global | 12:55:2c:64:76:eb |
[ 12.761912] cloud-init[1197]: ci-info: | eth0 | True | fe80::1055:2cff:fe64:76eb/64 | . | link | 12:55:2c:64:76:eb |
[ 12.771550] cloud-init[1197]: ci-info: | lo | True | 127.0.0.1 | 255.0.0.0 | host | . |
[ 12.779673] cloud-init[1197]: ci-info: | lo | True | ::1/128 | . | host | . |
[ 12.788089] cloud-init[1197]: ci-info: +--------+------+------------------------------+---------------+--------+-------------------+
[ 12.796512] cloud-init[1197]: ci-info: +++++++++++++++++++++++++++Route IPv4 info++++++++++++++++++++++++++++
[ 12.803863] cloud-init[1197]: ci-info: +-------+-------------+----------+---------------+-----------+-------+
[ 12.813760] cloud-init[1197]: ci-info: | Route | Destination | Gateway | Genmask | Interface | Flags |
[ 12.824910] cloud-init[1197]: ci-info: +-------+-------------+----------+---------------+-----------+-------+
[ 12.836346] cloud-init[1197]: ci-info: | 0 | 0.0.0.0 | 10.0.0.1 | 0.0.0.0 | eth0 | UG |
[ 12.847567] cloud-init[1197]: ci-info: | 1 | 10.0.0.0 | 0.0.0.0 | 255.255.240.0 | eth0 | U |
[ 12.858661] cloud-init[1197]: ci-info: +-------+-------------+----------+---------------+-----------+-------+
[ 12.868250] cloud-init[1197]: ci-info: +++++++++++++++++++Route IPv6 info+++++++++++++++++++
[ 12.874838] cloud-init[1197]: ci-info: +-------+-------------+---------+-----------+-------+
[ 12.884567] cloud-init[1197]: ci-info: | Route | Destination | Gateway | Interface | Flags |
[ 12.894282] cloud-init[1197]: ci-info: +-------+-------------+---------+-----------+-------+
[ 12.902525] cloud-init[1197]: ci-info: | 10 | fe80::/64 | :: | eth0 | U |
[ 12.911290] cloud-init[1197]: ci-info: | 12 | local | :: | eth0 | U |
[ 12.919387] cloud-init[1197]: ci-info: | 13 | multicast | :: | eth0 | U |
[ 12.929408] cloud-init[1197]: ci-info: +-------+-------------+---------+-----------+-------+
[[0;32m OK [0m] Started Initial cloud-init job (metadata service crawler).
Starting Permit User Sessions...
Starting OpenSSH server daemon...
[[0;32m OK [0m] Reached target Network is Online.
Starting System Logging Service...
Starting p0f passive fingerprinter...
Starting cPanel IP aliases service...
Starting Fastmail Services...
Starting cPanel services...
Starting SMTP Tweak...
Starting cPanel fix quotas on boot...
Starting Crash recovery kernel arming...
Starting Notify NFS peers of a restart...
Starting cPanel IPv6 service...
[[0;32m OK [0m] Reached target Cloud-config availability.
Starting Apply the settings specified in cloud-config...
[[0;32m OK [0m] Started OpenSSH server daemon.
[[0;32m OK [0m] Started System Logging Service.
[[0;32m OK [0m] Started Permit User Sessions.
[[0;32m OK [0m] Started Notify NFS peers of a restart.
[[0;32m OK [0m] Started Serial Getty on ttyS0.
[[0;32m OK [0m] Started Job spooling tools.
[[0;32m OK [0m] Started Command Scheduler.
[[0;32m OK [0m] Started Getty on tty1.
[[0;32m OK [0m] Reached target Login Prompts.
[[0;32m OK [0m] Started p0f passive fingerprinter.
[[0;32m OK [0m] Started cPanel IP aliases service.
[[0;32m OK [0m] Created slice User Slice of UID 0.
Starting User runtime directory /run/user/0...
[[0;32m OK [0m] Started User runtime directory /run/user/0.
Starting User Manager for UID 0...
[[0;32m OK [0m] Started Fastmail Services.
[[ 13.986438] cloud-init[1480]: Cloud-init v. 22.1-6.el8_7.2.alma running 'modules:config' at Mon, 17 Apr 2023 14:20:44 +0000. Up 13.83 seconds.
[0;32m OK [0m] Started cPanel services.
Starting cPanel Greylisting Daemon...
Starting cPanel dav services...
Starting tailwatchd...
Starting FPM service for cPanel Daemons...
Starting cPanel brute force detector services...
Starting cPanel Log services...
Starting cPanel DNS admin service...
[[0;32m OK [0m] Started User Manager for UID 0.
[[0;32m OK [0m] Started Session 1 of user root.
[[0;32m OK [0m] Started Apply the settings specified in cloud-config.
Starting Execute cloud user/final scripts...
[[0;32m OK [0m] Started cPanel Log services.
[[0;32m OK [0m] Started cPanel IPv6 service.
[[0;1;31mFAILED[0m] Failed to start cPanel Greylisting Daemon.
See 'systemctl status cpgreylistd.service' for details.
[[0;32m OK [0m] Started cPanel brute force detector services.
[[0;32m OK [0m] Started cPanel DNS admin service.
[[0;32m OK [0m] Started cPanel dav services.
[ 15.207193] cloud-init[1636]: Cloud-init v. 22.1-6.el8_7.2.alma running 'modules:final' at Mon, 17 Apr 2023 14:20:46 +0000. Up 15.00 seconds.
[ 15.229568] cloud-init[1636]: Cloud-init v. 22.1-6.el8_7.2.alma finished at Mon, 17 Apr 2023 14:20:46 +0000. Datasource DataSourceEc2Local. Up 15.19 seconds
[[0;32m OK [0m] Started Execute cloud user/final scripts.
[[0;32m OK [0m] Started SMTP Tweak.
[[0;1;31mFAILED[0m] Failed to start FPM service for cPanel Daemons.
See 'systemctl status cpanel_php_fpm.service' for details.
[[0;32m OK [0m] Started tailwatchd.
[[0;32m OK [0m] Started cPanel fix quotas on boot.
[[0;32m OK [0m] Reached target Multi-User System.
[[0;32m OK [0m] Reached target Cloud-init target.
Starting Update UTMP about System Runlevel Changes...
[[0;32m OK [0m] Started Update UTMP about System Runlevel Changes.
[[0;32m OK [0m] Started Crash recovery kernel arming.

AlmaLinux 8.7 (Stone Smilodon)
Kernel 4.18.0-425.19.2.el8_7.x86_64 on an x86_64

server login:

----

Any idea on what I'm supposed to do next or fix it?

cPRex · Apr 17, 2023

Hey there! There will be multiple reboots during the update process, with some of them taking a long time - up to 30 minutes or more. It's possible that you're just in one of those reboot periods.

If you have a console provided by your host you could watch the server status there, but if it's still not reachable after 30-45 minutes, you'll want to contact your host to have them investigate the system.

Innosonian · Apr 17, 2023

I manage the the AWS Instances, so it would be myself.

I think I started running it about 12, so nearly 4 hours ago now.

cPRex · Apr 17, 2023

That does seem too long for sure. I'd check the console if you can access that, and if not, you'll need to reach out to their support to have them check the machine.

Innosonian · Apr 17, 2023

Unfortunately AWS aren't that forth coming.

Does the log file make sense? It's just ended with 'server login' as if waiting for something?

cPRex · Apr 17, 2023

No, I haven't seen exactly that output before.

Are you able to access the system over SSH at this time? If so, it would be best to submit a ticket to our support team so we can review that update.

Innosonian · Apr 17, 2023

No I can't access SSH at the moment. And I can't generate a support ticket with cPanel because it required support id, which is generated via WHM! So I'm a little stuck!

cPRex · Apr 17, 2023

If there's no SSH access you'll have to reach out to the host as there isn't anything we could do on our side.

You can always email [email protected] to start a ticket without having your ID ready.

Innosonian · Apr 17, 2023

So good news, I can now access the SSH.

Not really sure where I am to go from here!

cPRex · Apr 17, 2023

Hey that's progress! If SSH works, you can submit that ticket and we can take a look.

Innosonian · Apr 17, 2023

Done and done

cPRex · Apr 17, 2023

Great - once you have the ticket number, please share it here so I can follow along.

Innosonian · Apr 17, 2023

Ticket Number: 95045506

cPRex · Apr 17, 2023

Thanks for that - I'm following along now, and I've given it some priority since the system isn't responding properly.

Innosonian · Apr 17, 2023

Not sure if this helps narrow things down, but when I try and do anything on SSH, I get this:

---

Traceback (most recent call last):
File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 14, in swig_import_helper
return importlib.import_module(mname)
File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 994, in _gcd_import
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 658, in _load_unlocked
File "<frozen importlib._bootstrap>", line 571, in module_from_spec
File "<frozen importlib._bootstrap_external>", line 922, in create_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
ImportError: libbrotlidec.so.1: cannot open shared object file: No such file or directory

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/bin/dnf", line 57, in <module>
from dnf.cli import main
File "/usr/lib/python3.6/site-packages/dnf/__init__.py", line 30, in <module>
import dnf.base
File "/usr/lib/python3.6/site-packages/dnf/base.py", line 29, in <module>
import libdnf.transaction
File "/usr/lib64/python3.6/site-packages/libdnf/__init__.py", line 8, in <module>
from . import error
File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 17, in <module>
_error = swig_import_helper()
File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 16, in swig_import_helper
return importlib.import_module('_error')
File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
ModuleNotFoundError: No module named '_error'

---

Any ideas?

cPRex · Apr 17, 2023

Thanks for that - it doesn't look good, but I've added it to the ticket so our team can see that.

cPRex · Apr 17, 2023

Our team was able to find an issue with the ImageMagick installer that was keeping the update from completing. After enabling the EPEL repository to get that installed, things are working well and the update was able to complete.

Code:

yum -y install ImageMagick ImageMagick-libs

Innosonian · Apr 17, 2023

Many thanks - I can now see the WHM.

With all the issues of restarting, it's knocked out my subscription " To access the interface, you must install the license and ensure that the license is active. " - so I'm waiting for the Customer Services team to refresh or re-establish this.

cPRex · Apr 17, 2023

Yup - it looks like Mae in our CS team is taking care of that now!

ErnestoHD · May 26, 2023

Hello:

I´m getting the same error that @Innosonian mentioned:

=====================
Traceback (most recent call last):
File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 14, in swig_import_helper
return importlib.import_module(mname)
File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 994, in _gcd_import
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 658, in _load_unlocked
File "<frozen importlib._bootstrap>", line 571, in module_from_spec
File "<frozen importlib._bootstrap_external>", line 922, in create_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed

ImportError: libbrotlidec.so.1: cannot open shared object file: No such file or directory
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/bin/yum", line 57, in <module>
from dnf.cli import main
File "/usr/lib/python3.6/site-packages/dnf/__init__.py", line 30, in <module>
import dnf.base
File "/usr/lib/python3.6/site-packages/dnf/base.py", line 29, in <module>
import libdnf.transaction
File "/usr/lib64/python3.6/site-packages/libdnf/__init__.py", line 8, in <module>
from . import error
File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 17, in <module>
_error = swig_import_helper()
File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 16, in swig_import_helper
return importlib.import_module('_error')
File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
ModuleNotFoundError: No module named '_error'
=====================

I've tried to enable the EPEL repository, but I got the same error:

=====================
[email protected] [~]# dnf install epel-release
Traceback (most recent call last):
File "/usr/lib64/python3.6/site-packages/libdnf/error.py", line 14, in swig_import_helper
return importlib.import_module(mname)
File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 994, in _gcd_import
.
.
.
=====================

Any suggest @cPRex, I really appreciate your support.

Thank you.

Thread starter	Similar threads	Forum	Replies	Date
O	Has anyone successfully migrated from CentOS v7.9 to AlmaLinux 8 using cPanel ELevate Project?	Operating Systems	11	Apr 4, 2023
I	cPanel and hosted websites not working after CentOS 7.8 upgrade to AlmaLinux 8	Operating Systems	4	Mar 12, 2023
F	centos7 to Almalinux issue	Operating Systems	3	Mar 10, 2023
K	The Best Way to upgrade to AlmaLinux 8 From Centos7	Operating Systems	11	Mar 9, 2023
I	Status of Elevate cPanel wrapper script for production environments CentOS 7 -> Almalinux 8	Operating Systems	1	Nov 24, 2022

CentOS -> AlmaLinux 8 Issue

Member

Jurassic Moderator

Member

Jurassic Moderator

Member

Jurassic Moderator

Member

Jurassic Moderator

Member

Jurassic Moderator

Member

Jurassic Moderator

Member

Jurassic Moderator

Member

Jurassic Moderator

Jurassic Moderator

Member

Jurassic Moderator

Member