Upgrade of Maria from 10.3 to 10.5 wipes WP passwords

[Raymond Hayes]

After completing an upgrade of MariaDB from 10.3 to 10.5 after the latest Cpanel upgrade, all database users passwords were wiped. These are specifically WordPress websites, and all sites went down with "error establishing database connection".

Luckily we did it on a smaller server, but there were close to 35 databases that I was required to go to each WordPress site, check wp-config and update the passwords...one by one.

Before we proceed to larger servers, we need to be able to understand why this happened....doing 300 to 500 databases would be an utter failure.

In looking at the upgrade log, there is nothing that seems out of the ordinary. And usually when we setup new VPSs, we upgrade from Mysql to maria10.3 with zero issues. Seems to be a maria to maria upgrade in place that is a problem.

I am willing to hear ideas of how we can preserve the passwords. As right now, we have quite a few servers that need updates...but, not with this kind of disaster.

Thanks for any help...

 

[cPRex]

Hey there! I haven't heard of any similar reports on this, because as you said, this would be a complete disaster.

Could you submit a ticket to our team so we can investigate what may have happened on your system? If you're able to do that, please post the number here so I can follow along and keep this thread updated.

 

[kingsburyweb]

After completing an upgrade of MariaDB from 10.3 to 10.5 after the latest Cpanel upgrade, all database users passwords were wiped. These are specifically WordPress websites, and all sites went down with "error establishing database connection".

Luckily we did it on a smaller server, but there were close to 35 databases that I was required to go to each WordPress site, check wp-config and update the passwords...one by one.

Before we proceed to larger servers, we need to be able to understand why this happened....doing 300 to 500 databases would be an utter failure.

In looking at the upgrade log, there is nothing that seems out of the ordinary. And usually when we setup new VPSs, we upgrade from Mysql to maria10.3 with zero issues. Seems to be a maria to maria upgrade in place that is a problem.

I am willing to hear ideas of how we can preserve the passwords. As right now, we have quite a few servers that need updates...but, not with this kind of disaster.

Thanks for any help...

Hi Raymond,

We have a bunch of WHM/cPanel Servers and late last night I updated them all to v98.0.4. I noticed MariaDB upgrade to 10.5 was available, but it wasn't marked as "recommended" by cPanel. Anyhow, I upgraded our staging server MariaDB to 10.5 and I encountered the same exact problem as you did.
Error: Can't select database
Error Details: We were able to connect to the database server (which means your username and password is okay) but not able to select the ***** database.
We only have around 5 Wordpress powered websites on this particular staging server, and each and every one had that error. I turned to these forums and saw your solution, which did correct my issue (resetting each DB password).

Long story short, Raymond is right in that the DB Passwords have to be set again if you use the MariaDB Upgrade tool to 10.5. Considering how many people use WHM/cPanel, I'm going to feel bad for anyone that upgrades to 10.5 as they will likely encounter this issue.

Glad I found this post, thank you!!

 

[cPRex]

Let me doing some additional testing with this and I'll update this thread soon.

 

[cPRex]

I'm having trouble reproducing this on my end - could you submit a ticket to our team so we can examine your system and do some more direct testing?

 

[cPRex]

I did some more testing and was able to create case CPANEL-38157 with our developers. We'll be giving this one some priority for sure, and I'll post again once I have some updates.

 

[cPRex]

Update - we have reported the bug directly to MariaDB, and you can follow that here: [MDEV-26363] Passwords incorrectly expiring after MySQL5.7 -> MariaDB10.3 -> 10.4+ upgrades. - Jira

Our team is still also working on this on our side.

 

[kingsburyweb]

I did some more testing and was able to create case CPANEL-38157 with our developers. We'll be giving this one some priority for sure, and I'll post again once I have some updates.

Thank you. Wonder if a new release should go out to temporarily hide the upgrade to 10.5 to avoid panic?

 

[cPRex]

Update - MariaDB doesn't plan to have a fix until the end of October, so we're doing something on our end to resolve this.

@kingsburyweb - if there is good news, 98 is in a slow rollout plan, so even if you have that version set to happen automatically, you may not get it, so there are a limited number of users affected at this point. We're planning to have our fix out within the next week so a vast majority of users will never even know this happened.

 

[cPRex]

We have released an autofixer that will run as part of the next update and will resolve the issue on all v98 machines.

 

[cPRex]

Update - the autofixer is going out today!

 

[Raymond Hayes]

Thank you. I have not done any new updates yet to Maria...but, I have a server I can test this on. Is the fix in the Cpanel update or in the Maria update? Basically, what version of Cpanel / WHM should I be on to verify this is fixed.

 

[cPRex]

The fix is part of the cPanel v98 updates. It's an autofixer, so it's not tied to one specific version.