SOLVED [UPS-184] OPCache issue after recent EA4 update

[vacancy]

Can you test apache mod_event and litespeed?

 

[cPanelLauren]

Well, I was about to test with event and CentOS6 on another server which I'm configuring now, @kdean noted he's not running litespeed so I think it might rule that out.

I can switch to event on this server to test with CentOS 7 but because it's a live server (my personal server) I need to change a couple of things, I'll update here with my findings in a few moments.

 

[cPanelLauren]

So with MPM_Event, PHP 7.3.9, Opcache and CGI (on both servers below)



But that 1 isn't changing - in fact nothing is being cached like it was previously.

Exactly the same behavior on the CentOS 6 test environment as well:



One thing that should be noted is the documentation here: PHP Options - EasyApache 4 - cPanel Documentation

We do state that opcache isn't compatible with CGI so I went to switch to DSO and I was reminded that DSO and Event are incompatible.

The rest of the warnings:

Warnings:

• EasyApache 4 does not currently support any opcode cacher other than OPCache.
• Opcode caching programs are not compatible with the suPHP or CGI PHP handlers. The caching program either does not function, or functions incorrectly.
• The system does not automatically configure OPCache. If you do not manually configure OPCache after you install it, it will provide no benefits.
• We strongly recommend the DSO PHP handler for the OPCache opcode cacher.
• Do not install multiple PHP caching programs on the same system. Multiple opcode caching programs consume excessive memory and degrade system performance.

I switched to FPM and I'm getting activity again:




Based on what I am seeing this configuration functions:

   Server Version: Apache/2.4.41 (cPanel) OpenSSL/1.0.2t mod_bwlimited/1.4

   Server MPM: event


[[email protected] public_html]# /opt/cpanel/ea-php73/root/usr/bin/php -v
PHP 7.3.9 (cli) (built: Sep 16 2019 17:39:54) ( NTS )
Copyright (c) 1997-2018 The PHP Group
Zend Engine v3.3.9, Copyright (c) 1998-2018 Zend Technologies
    with Zend OPcache v7.3.9, Copyright (c) 1999-2018, by Zend Technologies


[[email protected] public_html]# uname -a
Linux server.domain.com 3.10.0-957.27.2.el7.x86_64 #1 SMP Mon Jul 29 17:46:05 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux


Server API    FPM/FastCGI

 

[kdean]

One more thing for my configuration. Not sure if it makes any difference. All sites force https and use http/2 if browser supports.

Note: I tested a straight HTTP connection with no difference.

 

[cPanelLauren]

I just realized @kdean we are using different versions of opcache (minor versions but still)

Your version:

ea-php73-php-opcache-7.3.9-1.1.3.cpanel.x86_64

My Version:

ea-php73-php-opcache-7.3.9-2.2.1.cpanel.x86_64

I checked on the CentOS 6 server I built for testing as well:

[[email protected] ~]# rpm -qa |grep opcache
ea-php73-php-opcache-7.3.9-2.2.1.cpanel.x86_64

Do you have an update for it available?

 

[kdean]

That was from before this weeks EA update.

I now have:

ea-php70-php-opcache-7.0.33-10.10.1.cpanel.x86_64
ea-php71-php-opcache-7.1.32-2.2.1.cpanel.x86_64
ea-php72-php-opcache-7.2.22-2.2.1.cpanel.x86_64
ea-php73-php-opcache-7.3.9-2.2.1.cpanel.x86_64

but still no difference.

I even tried switching from php-fpm to mod_lsapi for my remaining 73 test area with no difference.

 

[cPanelLauren]

@kdean

Because I can't replicate it in all the tests I've done and provided here, except if I'm running CGI I'd again lean toward a ticket.

 

[CyclingTribe]

I'm seeing the same thing with ea-php73-php-opcache-7.3.9-2.2.1.cpanel.x86_64:



No hits and no files in the files tab.

 

[cPanelLauren]

@CyclingTribe

What is the PHP handler you have set for PHP 7.3

 

[CyclingTribe]

Hi @cPanelLauren - it's lsapi and we're running PHP-FPM.

 

[CyclingTribe]

Just for comparison - on the same server we have temporarily re-enabled PHP5.6 for an old Joomla site we're upgrading and it's working fine for that site:

 

[cPanelLauren]

You can see in my earlier tests I wasn't able to reproduce this with LSAPI on CentOS7 nor was I able to with PHP-FPM - the only instance in which I was able to replicate this behavior is when I was running CGI which is NOT supported with OPCache.
I'd love to be able to investigate this further but we'd need access to do so - I need someone to open a ticket, once you do that update here with the ticket ID.

 

[CyclingTribe]

Ticket submitted: 13453497

 

[cPanelLauren]

Sorry, I tried to create a ticket but it defaults to my host as the support provider.

That should just be a recommendation and you should be able to continue on opening the ticket if you have root access to the server. This is discussed here: Create Support Ticket - Version 84 Documentation - cPanel Documentation

 

[CyclingTribe]

Thanks @cPanelLauren - I figured it out - and edited my post. Ticket 13453497

 

[LucasRolff]

The issue is related to an ionCube update, from cPanel support, that got a message from ionCube:

We are aware of this issue which only affects the PHP 7.3 ionCube Loader. We will be correcting this in the forthcoming 10.3.9 release which should become generally available either later this week or early next week.

Basically ionCube 10.3.8 update broke stuff, a fix is coming.

A temporary workaround is either to downgrade ionCube package to the previous version or just disable the extension until a fix has been made.

 

[CyclingTribe]

Thanks - we'll leave it disabled and update ionCube loader when the fix is released. Thanks to the cPanel team for sussing it out.

 

[cPanelLauren]

Hey Guys,

As mentioned by @LucasRolff this is related to the IonCube update, which actually explains a lot as to why I was unable to replicate since I hadn't included it in any of my tests. We have an internal case open to track this issue (tracking only since it's an upstream issue) and I'll update here when the issue is reported to be fixed. The internal tracking case is ID UPS-184.

Right now downgrading IonCube to 10.3.2 resolves the issue and we've reported the issue to the folks at IonCube who are aware of it and are working to resolve it currently.


Thanks!

 

[kdean]

Looks like the IonCube 10.3.9 release with the fix is now available. Have at it cPanel.

ionCube News - PHP Encoder, protection, installer and performance tools from ionCube

Secure and license your PHP scripts with the ionCube PHP Encoder 12.0. Secure valuable code with bytecode compilation, encryption and licensing capabilities.

www.ioncube.com

 

[cPanelLauren]

We have a separate case open to update the RPM - CPANEL-29887 which I just took a look at and it seems that the case is pending final review so we should have the new rpm added pretty soon. I'll update here when it is.