Horde/IMP webmail searches limited results

[aztopdavid]

My vps runs cPanel/WHM v80.0.18 with Horde at v5.2.22. I use Horde/IMP webmail almost exclusively to access several email accounts and use the search function daily. Up until today, the results shown spanned my entire Inbox (or my entire email account when adding "All Mailboxes" in the Advanced search options). Today, my search results only show the last day or so of results, even though there should be MANY older results (I have a lot of items in my Inbox). This is happening on all mailboxes that I've checked, although in some cases, I'm seeing results going back up to 4 days, but that's still only a very small window of what should be shown.

I logged into WHM and checked the value for "Age, in days, of content to purge users’ Horde cache files" in Tweak Settings, and it's "Disabled" which is the default.

Suggestions as to what else I should check or about what might be causing this are most welcome!

(sorry about the misleading Subject -- it probably should have been "limited results in Horde/IMP webmail searches" and thanks for moving this to Email -- I thought maybe I should have posted it here, but it wasn't related to exim, sending/receiving emails, so I chose General instead)

 

[Havri]

Hi David,

This is something that is happening to me too. I'm also using cPanel v80.0.18 on CentOS 7.

On my server, I also run cPanel FTS - Apache Solr. You should check if you have it enabled too. Maybe disabling this fixes the problem.

For me, a temporary fix that works is to perform a full text search (FTS) scan the affected account's mailboxes:

/usr/local/cpanel/scripts/rescan_user_dovecot_fts --user myuser123

After that, I need to reindex mails with doveadm:

doveadm index -u [email protected] INBOX.*

I'm not sure this is the right order for these commands, but it worked in my case.

NOTE:

If you're already logged into the webmail and you run the above command, you'll need to refresh your webmail tab or relog back in.

Best regards!

 

[aztopdavid]

Thanks, Havri! Before you replied, I joined the IMP list at Horde.org and posted this same issue. One person mentioned possible IMAP server issues, so I started looking onto Dovecot commands. I tried:

doveadm force-resync -u [email protected] INBOX

and:

doveadm index -u [email protected] INBOX

but neither helped, so I discovered FTS and this is the command that worked:

doveadm fts rescan -u [email protected]

Then I looked here again and saw your response.

I'm pretty sure that the "fts rescan" command by itself solved the problem, and thanks for your helpful response!

 

[Havri]

Hi David,

Sounds great. Glad that you found a solution, although in my case it's a little bit too much to do on my part. Yesterday I had a client with ~150 mailboxes that needed its fts rescanned. The day before that another 100 mailboxes or so. Not really looking forward to do this manually everyday. Waiting for someone at cPanel to give some pointers as to what to do further or tell me if I need to open a ticket.

Best regards.

 

[aztopdavid]

I'm guessing there are many more servers affected, but people aren't reporting it yet, because incomplete search results in webmail will only be noticed by a very small subset of end users and it's less likely to be reported to server admins, and then to cPanel. I don't think the "fts rescan" command will take a wildcard, as I tried that and it didn't appear to work.

I don't know if it's related, but this morning, after the nightly cPanel Update chron job, my lfd sent me a number of "Suspicious File Alert" warnings related to the Dynamic Kernel Module Support temp files -- most likely unrelated.

 

[Havri]

Hi David,

I think more reports will come in soon. There is an option "-A" that allows me to rescan the mailboxes for all users, but I think that will take a lot of time, depending on the number of mails:

Tools/Doveadm/FTS - Dovecot Wiki

The thing is that from what I've checked, only some users have this problem, which is weird. Some mailboxes on the same domain are affected by this and some aren't. I just generate a list of mailboxes that need to be reindexed and I work with that.

Let's see if other people are having the same problem or if someone at cPanel gives us some advice.

Best regards.

 

[cPanelMichael]

Hello @Havri,

Updates to the Solr RPMS (part of the Full Text Search Indexing for IMAP powered by Apache Solr™ plugin offered in WHM >> Manage Plugins) were published on June 22nd, 2019.

Can you report this issue via a support ticket so we can take a closer look at an affected system and verify if this is a defect related to the updated RPMS? You can post the ticket number here and I'll link this thread to it.

Thank you.