cpanellogd apparently not running webalizer for web stats for some domains

[nino]

Hi,

First, I do apologize for posting about a webalizer problem as I've seem many topics about similar problems. I've searched all over the forums but none of the other topics gave me a clue to solve my issue.

Apparently cpanellogd is not running webalizer for some of my domains. All of them have big web log files (>20mb). If I run webalizer manually with the command bellow, the stats gets updated normally:

/usr/local/cpanel/3rdparty/bin/webalizer -N10 -D /home2/[USER]/tmp/webalizer/dns_cache.db -R250 -p -n [DOMAN] -o /home2/[USER]/tmp/webalizer /usr/local/apache/domlogs/[DOMAIN]

But if I run the logs through cpannellogd, I don't see webalizer being called for web logs. The only lines containing webalizer apparently are for the ftp logs.

# /scripts/runweblogs [USER]
Log checker loaded ok..
==> cPanel Log Daemon version 25.0
==> Loaded RRDs: version 1.4004
Processing [USER]...
Run Logs domain: [USER].com.br BW Limit: 104857600000 Domains: [DOMAINS]
info [safeapacherestart] Restart elapsed seconds: 7
[2013-03-07 15:13:54 -0300] Process bandwidth for [USER]
[2013-03-07 15:13:55 -0300] Processing exim stats for [USER]....
[2013-03-07 15:13:55 -0300] ...Done
[2013-03-07 15:13:57 -0300] Disk Usage for [USER] on /dev/sdb1 (1238596/5120000)
[2013-03-07 15:13:57 -0300] WEBLANG portuguese_brazil
[2013-03-07 15:13:57 -0300] Archive Status: 0
[2013-03-07 15:13:57 -0300] About to fork for [USER] [ALL DOMAINS: [DOMAINS]]
[2013-03-07 15:13:57 -0300] /usr/local/cpanel/3rdparty/bin/analog: analog version 6.0/Unix
[2013-03-07 15:13:57 -0300] /usr/local/cpanel/3rdparty/bin/analog: Warning M: Cache file
[2013-03-07 15:13:57 -0300]   /home2/[USER]/tmp/analog/cache doesn't contain last-seven-day statistics; so
[2013-03-07 15:13:57 -0300]   these may be underestimated
[2013-03-07 15:13:57 -0300]   (For help on all errors and warnings, see docs/errors.html)
[2013-03-07 15:14:13 -0300] /usr/local/cpanel/3rdparty/bin/analog: Warning L: logfiles
[2013-03-07 15:14:13 -0300]   /home2/[USER]/tmp/analog/cache and /usr/local/apache/domlogs/[USER].com.br
[2013-03-07 15:14:13 -0300]   overlap: possible double counting
[2013-03-07 15:14:15 -0300] /usr/local/cpanel/3rdparty/bin/analog: Warning R: Turning off empty Virtual
[2013-03-07 15:14:15 -0300]   Host Report
[2013-03-07 15:14:15 -0300] /usr/local/cpanel/3rdparty/bin/analog: Warning R: In Domain Report, turning
[2013-03-07 15:14:15 -0300]   off pie chart of only one wedge
[2013-03-07 15:14:22 -0300] Create/Update database for config "/home2/[USER]/tmp/awstats/awstats.[USER].com.br.conf" by AWStats version 7.0 (build 1.971)
[2013-03-07 15:14:22 -0300] From data in log file "/usr/local/apache/domlogs/[USER].com.br"...
[2013-03-07 15:14:22 -0300] Phase 1 : First bypass old records, searching new record...
[2013-03-07 15:14:22 -0300] Direct access after last parsed record (after line 136037)
[2013-03-07 15:14:22 -0300] Jumped lines in file: 136037
[2013-03-07 15:14:22 -0300]  Found 136037 already parsed records.
[2013-03-07 15:14:22 -0300] Parsed lines in file: 244
[2013-03-07 15:14:22 -0300]  Found 0 dropped records,
[2013-03-07 15:14:22 -0300]  Found 0 comments,
[2013-03-07 15:14:22 -0300]  Found 0 blank records,
[2013-03-07 15:14:22 -0300]  Found 0 corrupted records,
[2013-03-07 15:14:22 -0300]  Found 0 old records,
[2013-03-07 15:14:22 -0300]  Found 244 new qualified records.
[2013-03-07 15:14:25 -0300] Webalizer V2.01-10 (Linux 2.6.32-279.19.1.el6.x86_64) English
[2013-03-07 15:14:25 -0300] Using logfile /usr/local/apache/domlogs/ftp.[USER].com.br-ftp_log (ftp)
[2013-03-07 15:14:25 -0300] Creating output in /home2/[USER]/tmp/webalizerftp
[2013-03-07 15:14:25 -0300] Hostname for reports is 'ftp.[USER].com.br'
[2013-03-07 15:14:25 -0300] Reading history file... webalizer.hist
[2013-03-07 15:14:25 -0300] Reading previous run data.. webalizer.current
[2013-03-07 15:14:25 -0300] 156076 records (156076 ignored) in 1.57 seconds, 99411/sec
Complete

I've already tried enabling and re-enabling webalizer for these accounts on WHM with no success. Other domains, with smaller log files gets updated normally. I've also tried to find if there's some limit about the log sizes but wasn't able to find anything.

I've also searched for errors on /usr/local/cpanel/logs/stats_log but there isn't any.

Running /scripts/fixwebalizer is not an option as I can't lose previous saved webalizer data for the accounts. Also, as I'm able to update webalizer stats manually, I assume that the problem isn't with webalizer itself.

If someone could give any clues to solve this issue, it would be of great help.

Thanks!

 

[nino]

Found the solution.

The localized webalizer executable was missing in "/usr/local/cpanel/3rdparty/bin/[locale]/".

The stats for FTP were being run normally because cpanellogd was using the default webalizer executable for it (english). But the domains configured for a different locate were not being run.

The cpanellogd was trying to run "/usr/local/cpanel/3rdparty/bin/[locale]/webalizer" that doesn't exist. So, there's two bugs here. First, cpanellogd is not notifying that the file is missing, no error is being reported. Second, cpanel itself have not detected that a locale was missing and tried to rebuild it automatically.

To fix it, I used "/usr/local/cpanel/bin/rebuildwebalizer [locale]".

Maybe this will help someone in the future

Thanks.