The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Latest Vistors no longer REAL TIME?

Discussion in 'General Discussion' started by adoni, May 12, 2011.

  1. adoni

    adoni Member

    Joined:
    Jan 13, 2010
    Messages:
    17
    Likes Received:
    0
    Trophy Points:
    1
    I used to be able to see real time stats for latest visitors

    It stopped about a week ago?

    Anything I can set in WHM to get that back working?

    I need real time stats to monitor IP's for clients with expensive ppc campaigns

    Thanks
     
  2. Infopro

    Infopro cPanel Sr. Product Evangelist
    Staff Member

    Joined:
    May 20, 2003
    Messages:
    14,478
    Likes Received:
    203
    Trophy Points:
    63
    Location:
    Pennsylvania
    cPanel Access Level:
    Root Administrator
    Twitter:
    If you require something to watch logs in real time, Latest Visitors is not what you want to use.

    There are multiple Feature Requests threads concerning Latest Visitors you might like to read thru, but nothing will be found there either for what you seek.

    http://forums.cpanel.net/f145/legacy-latest-vistors-default-202461.html

    http://forums.cpanel.net/f334/case-42766-case-45680-latest-visitor-log-171674.html (archived/closed)

    If you want real time, from SSH:
    tail -f /home/username/access-logs/domain.com
     
  3. adoni

    adoni Member

    Joined:
    Jan 13, 2010
    Messages:
    17
    Likes Received:
    0
    Trophy Points:
    1
    that tail switch won't even work in ssh?

    so my logs are messed up

    they worked fine up til 2 weeks ago

    now they seem to be on once a day updates only

    anyone know how to tail the main dns log so I can watch every domain on the server in real time

    thanks
     
  4. Infopro

    Infopro cPanel Sr. Product Evangelist
    Staff Member

    Joined:
    May 20, 2003
    Messages:
    14,478
    Likes Received:
    203
    Trophy Points:
    63
    Location:
    Pennsylvania
    cPanel Access Level:
    Root Administrator
    Twitter:
    You did edit the /username/ and /domain.com, correct?

    What do you mean it does not work? What was the error when you ran it?
     
  5. adoni

    adoni Member

    Joined:
    Jan 13, 2010
    Messages:
    17
    Likes Received:
    0
    Trophy Points:
    1
    Yep, I got right user and domain. I get a screen waiting to pipe in info, then I go to the site, refresh page, and nothing is coming across the log. So for some reason it looks like my logs are now not updating at all.

    I see my IP in the error log. I don't have a favicon on the site, so that error is in the error log, but my access logs are dead. They must be kept now in memory or something and eventually write later. They record now like my normal logs.

    Awstats seems to be turned off by default in root. The other two log analyizers update only daily. Last 300 visitors was real time until about 2 weeks ago. About a month ago I had a major crash on a new server, seems I was over 10K accounts and a bunch of my sites have 200+ subdomains, so 3K domains with a bunch of sites with many subdmains that means a ton of log work. The ISP admins had to do something with cpanel to get my server html working a month ago. Last visitors worked fine, but now they're gone.

    And yeah, tail -f on that log won't work. Do you know what the catch all log is on a server to show every html call? I used to use that years ago with cpanel to watch all my sites in real time with thousands of processes every minute. I'd ctrl c it to freeze a window, then see what I was looking for.

    Anyway, I started using some blogs recently, so that's the only new stuff on the server and those WP programs are crappy IMO with like 100 processes per visitor to pull up one page -- way too many scripts and images and whatever they do. So WP was added recently. Maybe, too much of a load on the server, but it's running under 1.0-.40 range, not too hot.
     
    #5 adoni, May 12, 2011
    Last edited by a moderator: May 12, 2011
  6. Infopro

    Infopro cPanel Sr. Product Evangelist
    Staff Member

    Joined:
    May 20, 2003
    Messages:
    14,478
    Likes Received:
    203
    Trophy Points:
    63
    Location:
    Pennsylvania
    cPanel Access Level:
    Root Administrator
    Twitter:
    tail -f /usr/local/apache/logs/error_log should show all errors on the server in real time.

    CPU is normally under 1.0? That's fine, IMHO.

    If you suspect an issue with your server you should contact your provider or cPanel support directly.

    WHM > Support > Support Center > Contact cPanel.
     
  7. adoni

    adoni Member

    Joined:
    Jan 13, 2010
    Messages:
    17
    Likes Received:
    0
    Trophy Points:
    1
    it's running a little hot

    1.50 or so avg

    plus the id is 85% useage

    the error logs show real time info so I can see any fresh IP since none of my sites use fav icon

    but I wanted to see real time for the whole server as to html calls

    I think the last time we did it, was via a custom tweak on the config files, so every domain wrote to a html file in apache and not just to the domain

    all I see is access_log for what ftp or ssh?
    error_log yeah real time for errors on the sites (but some have no errors)

    don't see a generic log in apache to cull all the html calls across the network

    anyway, the last 300 visitors is still not REAL TIME, so if anyone knows a way to turn that on for a domain great

    is there a log for all dns calls? anywhere on the server?
     
  8. cPanelTristan

    cPanelTristan Quality Assurance Analyst
    Staff Member

    Joined:
    Oct 2, 2010
    Messages:
    7,623
    Likes Received:
    21
    Trophy Points:
    38
    Location:
    somewhere over the rainbow
    cPanel Access Level:
    Root Administrator
    Does /usr/local/apache/logs/access_log show all activity? It should be a log for all activity to Apache. Otherwise, you can view the individual domlogs at /usr/local/apache/domlogs/domain.com location

    For the DNS, you would have any entries for queries to /var/log/messages location, although it does not simply log the named entries but those for SSH and FTP as well as kernel messages.
     
  9. adoni

    adoni Member

    Joined:
    Jan 13, 2010
    Messages:
    17
    Likes Received:
    0
    Trophy Points:
    1
    the access logs show almost nothing, they don't show real time

    the error logs show lots of action

    the individual domain logs are dead, no real time stats

    that's why latest 300 visitors do no pull any info

    somethings broken
     
  10. cPanelTristan

    cPanelTristan Quality Assurance Analyst
    Staff Member

    Joined:
    Oct 2, 2010
    Messages:
    7,623
    Likes Received:
    21
    Trophy Points:
    38
    Location:
    somewhere over the rainbow
    cPanel Access Level:
    Root Administrator
    Yes, something does appear to be broken. Please try running this command for the domain in question and provide the output when it runs:

    Code:
    /scripts/runweblogs username
    Here replace username with the cPanel username for the account in question. Also, check the domlogs timestamp before and after running that command:

    Code:
    ls -lah /usr/local/apache/domlogs/domain.com
    Again, please replace domain.com with the domain in question.
     
  11. adoni

    adoni Member

    Joined:
    Jan 13, 2010
    Messages:
    17
    Likes Received:
    0
    Trophy Points:
    1
    says waiting for load to go down before continuing
     
  12. cPanelTristan

    cPanelTristan Quality Assurance Analyst
    Staff Member

    Joined:
    Oct 2, 2010
    Messages:
    7,623
    Likes Received:
    21
    Trophy Points:
    38
    Location:
    somewhere over the rainbow
    cPanel Access Level:
    Root Administrator
    Please provide the results once it does process then. Also, what is the current load on the machine? You can get the load by running the "uptime" command.
     
  13. adoni

    adoni Member

    Joined:
    Jan 13, 2010
    Messages:
    17
    Likes Received:
    0
    Trophy Points:
    1
    root@ais [/usr/local/apache/logs]# ls -lah /usr/local/apache/domlogs/personalinjuryattorney.biz
    -rw-r----- 2 root piabiz 1.3K May 12 12:27 /usr/local/apache/domlogs/personalinjuryattorney.biz

    then

    Code:
    root@ais [/usr/local/apache/logs]# /scripts/runweblogs piabiz
    Log checker loaded ok..
    ==> cPanel Log Daemon version 24.0
    ==> Loaded RRDs: version 1.3006
    Processing piabiz...
    Run Logs domain: personalinjuryattorney.biz BW Limit: unlimited Domains: [fortlauderdale.personalinjuryattorney.biz ftlauderdale.personalinjuryattorney.biz chicago.personalinjuryattorney.biz coralsprings.personalinjuryattorney.biz dallas.personalinjuryattorney.biz houston.personalinjuryattorney.biz lasvegas.personalinjuryattorney.biz losangeles.personalinjuryattorney.biz miami.personalinjuryattorney.biz newyork.personalinjuryattorney.biz newyorkcity.personalinjuryattorney.biz palmbeach.personalinjuryattorney.biz philadelphia.personalinjuryattorney.biz phoenix.personalinjuryattorney.biz sandiego.personalinjuryattorney.biz sanfrancisco.personalinjuryattorney.biz sanjose.personalinjuryattorney.biz bocaraton.personalinjuryattorney.biz]
    [2011-05-12 13:19:30 -0500] Process bandwidth for piabiz
    [2011-05-12 13:19:31 -0500] Processing exim stats for piabiz....
    [2011-05-12 13:19:31 -0500] ...Done
    [2011-05-12 13:19:31 -0500] WEBLANG english
    [2011-05-12 13:19:31 -0500] Archive Status: 0
    [2011-05-12 13:19:31 -0500] About to fork for piabiz [ALL DOMAINS: fortlauderdale.personalinjuryattorney.biz, ftlauderdale.personalinjuryattorney.biz, chicago.personalinjuryattorney.biz, coralsprings.personalinjuryattorney.biz, dallas.personalinjuryattorney.biz, houston.personalinjuryattorney.biz, lasvegas.personalinjuryattorney.biz, losangeles.personalinjuryattorney.biz, miami.personalinjuryattorney.biz, newyork.personalinjuryattorney.biz, newyorkcity.personalinjuryattorney.biz, palmbeach.personalinjuryattorney.biz, philadelphia.personalinjuryattorney.biz, phoenix.personalinjuryattorney.biz, sandiego.personalinjuryattorney.biz, sanfrancisco.personalinjuryattorney.biz, sanjose.personalinjuryattorney.biz, bocaraton.personalinjuryattorney.biz, personalinjuryattorney.biz]
    [2011-05-12 13:19:31 -0500] Waiting for load to go down to continue
     
  14. adoni

    adoni Member

    Joined:
    Jan 13, 2010
    Messages:
    17
    Likes Received:
    0
    Trophy Points:
    1
    loads now 3.50

    this is a relatively new server

    it recently crashed html and cpanel had to come in an fix

    they claimed I had too many domains (8K)

    3k domains with many that have sub domains

    so they did something and it worked

    then a couple of weeks later the logs for latest visitors stopped being real time

    I have to monitor those logs in real time due to some ppc fraud issues
     
  15. cPanelTristan

    cPanelTristan Quality Assurance Analyst
    Staff Member

    Joined:
    Oct 2, 2010
    Messages:
    7,623
    Likes Received:
    21
    Trophy Points:
    38
    Location:
    somewhere over the rainbow
    cPanel Access Level:
    Root Administrator
    Your domlogs likely aren't updating due to the server's load. If the load is too high most times, it will cause the logs to not process.

    In WHM > Tweak Settings, you may want to change the value for "Extra CPUs for server load" to be around 5, then click the "Save" button.
     
  16. adoni

    adoni Member

    Joined:
    Jan 13, 2010
    Messages:
    17
    Likes Received:
    0
    Trophy Points:
    1
    thanks

    do I have to do anything else now to force logs to refresh to new setting?

    oh, I had to find stats and logs to do the tweak

    do you know of a way to force all httpd calls to write to one master log

    nick did that for me on an old server years ago we used forever

    probably from 1997 to 2003

    that was nice having all traffic report to one log to monitor the whole network live

    I don't remember if it still did individual logs

    maybe there's a way to pipe in multiple logs via shell

    tail this and that and that and this
     
  17. adoni

    adoni Member

    Joined:
    Jan 13, 2010
    Messages:
    17
    Likes Received:
    0
    Trophy Points:
    1
    looks like some logs are starting to show up now

    thanks
     
  18. adoni

    adoni Member

    Joined:
    Jan 13, 2010
    Messages:
    17
    Likes Received:
    0
    Trophy Points:
    1
    spoke too soon

    logs still not real time

    looks like I had a minor update after noon

    next update is after midnight

    so still no real time logs

    argghhhhhhhhh
     
  19. cPanelTristan

    cPanelTristan Quality Assurance Analyst
    Staff Member

    Joined:
    Oct 2, 2010
    Messages:
    7,623
    Likes Received:
    21
    Trophy Points:
    38
    Location:
    somewhere over the rainbow
    cPanel Access Level:
    Root Administrator
    Force a stats update for all accounts using this command:

    Code:
    /scripts/runstatsonce --force
     
  20. adoni

    adoni Member

    Joined:
    Jan 13, 2010
    Messages:
    17
    Likes Received:
    0
    Trophy Points:
    1
    root@ais [/usr/local/apache/logs]# /scripts/runstatsonce --force
    This script requires cPanel 6.4.2 Build 11+
    ==> cPanel Log Daemon version 24.0
    ==> Ignoring lastrun files and running all stats now
    ==> cpanellogd will exit after stats have run
     
Loading...

Share This Page