The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

2 GIG log file kills web server

Discussion in 'General Discussion' started by ethank, Dec 10, 2005.

  1. ethank

    ethank Member

    Joined:
    Mar 29, 2005
    Messages:
    16
    Likes Received:
    0
    Trophy Points:
    1
    I'm having an issue with one of my sites, where the log file for one site goes to 2.0 gigs, and when that happens, it won't log anymore and the webserver starts dying. I have to clear the log for it to start working.

    Does anyone know how to fix this?
     
  2. ntwaddel

    ntwaddel Well-Known Member

    Joined:
    Nov 3, 2003
    Messages:
    173
    Likes Received:
    0
    Trophy Points:
    16
    Location:
    Templeton, CA
    you could tell cpanel to clear the log everytime the stats run, hopefully its not growing to over 2gigs everyday
     
  3. simplestar

    simplestar Well-Known Member

    Joined:
    Nov 15, 2005
    Messages:
    97
    Likes Received:
    0
    Trophy Points:
    6
    I can't remember the name of it, but there is an RPM you can install that will watch and dump logs before they hit the 2G mark.
     
  4. ethank

    ethank Member

    Joined:
    Mar 29, 2005
    Messages:
    16
    Likes Received:
    0
    Trophy Points:
    1
    Twice a day it grows, and the stats can't keep up.
     
  5. aby

    aby Well-Known Member

    Joined:
    May 31, 2005
    Messages:
    638
    Likes Received:
    0
    Trophy Points:
    16
    Location:
    India
    You can set up a cron to clear the logs with in a specific time period .
     
  6. brianoz

    brianoz Well-Known Member

    Joined:
    Mar 13, 2004
    Messages:
    1,146
    Likes Received:
    6
    Trophy Points:
    38
    Location:
    Melbourne, Australia
    cPanel Access Level:
    Root Administrator
    That's the wrong way to fix it, you really need to work out why that log file is growing so rapidly and fix the problem at cause. That sort of log growth doesn't sound like a normal pattern of access.
     
  7. aby

    aby Well-Known Member

    Joined:
    May 31, 2005
    Messages:
    638
    Likes Received:
    0
    Trophy Points:
    16
    Location:
    India
    That depends on the site .. i would say... if he is having a very busy site, .. But ... yes .. it is true that it is Normal.. But I have seen many cases ... in which the traffic is so high that you have to go for this.. But I agree, it is worth to investigate more..
     
  8. lart2150

    lart2150 Registered

    Joined:
    Dec 10, 2005
    Messages:
    1
    Likes Received:
    0
    Trophy Points:
    1
    i'm new to cpanel but you could try to tell logrote to rote your logs more frequently.
     
  9. brianoz

    brianoz Well-Known Member

    Joined:
    Mar 13, 2004
    Messages:
    1,146
    Likes Received:
    6
    Trophy Points:
    38
    Location:
    Melbourne, Australia
    cPanel Access Level:
    Root Administrator
    Yeah, sorry for not adding this above, but I did know that 2Gb a day is *possible*, I just think it's likely something is going wrong. We've had MSNbot and Googlebot go into loops or semi-loops on some sites here, so I'm suspecting something like that. It could also be referrer spam, or any one of a number of things. He specifically didn't mention it was a very high traffic site, so if it's not (and he'd know as it usually builds up over time), my bet is there'll be a culprit! Unless it was slashdotted! Anyway ... all theory until the OP responds ...

    - b
     
  10. ethank

    ethank Member

    Joined:
    Mar 29, 2005
    Messages:
    16
    Likes Received:
    0
    Trophy Points:
    1
    I know its legit traffic, as its a hugely popular gossip blog. I think what I'll end up doing is using google analytics and stop it logging, but I need a solution until I can do that :)
     
  11. abubin

    abubin Well-Known Member

    Joined:
    Dec 7, 2004
    Messages:
    393
    Likes Received:
    1
    Trophy Points:
    18
    if the site can generate more than 2gb of log traffics per day then it is really busy and I think you would be looking at around 200,000 hits per day? Over a few million page views per day? If that is true, you would be looking at some really traffic heavy site for a blog? If this is true, how come I don't know about such blog site? hehehe....

    Did you set your log level to minimum at WHM?
     
  12. ethank

    ethank Member

    Joined:
    Mar 29, 2005
    Messages:
    16
    Likes Received:
    0
    Trophy Points:
    1
    Its pinkisthenewblog.com

    I don't run it, but I host it.
     
  13. PanelGuy

    PanelGuy Well-Known Member

    Joined:
    Oct 13, 2004
    Messages:
    106
    Likes Received:
    0
    Trophy Points:
    16
  14. 65535

    65535 Member

    Joined:
    Jul 15, 2003
    Messages:
    16
    Likes Received:
    0
    Trophy Points:
    1
    Isn't this a 32bit limitation of Apache rather than anything else?

    Rus
     
  15. myusername

    myusername Well-Known Member
    PartnerNOC

    Joined:
    Mar 6, 2003
    Messages:
    691
    Likes Received:
    1
    Trophy Points:
    18
    Location:
    chown -R us.*yourbase*
    cPanel Access Level:
    DataCenter Provider
    Twitter:
    I wouldn't say that. We have a site spread across several servers that constantly has this problem. The problem is the servers are so finely tuned to hand a ton of traffic. those logs can indeed be normal for many busy sites.
    We set a cron up for ours because the cpanel option to remove them after stats run is not always reliable.

    So much for web stats.

    Anyways, I voted as well.
     
Loading...

Share This Page