The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Apache Bug (Build 11.38.x)? (get /robots.txt)

Discussion in 'Security' started by easyswiss, Oct 10, 2013.

  1. easyswiss

    easyswiss Active Member

    Joined:
    Apr 19, 2011
    Messages:
    33
    Likes Received:
    0
    Trophy Points:
    6
    We have a problem on 2 servers since ~july/august 2013, they have every day a lot of processes like this here:

    945950 1/43/7079 G 1.80 68687 0 2.7 0.50 175.53 66.249.66.104 HOSTNAME:4 GET /robots.txt HTTP/1.1
    872984 1/9/36597 G 0.19 11952 0 2.7 0.19 1167.38 66.249.66.36 HOSTNAME:4 GET /robots.txt HTTP/1.1

    This results in heavy load (this processes take 100% cpu usage -> as nobody).

    Is there a solution?
    Add this IP's to the host access access control have no effect.
    Only this "get /robots.txt processes need so much cpu.
     
  2. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,811
    Likes Received:
    671
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    Hello :)

    Do you have a third-party firewall application such as CSF installed on your system? If not, it may be a good idea to install a firewall so you can block IP addresses from accessing your server. You may also want to install Mod_Security to help with certain access attempts.

    Thank you.
     
  3. cPanelJamyn

    cPanelJamyn Social Engineer
    Staff Member

    Joined:
    Jan 29, 2009
    Messages:
    105
    Likes Received:
    2
    Trophy Points:
    0
Loading...

Share This Page