The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

client denied by server configuration

Discussion in 'General Discussion' started by overload, Jul 12, 2007.

  1. overload

    overload Member

    Joined:
    Feb 9, 2006
    Messages:
    11
    Likes Received:
    0
    Trophy Points:
    1
    Hello

    Please help me with the following problem, my site bans Googlebot but
    I find no reason for this.

    I noticed in Cpanel's error log this line:

    Thu Jul 12 12:00:09 2007] [error] [client 66.249.65.75] client denied by server configuration: /home/myuser/public_html/myfile.php

    I am 100% sure this is not banned from htaccess, what are other reasons for this?
    What else could ban an ip or agent and how to find out.
     
  2. jayh38

    jayh38 Well-Known Member

    Joined:
    Mar 3, 2006
    Messages:
    1,215
    Likes Received:
    0
    Trophy Points:
    36
    It sounds like your host may have restricted google from crawling the server. You should check with your host.
     
  3. Spiral

    Spiral BANNED

    Joined:
    Jun 24, 2005
    Messages:
    2,023
    Likes Received:
    7
    Trophy Points:
    0
    I would double check .htaccess files again anyway ....

    Instead of .htaccess, the block might have been placed in the main httpd.conf file
    and usually results from the use of "Deny from" commands.

    Mod_Security and / or firewalls such as CSF or APF could also restrict access.

    Could also be as simple as file permissions on that file shown in the error ;)
     
  4. overload

    overload Member

    Joined:
    Feb 9, 2006
    Messages:
    11
    Likes Received:
    0
    Trophy Points:
    1
    I have dedicated server so I can check everything.

    - htaccess is not
    - httpd.conf I checked it and found no clue
    - csf is not installed
     
  5. Spiral

    Spiral BANNED

    Joined:
    Jun 24, 2005
    Messages:
    2,023
    Likes Received:
    7
    Trophy Points:
    0
    You didn't say anything about mod_security
     
  6. overload

    overload Member

    Joined:
    Feb 9, 2006
    Messages:
    11
    Likes Received:
    0
    Trophy Points:
    1
    here it is modsec.conf, nothing


    <IfModule mod_security.c>
    SecFilterEngine On
    SecFilterCheckURLEncoding On
    SecFilterForceByteRange 0 255
    SecAuditEngine RelevantOnly
    SecAuditLog logs/audit_log
    SecFilterDebugLog logs/modsec_debug_log
    SecFilterDebugLevel 0
    SecFilterDefaultAction "deny,log,status:406"
    SecFilterSelective REMOTE_ADDR "^127.0.0.1$" nolog,allow
    Include "/usr/local/apache/conf/modsec.user.conf"
    </IfModule>
     
  7. overload

    overload Member

    Joined:
    Feb 9, 2006
    Messages:
    11
    Likes Received:
    0
    Trophy Points:
    1
    almost bingo!

    I finally have some clue, I noticed in mod_sec log that indeed some requests from google IP are banned because of invalid characters in GET request. for these request, response code is 406 - Access denied with code 406.

    in my access log nevertheless I get requests with response code 200. does it mean that
    googlebot is not really banned, only some bad requests are rejected? here it is complete explanation for error (message):

    "access denied with code 406. Error normalising REQUEST_URI: Invalid URL encoding detected: not enough characters"
     
  8. CapriSkye

    CapriSkye Registered

    Joined:
    Oct 6, 2004
    Messages:
    4
    Likes Received:
    0
    Trophy Points:
    1
    mod_dosevasive?
     
Loading...

Share This Page