Please whitelist cPanel in your adblocker so that you’re able to see our version release promotions, thanks!

The Community Forums

Interact with an entire community of cPanel & WHM users!

How to disallow some crawler globally in httpd conf?

Discussion in 'General Discussion' started by postcd, May 27, 2014.

  1. postcd

    postcd Well-Known Member

    Joined:
    Oct 22, 2010
    Messages:
    689
    Likes Received:
    14
    Trophy Points:
    68
    Hello,

    if i want to disable some web crawler globally on all existing and future accounts, how to do it persistently?

    example this can be added to .htaccess but i need persistent global file of httpd ?

    I found Home » Service Configuration » Apache Configuration » Include Editor
    there are 3 include files, not sure if i can use this and add mentioned thing? persistently?

    Also what if i want to add some robots.txt rule globally?
    like:
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
    #1 postcd, May 27, 2014
    Last edited: May 27, 2014
  2. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    43,870
    Likes Received:
    1,811
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
Loading...

Share This Page

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice