Please whitelist cPanel in your adblocker so that you’re able to see our version release promotions, thanks!

The Community Forums

Interact with an entire community of cPanel & WHM users!

How to disallow some crawler globally in httpd conf?

Discussion in 'General Discussion' started by postcd, May 27, 2014.

  1. postcd

    postcd Well-Known Member

    Joined:
    Oct 22, 2010
    Messages:
    694
    Likes Received:
    15
    Trophy Points:
    68
    Hello,

    if i want to disable some web crawler globally on all existing and future accounts, how to do it persistently?

    example this can be added to .htaccess but i need persistent global file of httpd ?

    I found Home » Service Configuration » Apache Configuration » Include Editor
    there are 3 include files, not sure if i can use this and add mentioned thing? persistently?

    Also what if i want to add some robots.txt rule globally?
    like:
     
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
    #1 postcd, May 27, 2014
    Last edited: May 27, 2014
  2. cPanelMichael

    cPanelMichael Technical Support Community Manager
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    44,704
    Likes Received:
    1,883
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Stop hovering to collapse... Click to collapse... Hover to expand... Click to expand...
Loading...

Share This Page

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice