Disable bots from accessing anything on the server

[tigerton]

Is there a way to globally disable Google etc from indexing anything on the server? I have /~xxxxxxx/ that keeps getting indexed.
I am aware that some might be solved with robots or disable it with mod but I need the open links to work.
Is there a foolproof way to block all traffic from all bots within WHM?

 

[cPanelLauren]

Technically you could but it would be a lot to add - mod_security could do this or an apache include - see the thread here:

SOLVED - Blocking bad bots

Hi! I have seen lots of bots accessing my websites on my VPS. For now i just block IPs temporarily using CSF, but i would like to have a better and global solution. So, i'm thinking in 2 options... first: Apache Configuration -> Include Editor -> “Pre Main Include” SetEnvIfNoCase...

forums.cpanel.net