Best practices for blocking bad bots?

[manoaratefy]

Good morning,

I'm facing a lot for bad bots which crawl websites on my servers and submitting contact forms/newsletter forms of my customers.

Even if my customers can block them with captcha tools on their form, I'm asking if there are some actions that I can do on my servers to block them (except IP blocking, which is very hard to manage as the bots doesn't have any fixed IP, they run on compromised servers across the world I think).

I'm currently trying with Comodo WAF rules, does it help?

Thanks in advance.

 

[cPanelLauren]

Are they actually bad bots or just bots in general? You can create a robots.txt file to exclude specific portions of sites.


If they're actually bad bots there are a few threads in the forums that address this:

SOLVED - Blocking bad bots

Hi! I have seen lots of bots accessing my websites on my VPS. For now i just block IPs temporarily using CSF, but i would like to have a better and global solution. So, i'm thinking in 2 options... first: Apache Configuration -> Include Editor -> “Pre Main Include” SetEnvIfNoCase...

forums.cpanel.net

Help with Globally blocking Bad Bots

Hello Everyone, I am running several c panel servers using CentOS 7 and I am experiencing a lot of bandwidth usage on a lot of websites by bots. Mainly these ones: Unknown robot identified by \*bot MJ12bot Is there a good way to block these two Globally in WHM? I have been searching and...

forums.cpanel.net

Globally stop bad bots in Apache

Usually use a tip on htaccess for stop badbots for some sites. But in last times, too many sites has same problem: too many bad boots with high traffic. What is best method for put on httpd.conf or for global sites ? # Block Bad Bots & Scrapers SetEnvIfNoCase User-Agent "MJ12bot" bad_bot...

forums.cpanel.net