Please whitelist cPanel in your adblocker so that you’re able to see our version release promotions, thanks!

The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

mod_sec - best way to ID user agents to block?

Discussion in 'Security' started by WorkinOnIt, Aug 3, 2016.

  1. WorkinOnIt

    WorkinOnIt Well-Known Member

    Aug 3, 2016
    Likes Received:
    Trophy Points:
    cPanel Access Level:
    Root Administrator
    Hi Forum

    I am new here so greetings to all !

    I'm working on the best way to identify and stop bad user agents. I've read multiple threads and googled a lot - so far it seems there is no "clear" or obvious best practice so to speak.

    At the moment I've implemented a mod_sec rule to include a txt file with a list of known bad bots etc.... but looking at logs of various user accounts on the server there appear to be a lot of hits from unknown spiders and bots - so how do you mitigate these in the txt file if you don't have a user agent name? What would be the best way to target "unknown bots"

    Also - where would one find a list of bad user agents to block?

    Thank you
  2. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Apr 11, 2011
    Likes Received:
    Trophy Points:
    cPanel Access Level:
    Root Administrator

    You can use the term "user agent list" on a search engine and find several results with lists of user agents that you may want to block. One of the third-party URLs in the results that looks helpful is:

    Identify and block bad robots from website

    Thank you.

Share This Page