The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

mod_sec - best way to ID user agents to block?

Discussion in 'Security' started by WorkinOnIt, Aug 3, 2016.

Tags:
  1. WorkinOnIt

    WorkinOnIt Well-Known Member

    Joined:
    Aug 3, 2016
    Messages:
    49
    Likes Received:
    1
    Trophy Points:
    8
    Location:
    UK
    cPanel Access Level:
    Root Administrator
    Hi Forum

    I am new here so greetings to all !

    I'm working on the best way to identify and stop bad user agents. I've read multiple threads and googled a lot - so far it seems there is no "clear" or obvious best practice so to speak.

    At the moment I've implemented a mod_sec rule to include a txt file with a list of known bad bots etc.... but looking at logs of various user accounts on the server there appear to be a lot of hits from unknown spiders and bots - so how do you mitigate these in the txt file if you don't have a user agent name? What would be the best way to target "unknown bots"

    Also - where would one find a list of bad user agents to block?

    Thank you
     
  2. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,854
    Likes Received:
    676
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    Hello,

    You can use the term "user agent list" on a search engine and find several results with lists of user agents that you may want to block. One of the third-party URLs in the results that looks helpful is:

    Identify and block bad robots from website

    Thank you.
     
Loading...

Share This Page