I recently noticed that “competitor research” and “SEO” bots were accounting for almost 60% of the traffic on my webserver. Here were the worst offenders: trendiction.com (trendictionbot) User Agent "Mozilla/5.0 (Windows NT 10.0; Win64; x64; trendictionbot0.5.0; trendiction search; http://www.trendiction.de/bot; please let us know of any problems; web at trendiction.com) Gecko/20170101 Firefox/67.0" Network(s) – 144.76.0.0/16 (Hetzner […]