ScotL wrote: ↑Fri Sep 02, 2022 1:34 pmYeah, seems like a waste of time. But still 663 is still a lot of hits even if half are bots/zombies.
Here's the only way to identify them via the logs -- by their User-Agent identification (and only if they're being honest, and tell me how many of the ones below (a subset of the entries that actually contain the string "bot", 32 out of 258) are being completely honest:
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +
http://www.bing.com/bingbot.htm) Chrome/103.0.5060.134 Safari/537.36
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +
http://www.google.com/bot.html) Chrome/104.0.5112.101 Safari/537.36
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +
http://www.google.com/bot.html) Safari/537.36
Mozilla/5.0 (compatible; Adsbot/3.1; +
https://seostar.co/robot/)
Mozilla/5.0 (compatible; AhrefsBot/7.0; +
http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; Barkrowler/0.9; +
https://babbar.tech/crawler)
Mozilla/5.0 (compatible; bingbot/2.0; +
http://www.bing.com/bingbot.htm)
Mozilla/5.0 (compatible; Googlebot/2.1; +
http://www.google.com/bot.html)
Mozilla/5.0 (compatible; Neevabot/1.0; +
https://neeva.com/neevabot)
Mozilla/5.0 (compatible;PetalBot;+
https://webmaster.petalsearch.com/site/petalbot)
Mozilla/5.0 (compatible; Pinterestbot/1.0; +
http://www.pinterest.com/bot.html)
Mozilla/5.0 (compatible) SemanticScholarBot (+
https://www.semanticscholar.org/crawler)
Mozilla/5.0 (compatible; YandexBot/3.0; +
http://yandex.com/bots)
Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; SiteAuditBot/0.97; +
http://www.semrush.com/bot.html)
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.5112.101 Mobile Safari/537.36 (compatible; Googlebot/2.1; +
http://www.google.com/bot.html)
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.5112.79 Mobile Safari/537.36 (compatible; Googlebot/2.1; +
http://www.google.com/bot.html)
Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+
https://webmaster.petalsearch.com/site/petalbot)
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15 (Applebot/0.1; +
http://www.apple.com/go/applebot)
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.5060.134 Safari/537.36
Mozilla/5.0 (Windows NT 10.0; Win64; x64; trendictionbot0.5.0; trendiction search;
http://www.trendiction.de/bot; please let us know of any problems; web at trendiction.com) Gecko/20170101 Firefox/67.0
serpstatbot/2.1 (advanced backlink tracking bot;
https://serpstatbot.com/;
abuse@serpstatbot.com)
I see quite a few in there that the forum software doesn't know about. As you can see, it's very easy to drown in this quagmire.