Page 1 of 1
Bots on forum
Posted:
Fri Nov 30, 2012 5:52 amby royalblue
Just making a list of the bots that stalk the forums, for the hell of it, but also since I saw a new one (google adsense) and now curious about how many there are. Got the idea?
1) Google
2) Bing
3) MSN
4) Yahoo
5) Google Adsense
Re: Bots on forum
Posted:
Fri Nov 30, 2012 7:31 amby Ratburntro44
There are a lot more of these, let's get a list... sorry about the extra stuff.
Google [Bot] Tue Nov 27, 2012 11:59 pm Deactivate Edit Delete
Bing [Bot] Fri Nov 23, 2012 10:20 pm Deactivate Edit Delete
AdsBot [Google] Never Deactivate Edit Delete
Alexa [Bot] Never Deactivate Edit Delete
Alta Vista [Bot] Never Deactivate Edit Delete
Ask Jeeves [Bot] Never Deactivate Edit Delete
Baidu [Spider] Never Deactivate Edit Delete
Exabot [Bot] Never Deactivate Edit Delete
FAST Enterprise [Crawler] Never Deactivate Edit Delete
FAST WebCrawler [Crawler] Never Deactivate Edit Delete
Francis [Bot] Never Deactivate Edit Delete
Gigabot [Bot] Never Deactivate Edit Delete
Google Adsense [Bot] Never Deactivate Edit Delete
Google Desktop Never Deactivate Edit Delete
Google Feedfetcher Never Deactivate Edit Delete
Heise IT-Markt [Crawler] Never Deactivate Edit Delete
Heritrix [Crawler] Never Deactivate Edit Delete
IBM Research [Bot] Never Deactivate Edit Delete
ICCrawler - ICjobs Never Deactivate Edit Delete
MSN NewsBlogs Never Deactivate Edit Delete
MSN [Bot] Never Deactivate Edit Delete
MSNbot Media Never Deactivate Edit Delete
Majestic-12 [Bot] Never Deactivate Edit Delete
Metager [Bot] Never Deactivate Edit Delete
NG-Search [Bot] Never Deactivate Edit Delete
Nutch [Bot] Never Deactivate Edit Delete
Nutch/CVS [Bot] Never Deactivate Edit Delete
OmniExplorer [Bot] Never Deactivate Edit Delete
Online link [Validator] Never Deactivate Edit Delete
SEO Crawler Never Deactivate Edit Delete
SEOSearch [Crawler] Never Deactivate Edit Delete
Seekport [Bot] Never Deactivate Edit Delete
Sensis [Crawler] Never Deactivate Edit Delete
Seoma [Crawler] Never Deactivate Edit Delete
Snappy [Bot] Never Deactivate Edit Delete
Steeler [Crawler] Never Deactivate Edit Delete
Synoo [Bot] Never Deactivate Edit Delete
Telekom [Bot] Never Deactivate Edit Delete
TurnitinBot [Bot] Never Deactivate Edit Delete
Voyager [Bot] Never Deactivate Edit Delete
W3 [Sitesearch] Never Deactivate Edit Delete
W3C [Linkcheck] Never Deactivate Edit Delete
W3C [Validator] Never Deactivate Edit Delete
WiseNut [Bot] Never Deactivate Edit Delete
YaCy [Bot] Never Deactivate Edit Delete
Yahoo MMCrawler [Bot] Never Deactivate Edit Delete
Yahoo Slurp [Bot] Never Deactivate Edit Delete
Yahoo [Bot] Never Deactivate Edit Delete
YahooSeeker [Bot] Never Deactivate Edit Delete
ichiro [Crawler] Never Deactivate Edit Delete
psbot [Picsearch] Never Deactivate Edit Delete
Re: Bots on forum
Posted:
Fri Nov 30, 2012 1:11 pmby Autumnwolf17
Yes... well... oh whoa that's a long list.
Oy, but are only some of them not on here?
Re: Bots on forum
Posted:
Fri Nov 30, 2012 5:12 pmby Joshua
Most of them are crawlers, which are a good thing.