44 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 214,970+3987 | 3.37 GB | 31 Dec 2015 - 23:59 |
BaiDuSpider | 14,315 | 1.93 GB | 31 Dec 2015 - 23:57 |
Yahoo Slurp | 4,884+78 | 557.10 MB | 31 Dec 2015 - 23:55 |
Yandex bot | 12,913+261 | 1.52 GB | 31 Dec 2015 - 23:49 |
Unknown robot (identified by empty user agent string) | 33,981+27 | 476.75 MB | 31 Dec 2015 - 23:35 |
SeznamBot | 150+126 | 2.29 MB | 31 Dec 2015 - 23:22 |
Googlebot | 11,758+103 | 2.39 GB | 31 Dec 2015 - 23:17 |
Mail.ru bot | 6+8 | 39.39 KB | 31 Dec 2015 - 23:02 |
Unknown robot (identified by hit on 'robots.txt') | 0+305 | 71.18 KB | 31 Dec 2015 - 22:09 |
Unknown robot (identified by 'crawl') | 4,861+179 | 20.95 MB | 31 Dec 2015 - 18:48 |
Unknown robot (identified by 'spider') | 19+9 | 117.71 KB | 31 Dec 2015 - 18:44 |
Unknown robot (identified by 'robot') | 3,299+65 | 127.02 MB | 31 Dec 2015 - 18:38 |
Exabot | 49+18 | 291.38 KB | 31 Dec 2015 - 18:29 |
FaceBook bot | 93 | 1.10 MB | 31 Dec 2015 - 16:27 |
MJ12bot | 8,117+647 | 60.39 MB | 31 Dec 2015 - 11:17 |
FavIconizer | 37 | 229.46 KB | 31 Dec 2015 - 09:27 |
Java (Often spam bot) | 1,083 | 17.09 MB | 31 Dec 2015 - 06:40 |
Phantom | 123 | 2.01 MB | 31 Dec 2015 - 01:31 |
MSNBot-media | 19+11 | 481.59 KB | 30 Dec 2015 - 22:07 |
WGet tools | 3 | 7.96 MB | 30 Dec 2015 - 20:36 |
Nutch | 20+2 | 103.35 KB | 30 Dec 2015 - 13:43 |
WordPress | 41 | 682.29 KB | 30 Dec 2015 - 13:03 |
Unknown robot (identified by '*bot') | 60+4 | 339.53 KB | 30 Dec 2015 - 04:22 |
Heritrix | 10+10 | 129.05 KB | 28 Dec 2015 - 20:33 |
StackRambler | 536 | 31.84 MB | 28 Dec 2015 - 15:07 |
Sunrise | 23 | 203.61 KB | 27 Dec 2015 - 23:42 |
Y!J Yahoo Japan | 55+11 | 274.22 KB | 27 Dec 2015 - 02:08 |
HTTrack off-line browser | 2+1 | 13.24 KB | 27 Dec 2015 - 00:57 |
Alexa (IA Archiver) | 21+6 | 414.62 KB | 26 Dec 2015 - 00:51 |
SurveyBot | 3 | 19.48 KB | 24 Dec 2015 - 15:10 |
Perl tool | 3 | 62.55 KB | 23 Dec 2015 - 12:04 |
Web Core / Roots | 2 | 41.87 KB | 22 Dec 2015 - 04:50 |
mnoGoSearch search engine software | 1+1 | 6.44 KB | 21 Dec 2015 - 23:00 |
Unknown robot (identified by 'discovery') | 5 | 64.66 KB | 21 Dec 2015 - 15:26 |
MSIECrawler | 8 | 34.39 MB | 19 Dec 2015 - 09:56 |
Unknown robot (identified by 'scanner') | 1 | 20.64 KB | 19 Dec 2015 - 05:54 |
Powermarks | 5 | 88.37 KB | 19 Dec 2015 - 04:03 |
Netcraft | 4 | 44.06 KB | 14 Dec 2015 - 21:35 |
Python-urllib | 15+3 | 120.66 KB | 10 Dec 2015 - 14:42 |
yacy | 1 | 6.89 KB | 07 Dec 2015 - 16:01 |
CFNetwork | 4 | 10.75 KB | 07 Dec 2015 - 14:26 |
Jakarta commons-httpclient | 2 | 141.13 KB | 06 Dec 2015 - 06:31 |
SpiderBot | 42+14 | 251.43 KB | 04 Dec 2015 - 20:17 |
archive.org bot | 1+1 | 22.05 KB | 03 Dec 2015 - 04:57 |
|