42 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 84,584+393 | 1.30 GB | 31 Jul 2015 - 23:49 |
Unknown robot (identified by empty user agent string) | 31,882+28 | 504.07 MB | 31 Jul 2015 - 20:03 |
Unknown robot (identified by 'crawl') | 20,021+58 | 89.33 MB | 31 Jul 2015 - 10:12 |
MJ12bot | 12,155+2305 | 100.83 MB | 31 Jul 2015 - 22:58 |
Yandex bot | 10,669+245 | 529.70 MB | 31 Jul 2015 - 23:40 |
Googlebot | 8,622+63 | 1.52 GB | 31 Jul 2015 - 23:58 |
Mail.ru bot | 4,124+110 | 84.94 MB | 31 Jul 2015 - 23:55 |
Unknown robot (identified by 'robot') | 3,207+9 | 114.42 MB | 31 Jul 2015 - 16:47 |
BaiDuSpider | 2,636 | 700.66 MB | 31 Jul 2015 - 23:47 |
Heritrix | 1,840+5 | 21.93 MB | 18 Jul 2015 - 23:11 |
Yahoo Slurp | 1,696+23 | 215.68 MB | 31 Jul 2015 - 23:59 |
SeznamBot | 582+22 | 6.85 MB | 31 Jul 2015 - 21:35 |
FaceBook bot | 463 | 17.29 MB | 31 Jul 2015 - 23:04 |
Java (Often spam bot) | 310 | 5.97 MB | 28 Jul 2015 - 22:26 |
Unknown robot (identified by hit on 'robots.txt') | 0+283 | 73.70 KB | 31 Jul 2015 - 20:04 |
StackRambler | 154 | 2.19 MB | 02 Jul 2015 - 14:40 |
Phantom | 79 | 1.34 MB | 24 Jul 2015 - 05:43 |
Exabot | 54+8 | 284.09 KB | 30 Jul 2015 - 22:52 |
CFNetwork | 46 | 1.13 MB | 31 Jul 2015 - 10:45 |
Unknown robot (identified by 'spider') | 15+17 | 286.42 KB | 31 Jul 2015 - 23:16 |
FavIconizer | 31 | 321.10 KB | 30 Jul 2015 - 16:31 |
Unknown robot (identified by '*bot') | 29+1 | 179.90 KB | 06 Jul 2015 - 03:19 |
Alexa (IA Archiver) | 22+7 | 431.59 KB | 15 Jul 2015 - 21:38 |
Python-urllib | 20+1 | 127.86 KB | 21 Jul 2015 - 18:31 |
Y!J Yahoo Japan | 10+8 | 59.83 KB | 29 Jul 2015 - 13:51 |
Feedfetcher-Google | 18 | 386.33 KB | 31 Jul 2015 - 10:46 |
archive.org bot | 5+11 | 110.05 KB | 31 Jul 2015 - 14:16 |
WebFilter | 11+3 | 185.78 KB | 31 Jul 2015 - 10:46 |
MSNBot-media | 5+5 | 356.66 KB | 31 Jul 2015 - 09:59 |
MSIECrawler | 10 | 11.92 MB | 24 Jul 2015 - 04:45 |
Perl tool | 5 | 80.97 KB | 20 Jul 2015 - 13:28 |
Powermarks | 4 | 86.63 KB | 27 Jul 2015 - 02:03 |
SurveyBot | 4 | 26.45 KB | 30 Jul 2015 - 08:58 |
Unknown robot (identified by 'discovery') | 3 | 64.62 KB | 31 Jul 2015 - 15:10 |
Spiderman | 2+1 | 13.24 KB | 14 Jul 2015 - 13:11 |
Netcraft | 3 | 20.73 KB | 11 Jul 2015 - 00:22 |
NG 1.x (Exalead) | 2 | 33.04 KB | 19 Jul 2015 - 08:46 |
WGet tools | 2 | 84.69 KB | 04 Jul 2015 - 12:10 |
HTTrack off-line browser | 2 | 9.11 KB | 28 Jul 2015 - 23:39 |
Unknown robot (identified by 'scanner') | 1 | 20.73 KB | 14 Jul 2015 - 14:04 |
ActiveBookmark | 1 | 4.18 KB | 07 Jul 2015 - 00:39 |
larbin | 1 | 21.67 KB | 17 Jul 2015 - 08:31 |
|