40 different robots | Hits | Bandwidth | Last visit |
Mail.ru bot | 4,634+92 | 101.40 MB | 31 Jul 2016 - 23:57 |
Yahoo Slurp | 2,845+83 | 622.70 MB | 31 Jul 2016 - 23:56 |
Java (Often spam bot) | 1,334+2 | 29.75 MB | 31 Jul 2016 - 23:55 |
BaiDuSpider | 1,975+8 | 315.14 MB | 31 Jul 2016 - 23:49 |
Unknown robot (identified by 'bot*') | 21,875+1330 | 936.31 MB | 31 Jul 2016 - 23:48 |
Googlebot | 5,927+92 | 1.85 GB | 31 Jul 2016 - 23:22 |
Unknown robot (identified by empty user agent string) | 54,144+26 | 1.30 GB | 31 Jul 2016 - 23:19 |
Yandex bot | 12,945+103 | 472.17 MB | 31 Jul 2016 - 23:15 |
UniversalFeedParser | 398 | 8.43 MB | 31 Jul 2016 - 21:45 |
Unknown robot (identified by hit on 'robots.txt') | 0+770 | 192.87 KB | 31 Jul 2016 - 21:45 |
MJ12bot | 7,788+1509 | 59.02 MB | 31 Jul 2016 - 21:44 |
Unknown robot (identified by 'crawl') | 3,186+144 | 13.48 MB | 31 Jul 2016 - 21:34 |
Feedfetcher-Google | 494 | 9.85 MB | 31 Jul 2016 - 21:29 |
Unknown robot (identified by 'robot') | 3,408+37 | 75.28 MB | 31 Jul 2016 - 20:25 |
SeznamBot | 1,513+85 | 92.52 MB | 31 Jul 2016 - 20:11 |
Unknown robot (identified by '*bot') | 354+95 | 2.83 MB | 31 Jul 2016 - 19:57 |
MSNBot-media | 40 | 173.33 KB | 31 Jul 2016 - 17:41 |
FaceBook bot | 175 | 7.05 MB | 31 Jul 2016 - 11:27 |
Powermarks | 16 | 187.17 KB | 30 Jul 2016 - 19:54 |
Heritrix | 3+5 | 31.71 KB | 30 Jul 2016 - 18:08 |
Exabot | 23+15 | 136.93 KB | 30 Jul 2016 - 12:01 |
Unknown robot (identified by 'spider') | 7+15 | 48.88 KB | 30 Jul 2016 - 11:38 |
Spiderman | 1 | 6.65 KB | 30 Jul 2016 - 00:51 |
WGet tools | 7 | 149.82 KB | 29 Jul 2016 - 22:52 |
NG 1.x (Exalead) | 1 | 55.01 KB | 29 Jul 2016 - 15:27 |
Phantom | 187 | 2.70 MB | 28 Jul 2016 - 20:32 |
FavIconizer | 38 | 248.99 KB | 28 Jul 2016 - 14:52 |
Jakarta commons-httpclient | 6 | 808.61 KB | 28 Jul 2016 - 10:22 |
Alexa (IA Archiver) | 103+14 | 1.53 MB | 28 Jul 2016 - 00:50 |
archive.org bot | 188+6 | 11.51 MB | 27 Jul 2016 - 17:20 |
Unknown robot (identified by 'discovery') | 4 | 83.77 KB | 27 Jul 2016 - 08:51 |
Python-urllib | 4 | 26.85 KB | 26 Jul 2016 - 10:42 |
Raven Search | 1 | 0 | 26 Jul 2016 - 09:37 |
Nutch | 4+5 | 25.94 KB | 22 Jul 2016 - 07:30 |
Unknown robot (identified by 'scanner') | 1 | 20.84 KB | 19 Jul 2016 - 04:07 |
SurveyBot | 2 | 13.55 KB | 17 Jul 2016 - 01:45 |
Netcraft | 3 | 21.10 KB | 14 Jul 2016 - 21:39 |
Web Core / Roots | 1 | 22.18 KB | 06 Jul 2016 - 20:52 |
CFNetwork | 8 | 21.27 KB | 05 Jul 2016 - 16:01 |
Perl tool | 1 | 22.25 KB | 03 Jul 2016 - 20:17 |
|