43 different robots | Hits | Bandwidth | Last visit |
Googlebot | 8,576+73 | 3.03 GB | 30 Sep 2015 - 23:59 |
Yahoo Slurp | 4,856+76 | 690.68 MB | 30 Sep 2015 - 23:57 |
Unknown robot (identified by 'bot*') | 126,058+433 | 1.85 GB | 30 Sep 2015 - 23:57 |
Mail.ru bot | 2,855+83 | 57.29 MB | 30 Sep 2015 - 23:55 |
Yandex bot | 9,313+207 | 471.79 MB | 30 Sep 2015 - 23:35 |
CFNetwork | 74 | 201.80 KB | 30 Sep 2015 - 23:31 |
FaceBook bot | 366 | 3.32 MB | 30 Sep 2015 - 23:21 |
BaiDuSpider | 1,938 | 795.79 MB | 30 Sep 2015 - 23:05 |
Unknown robot (identified by 'robot') | 3,256+3 | 185.82 MB | 30 Sep 2015 - 23:04 |
Java (Often spam bot) | 1,097+1 | 17.67 MB | 30 Sep 2015 - 21:43 |
Unknown robot (identified by hit on 'robots.txt') | 0+574 | 151.99 KB | 30 Sep 2015 - 21:40 |
MJ12bot | 7,610+445 | 106.76 MB | 30 Sep 2015 - 21:35 |
Jakarta commons-httpclient | 14 | 216.50 KB | 30 Sep 2015 - 21:24 |
Unknown robot (identified by empty user agent string) | 34,702+16 | 732.24 MB | 30 Sep 2015 - 21:22 |
Python-urllib | 10 | 64.83 KB | 30 Sep 2015 - 21:06 |
Sift | 1 | 9.54 KB | 30 Sep 2015 - 21:05 |
Unknown robot (identified by '*bot') | 29+2 | 179.38 KB | 30 Sep 2015 - 21:03 |
Unknown robot (identified by 'crawl') | 5,658+123 | 24.61 MB | 30 Sep 2015 - 21:03 |
FavIconizer | 37 | 234.82 KB | 30 Sep 2015 - 20:07 |
Unknown robot (identified by 'discovery') | 4 | 66.65 KB | 30 Sep 2015 - 10:48 |
Unknown robot (identified by 'spider') | 26+15 | 147.04 KB | 29 Sep 2015 - 21:55 |
MSIECrawler | 2 | 12.60 MB | 29 Sep 2015 - 17:09 |
Exabot | 33+15 | 185.53 KB | 29 Sep 2015 - 12:19 |
Perl tool | 4 | 49.39 KB | 29 Sep 2015 - 12:03 |
SeznamBot | 499+17 | 4.46 MB | 29 Sep 2015 - 09:59 |
Heritrix | 5+6 | 73.10 KB | 28 Sep 2015 - 03:04 |
Custo | 1 | 5.75 KB | 26 Sep 2015 - 05:14 |
Y!J Yahoo Japan | 1+4 | 7.49 KB | 25 Sep 2015 - 19:35 |
WGet tools | 1 | 22.57 KB | 25 Sep 2015 - 06:32 |
SurveyBot | 3 | 20.40 KB | 25 Sep 2015 - 05:48 |
archive.org bot | 4+4 | 23.78 MB | 25 Sep 2015 - 03:57 |
WordPress | 42 | 711.20 KB | 23 Sep 2015 - 13:59 |
CsCrawler | 1+1 | 6.90 KB | 23 Sep 2015 - 06:07 |
MSNBot-media | 2+1 | 43.72 KB | 20 Sep 2015 - 10:14 |
Phantom | 124 | 2.08 MB | 18 Sep 2015 - 05:53 |
NG 1.x (Exalead) | 2 | 30.68 KB | 17 Sep 2015 - 03:04 |
Nutch | 3+5 | 21.34 KB | 15 Sep 2015 - 13:03 |
StackRambler | 48 | 746.93 KB | 12 Sep 2015 - 19:09 |
Web Core / Roots | 1 | 21.71 KB | 10 Sep 2015 - 17:24 |
Feedfetcher-Google | 1 | 17.88 KB | 10 Sep 2015 - 08:59 |
WebFilter | 8+1 | 71.81 KB | 10 Sep 2015 - 08:59 |
Alexa (IA Archiver) | 21+5 | 428.67 KB | 10 Sep 2015 - 08:17 |
Netcraft | 4 | 22.17 KB | 09 Sep 2015 - 12:26 |
|