| 44 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'bot*') | 170,453+462 | 2.55 GB | 31 Oct 2015 - 23:59 |
| Unknown robot (identified by empty user agent string) | 28,567+26 | 398.41 MB | 31 Oct 2015 - 23:30 |
| Yandex bot | 15,226+224 | 1.12 GB | 31 Oct 2015 - 23:59 |
| Googlebot | 12,110+83 | 3.52 GB | 31 Oct 2015 - 23:59 |
| MJ12bot | 9,867+690 | 65.54 MB | 31 Oct 2015 - 23:33 |
| Yahoo Slurp | 3,589+68 | 418.51 MB | 31 Oct 2015 - 23:59 |
| Unknown robot (identified by 'crawl') | 2,733+126 | 11.52 MB | 31 Oct 2015 - 19:36 |
| Unknown robot (identified by 'robot') | 2,801+34 | 138.55 MB | 31 Oct 2015 - 23:41 |
| BaiDuSpider | 1,651 | 663.50 MB | 31 Oct 2015 - 23:31 |
| Java (Often spam bot) | 798+1 | 18.50 MB | 31 Oct 2015 - 07:38 |
| Unknown robot (identified by hit on 'robots.txt') | 0+675 | 125.75 KB | 31 Oct 2015 - 23:23 |
| Mail.ru bot | 464+47 | 7.09 MB | 23 Oct 2015 - 06:36 |
| FaceBook bot | 370 | 5.48 MB | 31 Oct 2015 - 12:35 |
| Phantom | 125 | 2.01 MB | 30 Oct 2015 - 07:07 |
| StackRambler | 102 | 1.91 MB | 30 Oct 2015 - 09:22 |
| Turn It In | 84+2 | 407.40 KB | 29 Oct 2015 - 23:15 |
| Exabot | 56+20 | 1.85 MB | 31 Oct 2015 - 22:25 |
| SeznamBot | 61+5 | 1.05 MB | 26 Oct 2015 - 10:20 |
| Jakarta commons-httpclient | 45 | 329.91 KB | 21 Oct 2015 - 21:51 |
| FavIconizer | 36 | 249.43 KB | 30 Oct 2015 - 00:56 |
| Y!J Yahoo Japan | 28+5 | 160.14 KB | 28 Oct 2015 - 19:19 |
| Nutch | 21+11 | 112.67 KB | 30 Oct 2015 - 11:30 |
| Unknown robot (identified by '*bot') | 28+1 | 160.16 KB | 06 Oct 2015 - 16:01 |
| Heritrix | 12+15 | 171.25 KB | 26 Oct 2015 - 02:59 |
| Unknown robot (identified by 'spider') | 12+10 | 61.66 KB | 29 Oct 2015 - 16:56 |
| MSNBot-media | 11+8 | 773.93 KB | 31 Oct 2015 - 13:12 |
| Python-urllib | 10 | 166.77 KB | 25 Oct 2015 - 20:09 |
| Unknown robot (identified by 'discovery') | 8 | 90.23 KB | 28 Oct 2015 - 23:49 |
| Perl tool | 8 | 86.92 KB | 26 Oct 2015 - 19:46 |
| WebFilter | 5+1 | 57.38 KB | 27 Oct 2015 - 21:48 |
| CFNetwork | 5 | 26.03 KB | 10 Oct 2015 - 23:43 |
| archive.org bot | 1+4 | 24.46 KB | 19 Oct 2015 - 14:11 |
| SurveyBot | 4 | 28.33 KB | 25 Oct 2015 - 08:03 |
| MSIECrawler | 4 | 27.71 MB | 21 Oct 2015 - 21:37 |
| Sift | 3 | 31.27 KB | 23 Oct 2015 - 20:27 |
| Feedfetcher-Google | 3 | 50.38 KB | 27 Oct 2015 - 22:10 |
| Netcraft | 3 | 23.08 KB | 10 Oct 2015 - 03:01 |
| Web Core / Roots | 2 | 45.35 KB | 31 Oct 2015 - 07:43 |
| Alexa (IA Archiver) | 1+1 | 14.60 KB | 09 Oct 2015 - 04:03 |
| NG 1.x (Exalead) | 1 | 22.24 KB | 22 Oct 2015 - 20:56 |
| TITAN | 1 | 7.12 KB | 02 Oct 2015 - 17:59 |
| Unknown robot (identified by 'scanner') | 1 | 22.82 KB | 16 Oct 2015 - 03:17 |
| Girafabot | 1 | 15.20 KB | 11 Oct 2015 - 13:37 |
| Google AdSense | 1 | 4.61 KB | 01 Oct 2015 - 15:15 |
|