| 42 different robots | Hits | Bandwidth | Last visit |
|---|
| Yandex bot | 15,348+234 | 1.95 GB | 30 Nov 2015 - 23:56 |
| BaiDuSpider | 2,428 | 745.34 MB | 30 Nov 2015 - 23:55 |
| Unknown robot (identified by 'bot*') | 205,299+1504 | 3.85 GB | 30 Nov 2015 - 23:53 |
| Unknown robot (identified by 'robot') | 3,076+47 | 142.38 MB | 30 Nov 2015 - 23:48 |
| Yahoo Slurp | 4,597+75 | 512.33 MB | 30 Nov 2015 - 23:41 |
| Googlebot | 7,192+83 | 1.86 GB | 30 Nov 2015 - 23:35 |
| Unknown robot (identified by empty user agent string) | 27,732+22 | 506.34 MB | 30 Nov 2015 - 21:32 |
| Unknown robot (identified by hit on 'robots.txt') | 0+530 | 119.63 KB | 30 Nov 2015 - 21:31 |
| Unknown robot (identified by 'crawl') | 3,043+139 | 12.54 MB | 30 Nov 2015 - 18:48 |
| Unknown robot (identified by 'spider') | 29+14 | 156.67 KB | 30 Nov 2015 - 18:36 |
| MJ12bot | 9,992+1442 | 75.60 MB | 30 Nov 2015 - 17:49 |
| Exabot | 24+15 | 121.87 KB | 30 Nov 2015 - 15:54 |
| FaceBook bot | 226 | 5.28 MB | 30 Nov 2015 - 15:47 |
| MSNBot-media | 10+9 | 1.30 MB | 30 Nov 2015 - 12:55 |
| Alexa (IA Archiver) | 3+3 | 42.22 KB | 30 Nov 2015 - 07:35 |
| FavIconizer | 28 | 181.87 KB | 29 Nov 2015 - 23:06 |
| Perl tool | 52 | 14.83 MB | 29 Nov 2015 - 21:36 |
| Java (Often spam bot) | 525+2 | 9.61 MB | 29 Nov 2015 - 16:30 |
| Nutch | 1+3 | 7.09 KB | 29 Nov 2015 - 03:20 |
| MSIECrawler | 2 | 20.99 KB | 29 Nov 2015 - 03:15 |
| Python-urllib | 5+1 | 191.24 KB | 28 Nov 2015 - 20:16 |
| SpiderBot | 87+55 | 531.25 KB | 28 Nov 2015 - 17:31 |
| Heritrix | 7+7 | 72.30 KB | 27 Nov 2015 - 22:59 |
| CFNetwork | 4 | 122.36 KB | 27 Nov 2015 - 10:47 |
| Phantom | 176 | 2.97 MB | 27 Nov 2015 - 07:14 |
| SeznamBot | 85+8 | 1.70 MB | 26 Nov 2015 - 13:58 |
| NG 1.x (Exalead) | 1 | 21.89 KB | 25 Nov 2015 - 23:04 |
| CsCrawler | 1+1 | 6.87 KB | 25 Nov 2015 - 09:22 |
| Unknown robot (identified by '*bot') | 60+2 | 399.55 KB | 24 Nov 2015 - 13:20 |
| SurveyBot | 3 | 20.52 KB | 24 Nov 2015 - 11:57 |
| Y!J Yahoo Japan | 2+5 | 14.60 KB | 23 Nov 2015 - 04:15 |
| Mail.ru bot | 1,827+93 | 115.78 MB | 22 Nov 2015 - 13:42 |
| Unknown robot (identified by 'discovery') | 6 | 67.09 KB | 19 Nov 2015 - 18:08 |
| archive.org bot | 0+4 | 1.38 KB | 17 Nov 2015 - 20:53 |
| Powermarks | 2 | 20.79 KB | 17 Nov 2015 - 19:55 |
| StackRambler | 24 | 307.79 KB | 17 Nov 2015 - 16:38 |
| Unknown robot (identified by 'scanner') | 1 | 22.47 KB | 16 Nov 2015 - 08:29 |
| Google AdSense | 2 | 10.02 KB | 11 Nov 2015 - 02:55 |
| WallPaper (alias crawlpaper) | 1 | 100.59 KB | 11 Nov 2015 - 02:18 |
| Netcraft | 16 | 267.40 KB | 08 Nov 2015 - 15:46 |
| Jakarta commons-httpclient | 1 | 135.92 KB | 04 Nov 2015 - 07:56 |
| Sift | 4 | 40.51 KB | 03 Nov 2015 - 22:21 |
|