| 40 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 2,739+65 | 610.42 MB | 30 Nov 2016 - 23:59 |
| Yandex bot | 10,071+238 | 1.26 GB | 30 Nov 2016 - 23:59 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1536 | 339.74 KB | 30 Nov 2016 - 23:55 |
| Unknown robot (identified by 'bot*') | 14,738+768 | 745.45 MB | 30 Nov 2016 - 23:55 |
| Googlebot | 8,702+58 | 2.66 GB | 30 Nov 2016 - 23:54 |
| Mail.ru bot | 4,021+138 | 403.28 MB | 30 Nov 2016 - 23:54 |
| Unknown robot (identified by empty user agent string) | 51,479+14 | 753.29 MB | 30 Nov 2016 - 23:52 |
| Unknown robot (identified by 'robot') | 3,319+64 | 90.79 MB | 30 Nov 2016 - 23:44 |
| Unknown robot (identified by '*bot') | 132+48 | 2.22 MB | 30 Nov 2016 - 23:24 |
| BaiDuSpider | 1,626+8 | 60.05 MB | 30 Nov 2016 - 23:14 |
| Python-urllib | 14 | 386.88 KB | 30 Nov 2016 - 23:08 |
| UniversalFeedParser | 600 | 12.88 MB | 30 Nov 2016 - 22:55 |
| MJ12bot | 2,593+173 | 30.75 MB | 30 Nov 2016 - 22:41 |
| StackRambler | 12 | 2.42 MB | 30 Nov 2016 - 22:30 |
| Feedfetcher-Google | 533 | 11.46 MB | 30 Nov 2016 - 22:18 |
| Unknown robot (identified by 'crawl') | 6,024+242 | 26.49 MB | 30 Nov 2016 - 20:22 |
| SeznamBot | 258+205 | 38.24 MB | 30 Nov 2016 - 19:41 |
| FavIconizer | 73 | 440.19 KB | 30 Nov 2016 - 18:13 |
| MSNBot-media | 316 | 1.42 MB | 30 Nov 2016 - 13:32 |
| Unknown robot (identified by 'spider') | 42+1 | 726.20 KB | 30 Nov 2016 - 12:57 |
| archive.org bot | 1+5 | 28.12 KB | 30 Nov 2016 - 10:07 |
| WGet tools | 16 | 384.90 KB | 30 Nov 2016 - 02:26 |
| Heritrix | 11+16 | 175.22 KB | 29 Nov 2016 - 16:40 |
| Unknown robot (identified by 'checker') | 457+1 | 2.25 MB | 29 Nov 2016 - 16:26 |
| Google AdSense | 4 | 35.82 KB | 29 Nov 2016 - 07:15 |
| Java (Often spam bot) | 995 | 17.53 MB | 28 Nov 2016 - 19:43 |
| Phantom | 110 | 233.97 MB | 28 Nov 2016 - 19:26 |
| Alexa (IA Archiver) | 52+21 | 927.73 KB | 28 Nov 2016 - 17:41 |
| CFNetwork | 34 | 1.22 MB | 28 Nov 2016 - 13:09 |
| FaceBook bot | 51 | 1.94 MB | 27 Nov 2016 - 20:15 |
| Sogou Spider | 14+9 | 64.85 KB | 27 Nov 2016 - 10:04 |
| Perl tool | 7 | 13.70 MB | 26 Nov 2016 - 21:34 |
| Raven Search | 1 | 0 | 26 Nov 2016 - 08:52 |
| SurveyBot | 2 | 13.52 KB | 26 Nov 2016 - 04:31 |
| Exabot | 43+11 | 319.06 KB | 23 Nov 2016 - 21:46 |
| Nutch | 1+1 | 6.85 KB | 19 Nov 2016 - 07:24 |
| Unknown robot (identified by 'discovery') | 2 | 40.46 KB | 18 Nov 2016 - 10:55 |
| Netcraft | 3 | 20.33 KB | 17 Nov 2016 - 01:04 |
| Unknown robot (identified by 'scanner') | 1 | 20.33 KB | 15 Nov 2016 - 18:52 |
| Web Core / Roots | 23 | 202.04 KB | 14 Nov 2016 - 13:26 |
|