34 different robots | Hits | Bandwidth | Last visit |
Mail.ru bot | 4,958+572 | 1.50 GB | 30 Jun 2018 - 23:59 |
Googlebot | 12,980+59 | 4.04 GB | 30 Jun 2018 - 23:59 |
Java (Often spam bot) | 18,079+1 | 1.52 GB | 30 Jun 2018 - 23:57 |
Yandex bot | 12,818+551 | 2.56 GB | 30 Jun 2018 - 23:52 |
Unknown robot (identified by 'bot*') | 19,123+1807 | 825.13 MB | 30 Jun 2018 - 23:49 |
Unknown robot (identified by 'robot') | 5,002+59 | 504.33 MB | 30 Jun 2018 - 23:45 |
MJ12bot | 1,570+157 | 11.13 MB | 30 Jun 2018 - 23:40 |
Unknown robot (identified by hit on 'robots.txt') | 0+622 | 164.89 KB | 30 Jun 2018 - 23:36 |
UniversalFeedParser | 149 | 3.65 MB | 30 Jun 2018 - 23:29 |
Unknown robot (identified by empty user agent string) | 1,827+9 | 66.56 MB | 30 Jun 2018 - 23:14 |
SeznamBot | 1,586+299 | 112.77 MB | 30 Jun 2018 - 23:08 |
BaiDuSpider | 1,067+6 | 87.87 MB | 30 Jun 2018 - 22:59 |
Unknown robot (identified by '*bot') | 253+5 | 26.50 MB | 30 Jun 2018 - 22:37 |
Unknown robot (identified by 'crawl') | 15,649+138 | 520.88 MB | 30 Jun 2018 - 19:44 |
FavIconizer | 43 | 264.38 KB | 30 Jun 2018 - 18:04 |
Feedfetcher-Google | 9 | 207.27 KB | 30 Jun 2018 - 10:01 |
Alexa (IA Archiver) | 223+34 | 14.03 MB | 30 Jun 2018 - 06:12 |
Python-urllib | 230+2 | 5.43 MB | 30 Jun 2018 - 02:34 |
WGet tools | 6 | 170.19 KB | 29 Jun 2018 - 23:49 |
archive.org bot | 5+6 | 53.46 KB | 29 Jun 2018 - 10:18 |
Unknown robot (identified by 'spider') | 39+2 | 257.65 KB | 29 Jun 2018 - 10:07 |
Unknown robot (identified by 'discovery') | 9 | 187.58 KB | 28 Jun 2018 - 15:55 |
FaceBook bot | 85 | 1.63 MB | 28 Jun 2018 - 01:34 |
Phantom | 30 | 421.43 KB | 25 Jun 2018 - 18:21 |
MSIECrawler | 7 | 109.69 KB | 25 Jun 2018 - 11:33 |
Web Core / Roots | 17 | 15.15 MB | 25 Jun 2018 - 00:41 |
CFNetwork | 5 | 568.63 KB | 23 Jun 2018 - 23:07 |
Unknown robot (identified by 'checker') | 360+7 | 1.76 MB | 22 Jun 2018 - 17:00 |
MSNBot | 1 | 21.95 KB | 12 Jun 2018 - 15:57 |
BBot | 2 | 43.27 KB | 08 Jun 2018 - 10:51 |
Jakarta commons-httpclient | 1 | 168.80 KB | 03 Jun 2018 - 12:52 |
Netcraft | 1 | 21.13 KB | 02 Jun 2018 - 14:45 |
Yahoo Slurp | 1+1 | 4.54 KB | 02 Jun 2018 - 00:33 |
Heritrix | 1+1 | 24.72 KB | 01 Jun 2018 - 16:04 |
|