| Crawler | | Visits |
|---|
| BLEXBot/1.0 | | 667 |
| MJ12bot/v1.4.8 | | 154 |
| Cliqzbot/1.0 | | 135 |
| SeznamBot/3.2 | | 133 |
| DotBot/1.1 | | 118 |
| bingbot/2.0 | | 109 |
| MJ12bot/v1.4.7 | | 90 |
| Googlebot/2.1 | | 86 |
| YandexBot/3.0 | | 72 |
| Yahoo! Slurp | | 67 |
| istellabot/t.1.13 | | 64 |
| Windows NT 10.0; WOW64 | | 54 |
| BUbiNG (+http://law.di.unimi.it/BUbiNG.html) | | 53 |
| proximic | | 50 |
| ia_archiver | | 38 |
| coccocbot-web/1.0 | | 38 |
| DeuSu/5.0.2 | | 37 |
| AhrefsBot/5.2 | | 37 |
| Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) | | 35 |
| Qwantify/2.4w | | 27 |
| GrapeshotCrawler/2.0 | | 23 |
| Baiduspider/2.0 | | 22 |
| WOW64 | | 22 |
| SemrushBot/1.2~bl | | 21 |
| archive.org_bot | | 20 |
| Windows NT 5.1; rv:6.0.2 | | 20 |
| Linux x86_64 | | 17 |
| Clickagy Intelligence Bot v2 | | 15 |
| SiteExplorer/1.1b | | 12 |
| U | | 9 |
| CCBot/2.0 (http://commoncrawl.org/faq/) | | 9 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.95 Safari/537.36/Nutch-1.13 | | 9 |
| Daum/4.1 | | 8 |
| Steeler/3.5 | | 7 |
| Exabot/3.0 | | 7 |
| istellabot/t.1 | | 6 |
| Plukkie/1.6 | | 6 |
| Windows NT 6.1; WOW64 | | 6 |
| Findxbot/1.0 | | 5 |
| GetIntent Crawler (http://getintent.com/bot.html) | | 5 |
| MSIE 10.0 | | 5 |
| linkdexbot/2.0 | | 5 |
| MaxPointCrawler/Nutch-1.10 (maxpoint.crawler at maxpointinteractive dot com) | | 5 |
| Dataprovider.com | | 4 |
| spbot/5.0.3 | | 4 |
| Windows NT 6.3; WOW64 | | 4 |
| Win64 | | 3 |
| Macintosh; Intel Mac OS X 10_12_3 | | 3 |
| Uptimebot/1.0 | | 3 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.95 Safari/537.36/Nutch-1.12 | | 3 |
| ltx71 - (http://ltx71.com/) | | 3 |
| Ubuntu | | 2 |
| IAS crawler (ias_crawler; http://integralads.com/site-indexing-policy/) | | 2 |
| Macintosh; Intel Mac OS X 10_11_6 | | 2 |
| MSIE 9.0 | | 2 |
| - | | 2 |
| Macintosh; Intel Mac OS X 10_9_2 | | 2 |
| SafeDNSBot (https://www.safedns.com/searchbot) | | 2 |
| GarlikCrawler/1.2 (http://garlik.com/, crawler@garlik.com) | | 2 |
| amd64 Windows 2003 5.2 | | 2 |
| Intel Mac OS X 10.9 | | 2 |
| oBot/2.3.1 | | 2 |
| Windows NT 5.1; rv:6.0 | | 2 |
| Macintosh; Intel Mac OS X 10_9_3 | | 2 |
| AwarioSmartBot/1.0 (+https://awario.com/bots.html; bots@awario.com) | | 2 |
| panscient.com | | 2 |
| SEOkicks-Robot | | 2 |
| SMTBot/1.0 | | 2 |
| linkdexbot/2.2 | | 2 |
| yoozBot-2.2 | | 2 |
| Macintosh; Intel Mac OS X 10_11_4 | | 1 |
| crawler4j (https://github.com/yasserg/crawler4j/) | | 1 |
| amd64 Linux 3.16.0-4-amd64 | | 1 |
| MegaIndex.ru/2.0 | | 1 |
| X11; Linux x86_64 | | 1 |
| YisouSpider | | 1 |
| compatible; ips-agent | | 1 |
| Nutch/Nutch-2.3.1 | | 1 |
| Windows NT 5.1 | | 1 |
| rogerbot/1.1 (http://moz.com/help/guides/search-overview/crawl-diagnostics#more-help, rogerbot-crawler+pr4-crawler-15@moz.com) | | 1 |
| netEstate NE Crawler (+http://www.website-datenbank.de/) | | 1 |
| Contacts-Crawler/0.1 (+http://www.scrapinghub.com) | | 1 |
| Wotbox/2.01 (+http://www.wotbox.com/bot/) | | 1 |
| Python-urllib/2.7 | | 1 |
| MSIE 7.0 | | 1 |
| psbot/0.1 (+http://www.picsearch.com/bot.html) | | 1 |
| Mozilla/5.0/Firefox/42.0 - nbertaupete95(at)gmail.com | | 1 |
| nutch-1.4/Nutch-1.4 | | 1 |
| Windows NT 6.1 | | 1 |
| Yeti/1.1 | | 1 |
| Prlog/1.0 | | 1 |
| Trident/7.0 | | 1 |
| SurdotlyBot/1.0 | | 1 |
| amd64 Linux 4.9.0-3-amd64 | | 1 |
| Aboundex/0.3 (http://www.aboundex.com/crawler/) | | 1 |
| http://temnos.com; rv:38.0 | | 1 |
