| Crawler | | Visits |
|---|
| BLEXBot/1.0 | | 790 |
| DotBot/1.1 | | 262 |
| MJ12bot/v1.4.8 | | 177 |
| Cliqzbot/2.0 | | 160 |
| YandexBot/3.0 | | 109 |
| bingbot/2.0 | | 98 |
| MJ12bot/v1.4.7 | | 91 |
| SeznamBot/3.2 | | 83 |
| Googlebot/2.1 | | 61 |
| Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) | | 59 |
| Yahoo! Slurp | | 57 |
| Linux x86_64 | | 52 |
| Windows NT 10.0; WOW64 | | 49 |
| coccocbot-web/1.0 | | 44 |
| AhrefsBot/5.2 | | 39 |
| istellabot/t.1.13 | | 35 |
| ia_archiver | | 32 |
| proximic | | 29 |
| SemrushBot/1.2~bl | | 27 |
| BUbiNG (+http://law.di.unimi.it/BUbiNG.html) | | 27 |
| Windows NT 5.1; rv:6.0.2 | | 22 |
| GrapeshotCrawler/2.0 | | 20 |
| - | | 18 |
| Qwantify/2.4w | | 17 |
| CCBot/2.0 (http://commoncrawl.org/faq/) | | 17 |
| archive.org_bot | | 14 |
| U | | 9 |
| Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.95 Safari/537.36/Nutch-1.13 | | 9 |
| Win64 | | 8 |
| Clickagy Intelligence Bot v2 | | 8 |
| Exabot/3.0 | | 6 |
| SiteExplorer/1.1b | | 6 |
| linkdexbot/2.0 | | 5 |
| MSIE 9.0 | | 5 |
| MaxPointCrawler/Nutch-1.10 (maxpoint.crawler at maxpointinteractive dot com) | | 5 |
| http://search.aliveadvisor.com | | 4 |
| Macintosh; Intel Mac OS X 10_9_2 | | 4 |
| Steeler/3.5 | | 4 |
| oBot/2.3.1 | | 4 |
| spbot/5.0.3 | | 4 |
| Findxbot/1.0 | | 3 |
| amd64 Windows 2003 5.2 | | 3 |
| Intel Mac OS X 10.9 | | 3 |
| ltx71 - (http://ltx71.com/) | | 3 |
| Go-http-client/1.1 | | 3 |
| GarlikCrawler/1.2 (http://garlik.com/, crawler@garlik.com) | | 3 |
| MSIE 10.0 | | 3 |
| WOW64 | | 3 |
| Dataprovider.com | | 3 |
| compatible; special_archiver/3.1.1 +http://www.archive.org/details/archive.org_bot | | 2 |
| NTENTbot | | 2 |
| Windows NT 6.3; WOW64 | | 2 |
| X11; Linux x86_64 | | 2 |
| yoozBot-2.2 | | 2 |
| DomainStatsBot/1.0 (http://domainstats.io/our-bot) | | 2 |
| compatible; ips-agent | | 2 |
| Macintosh; Intel Mac OS X 10_12_6 | | 2 |
| SEOkicks-Robot | | 2 |
| SafeDNSBot (https://www.safedns.com/searchbot) | | 2 |
| nutch-1.4/Nutch-1.4 | | 1 |
| MojeekBot/0.6 | | 1 |
| CountBot/0.1 (+http://ehrsolution.de/crawler) | | 1 |
| Prlog/1.0 | | 1 |
| StorygizeBot | | 1 |
| Windows NT 6.1; rv:40.0 | | 1 |
| Windows NT 6.1; WOW64 | | 1 |
| Windows NT 6.1; rv:28.0 | | 1 |
| SurdotlyBot/1.0 | | 1 |
| Yeti/1.1 | | 1 |
| Googlebot | | 1 |
| MSIE 8.0 | | 1 |
| LinqiaCrawlerBot/1.0 (eng@linqia.com) | | 1 |
| Macintosh; Intel Mac OS X 10_9_3 | | 1 |
| Contacts-Crawler/0.2 (+http://www.scrapinghub.com) | | 1 |
| python-requests/2.10.0 | | 1 |
| Macintosh; Intel Mac OS X 10_11_4 | | 1 |
| compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot | | 1 |
| Jakarta Commons-HttpClient/3.1 | | 1 |
| DomainCrawler/3.0 (info@domaincrawler.com; http://www.domaincrawler.com/davekb.com) | | 1 |
| Python-urllib/2.7 | | 1 |
| IAS crawler (ias_crawler; http://integralads.com/site-indexing-policy/) | | 1 |
| rapidminer-web-mining-extension-crawler | | 1 |
| Intel Mac OS X 10.12 | | 1 |
| GetIntent Crawler (http://getintent.com/bot.html) | | 1 |
