- AhrefsBot
- LinkpadBot
- MJ12bot
- Baiduspider
- Riddler
- MegaIndex.ru
- SputnikBot
- msnbot
- Exabot
- DotBot
- wmaid
- statdom
- TurnitinBot
- Web-Monitoring
- 200PleaseBot
- SLCC2
- SV1
- MSIE\s6.1
- Ask\sJeeves
- HP\sWeb\sPrintSmart
- HTTrack
- IDBot
- Indy\sLibrary
- ListChecker
- MSIECrawler
- NetCache
- Nutch
- RPT-HTTPClient
- rulinki.ru
- Twiceler
- Webster\sPro
- www.cys.ru
- Wysigot
- Yeti
- Accoona
- CazoodleBot
- CFNetwork
- ConveraCrawler
- DISCo
- Download\sMaster
- FAST\sMetaWeb\sCrawler
- Flexum\sspider
- Gigabot
- HTMLParser
- Adsbot
- Barkrowler
- Konturbot
- ltx71
- GrapeshotCrawler
- SemrushBot-SA
- Seekport\Crawler
- Mediatoolkitbot
- SMTBot
- BluechipBacklinks
- ia_archiver
- ichiro
- IRLbot
- Java
- km.ru\sbot
- kmSearchBot
- libwww-perl
- Lupa.ru
- LWP::Simple
- lwp-trivial
- Missigua
- Offline\sExplorer
- OmniExplorer_Bot
- PEAR
- psbot
- Python
- rulinki.ru
- SMILE
- Speedy
- Teleport\sPro
- TurtleScanner
- voyager
- WebCopier
- WebData
- WebZIP
- Yanga
- Ezooms
- BLEXBot
- Spider/Bot
- SemrushBot
- DataForSeoBot
- MBCrawler
- YaK
- niraiya.com
- Cloudfind
- GetIntent\Crawler
- SafeDNSBot
- SeopultContentAnalyzer
- serpstatbot
- Slurp
- Rome\Client
- Scrapy
- FlipboardRSS
- FlipboardProxy
- Proximic\Bot
- ZoominfoBot
- SeznamBot
- Seekport\Crawler
- GeedoBot
- gptbot
- SiteAnalyzerbot
- Linguee
- archive.org_bot
- Amazonbot
- SeekportBot
