User-agent: Acme.Spider 
User-agent: Ahoy! The Homepage Finder 
User-agent: Alkaline 
User-agent: Arachnophilia 
User-agent: ArchitextSpider 
User-agent: Aretha 
User-agent: ARIADNE 
User-agent: ASpider (Associative Spider) 
User-agent: Atomz.com Search Robot 
User-agent: AURESYS 
User-agent: BackRub 
User-agent: Big Brother 
User-agent: Bjaaland 
User-agent: BlackWidow 
User-agent: Die Blinde Kuh 
User-agent: bright.net caching robot 
User-agent: BSpider 
User-agent: CACTVS Chemistry Spider 
User-agent: Calif 
User-agent: Cassandra 
User-agent: Digimarc Marcspider/CGI 
User-agent: Checkbot 
User-agent: churl 
User-agent: CMC/0.01 
User-agent: Combine System 
User-agent: Conceptbot 
User-agent: Web Core / Roots 
User-agent: CS-HKUST WISE: WWW Index and Search Engine 
User-agent: Cusco 
User-agent: DeWeb(c) Katalog/Index 
User-agent: DienstSpider 
User-agent: Digital Integrity Robot 
User-agent: Direct Hit Grabber 
User-agent: DNAbot 
User-agent: DownLoad Express 
User-agent: DragonBot 
User-agent: DWCP (Dridus' Web Cataloging Project) 
User-agent: EbiNess 
User-agent: EIT Link Verifier Robot 
User-agent: Emacs-w3 Search Engine 
User-agent: ananzi 
User-agent: Esther 
User-agent: Evliya Celebi 
User-agent: nzexplorer 
User-agent: Fluid Dynamics Search Engine robot 
User-agent: Felix IDE 
User-agent: Wild Ferret Web Hopper #1, #2, #3 
User-agent: FetchRover 
User-agent: fido 
User-agent: Hämähäkki 
User-agent: KIT-Fireball 
User-agent: Fish search 
User-agent: Fouineur 
User-agent: Robot Francoroute 
User-agent: Freecrawl 
User-agent: FunnelWeb 
User-agent: gazz 
User-agent: GCreep 
User-agent: GetBot 
User-agent: GetURL 
User-agent: Golem 
User-agent: Googlebot 
User-agent: Grapnel/0.01 Experiment 
User-agent: Griffon 
User-agent: Gromit 
User-agent: Northern Light Gulliver 
User-agent: HamBot 
User-agent: Harvest 
User-agent: havIndex 
User-agent: HI (HTML Index) Search 
User-agent: Hometown Spider Pro 
User-agent: Wired Digital 
User-agent: ht://Dig 
User-agent: HTMLgobble 
User-agent: Hyper-Decontextualizer 
User-agent: IBM_Planetwide 
User-agent: Popular Iconoclast 
User-agent: Ingrid 
User-agent: Imagelock 
User-agent: IncyWincy 
User-agent: Informant 
User-agent: InfoSeek Robot 1.0 
User-agent: Infoseek Sidewinder 
User-agent: InfoSpiders 
User-agent: IntelliAgent 
User-agent: Iron33 
User-agent: Israeli-search 
User-agent: JavaBee 
User-agent: JCrawler 
User-agent: Jeeves 
User-agent: Jobot 
User-agent: JoeBot 
User-agent: The Jubii Indexing Robot 
User-agent: JumpStation 
User-agent: Katipo 
User-agent: KDD-Explorer 
User-agent: Kilroy 
User-agent: KO_Yappo_Robot 
User-agent: LabelGrabber 
User-agent: larbin 
User-agent: legs 
User-agent: Lockon 
User-agent: logo.gif Crawler 
User-agent: Lycos 
User-agent: Mac WWWWorm 
User-agent: Magpie 
User-agent: MediaFox 
User-agent: NEC-MeshExplorer 
User-agent: MindCrawler 
User-agent: moget 
User-agent: Motor 
User-agent: Muscat Ferret 
User-agent: Mwd.Search 
User-agent: NetCarta WebMap Engine 
User-agent: NetScoop 
User-agent: newscan-online 
User-agent: NHSE Web Forager 
User-agent: Nomad 
User-agent: The NorthStar Robot 
User-agent: Occam 
User-agent: HKU WWW Octopus 
User-agent: Orb Search 
User-agent: Pack Rat 
User-agent: PageBoy 
User-agent: Patric 
User-agent: The Peregrinator 
User-agent: PerlCrawler 1.0 
User-agent: Phantom 
User-agent: PiltdownMan 
User-agent: Pioneer 
User-agent: Portal Juice Spider 
User-agent: PGP Key Agent 
User-agent: PlumtreeWebAccessor 
User-agent: Poppi 
User-agent: PortalB Spider 
User-agent: The Python Robot 
User-agent: Raven Search 
User-agent: RBSE Spider 
User-agent: Resume Robot 
User-agent: RoadHouse Crawling System 
User-agent: Road Runner: The ImageScape Robot 
User-agent: Robbie the Robot 
User-agent: ComputingSite Robi/1.0 
User-agent: Roverbot 
User-agent: SafetyNet Robot 
User-agent: Scooter 
User-agent: Search.Aus-AU.COM 
User-agent: SearchProcess 
User-agent: Senrigan 
User-agent: SG-Scout 
User-agent: ShagSeeker 
User-agent: Shai'Hulud 
User-agent: Sift 
User-agent: Simmany Robot Ver1.0 
User-agent: Open Text Index Robot 
User-agent: SiteTech-Rover 
User-agent: Inktomi Slurp 
User-agent: Smart Spider 
User-agent: Snooper 
User-agent: Solbot 
User-agent: Spanner 
User-agent: spider_monkey 
User-agent: SpiderBot 
User-agent: SpiderMan 
User-agent: Spry Wizard Robot 
User-agent: Site Searcher 
User-agent: Suke 
User-agent: Sven 
User-agent: Tarantula 
User-agent: tarspider 
User-agent: Tcl W3 Robot 
User-agent: TechBOT 
User-agent: Templeton 
User-agent: TitIn 
User-agent: TITAN 
User-agent: The TkWWW Robot 
User-agent: UCSD Crawl 
User-agent: UdmSearch 
User-agent: URL Spider Pro 
User-agent: Valkyrie 
User-agent: Victoria 
User-agent: vision-search 
User-agent: Voyager 
User-agent: VWbot 
User-agent: W3M2 
User-agent: WebCatcher 
User-agent: WebCopy 
User-agent: webfetcher 
User-agent: The Webfoot Robot 
User-agent: WebMirror 
User-agent: WebQuest 
User-agent: WebReaper 
User-agent: webs 
User-agent: Websnarf 
User-agent: WebSpider 
User-agent: WebVac 
User-agent: webwalk 
User-agent: WebWalker 
User-agent: WebWatch 
User-agent: Wget 
User-agent: WhoWhere Robot 
User-agent: w3mir 
User-agent: WebStolperer 
User-agent: The Web Wombat 
User-agent: The World Wide Web Worm 
User-agent: WWWC Ver 0.2.5 
User-agent: WebZinger 
User-agent: XGET 
User-agent: Nederland.zoek 
Disallow: /linkspage.htm