!Susie (http://www.sync2it.com/susie) !Susie+(http://www.sync2it.com/susie) """Michael's Traffic Videos"" by Michael Cheney" """Michael's+Traffic+Videos""+by+Michael+Cheney" ">'> "Googlebot/2.1 ( http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.htm "Googlebot/2.1 ( http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html "Googlebot/2.1 (+http://www.googlebot.com/bot.html)" "GoogleBot/2.1" "Googlebot/2.1+(+http://googlebot.com/bot.html)" "Googlebot/2.1+(+http://www.google.com/bot.html)" "Googlebot/2.1+(+http://www.googlebot.com/bot.html)" "Googlebot/2.1+(+http://www.googlebot.com/bot.html)" Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) "Googlebot/2.1+(+http://www.googlebot.com/bot.html)"+Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html) "Googlebot/2.1+(+http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html "Googlebot/2.1+(+http://www.googlebot.com/bot.html)"Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html "Googlebot/2.1+(+http://www.googlebot.com/bot.html)"Mozilla/5.0+(compatible;+Googlebot/2.1;+http://www.google.com/bot.htm "Googlebot/2.1+(+http://www.googlebot.com/bot.html)"Mozilla/5.0+(compatible;+Googlebot/2.1;+http://www.google.com/bot.html "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" "Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)" "Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9b4pre) Gecko/2008021019 Fedora/2.0 "Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html)" "Mozilla/5.0+(compatible;+Googlebot/2.1;+http://www.google.com/bot.html)" "Mozilla/5.0+(X11;+U;+Linux+x86_64;+en-US;+rv:1.9b4pre)+Gecko/2008021019+Fedora/2.0 "Nokia6820/2.0 (4.83) Profile/MIDP-1.0 Configuration/CLDC-1.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)" "Nokia6820/2.0+(4.83)+Profile/MIDP-1.0+Configuration/CLDC-1.0+(compatible;+Googlebot-Mobile/2.1;++http://www.google.com/bot.html)" "Testbot/1.0 (compatible; Testbot/1.0; +http://www.testbot.com/bot.html "Testbot/1.0 (compatible; Testbot/1.0; +http://www.testbot.com/bot.html" "Testbot/1.0+(compatible;+Testbot/1.0;++http://www.testbot.com/bot.html "Testbot/1.0+(compatible;+Testbot/1.0;++http://www.testbot.com/bot.html" "YahooFeedSeeker/2.0+(compatible;+Mozilla+4.0;+MSIE+5.5;+http://publisher.yahoo.com/rssguide)" # UA "Googlebot/Test (+http://www.googlebot.com/bot.html)" # UA "Googlebot-Image/1.0" # UA "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" # UA "Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)" #+UA+"Googlebot/Test+(+http://www.googlebot.com/bot.html)" #+UA+"Googlebot-Image/1.0" #+UA+"Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html)" #+UA+"Mozilla/5.0+(compatible;+Googlebot/2.1;+http://www.google.com/bot.html)" #1 in Business Networking, www.MarcusWalker.ws #1+in+Business+Networking,+www.MarcusWalker.ws &I=F4750FF73B4079D9DD67B33448E2ED88-4FAA9F0878DA42FB-00C0DC9C8F282D2D-www.versionsofthebible.org ( Robots.txt Validator http://www.searchengineworld.com/cgi-bin/robotcheck.cgi ) (+http://www.google.com/bot.html) (+Robots.txt+Validator+http://www.searchengineworld.com/cgi-bin/robotcheck.cgi+) (compatible; Googlebot/2.1; +http://www.google.com/bot.html) (compatible;+Googlebot/2.1;++http://www.google.com/bot.html) (null) * Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) */Nutch-0.9-dev *+Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html) .................................................. ./bbl_list.pl/0.1 libwww-perl/5.805 ./bbl_list.pl/0.1+libwww-perl/5.805 .NET Framework Test Client .NET+Framework+Test+Client /usr/bss_miner/user_agents ::_detectURL '; DROP TABLE-- ">'>

I made you a cookie, but I eated it :( .

WebToaster - WebToaster V0.9 Alpha WebToaster+-+WebToaster+V0.9+Alpha Dan Matan's Site: Pharmacy, Economics, Efficiency, Mods & Random Thoughts Transfer Rome to Fiumicino Airport HTML Goodies List of Nickname NDSS.NL - Nintendo DS Scene Nederland Allez les verts But but but C'est pas footu Courbis fait son trou (de balle) Courbis pousse la balle un peu loin Elle est ou la baballe Foot de fou Fou de foot Vive le foot avec Courbis Mozilla/6.0 (Windows; U; Windows NT 5.1; ru; rv:1.9.0.1) Gecko/2008070208 Firefox/4 Courbis : Livres et logiciels gratuits, Meteo du RER, etc... Courbis : Livres et logiciels gratuits, Meteo du RER, etc... Courbis presente Voyage au centre de la HP28 Courbis presente Voyage au centre de la HP48 Courbis presents a Journey to the Center of the HP48 Courbis vous offre babel, un roman de science-fiction gratuit Courbis vous offre la meteo du RER Courbis, Acteur de l'Internet depuis 1988 Courbis, logiciels gratuits pour Pabx Alcatel 4400 Courbis, trucs et astuces pour la Varadero 125 Courbis, trucs et astuces pour le Tomtom Rider Forex Trading Network Organization (info@netforex.org) Forex Trading Network Organization info@netforex.org

DIY CUSTOM GRAPHICS ONLINE

(compatible; MSIE 6.0; Windows NT 5.1; SV1; Creative ZENcast v2.00.13) Dan+Matan's+Site:+Pharmacy,+Economics,+Efficiency,+Mods+&+Random+Thoughts Transfer+Rome+to+Fiumicino+Airport HTML+Goodies List+of+Nickname NDSS.NL+-+Nintendo+DS+Scene+Nederland Allez+les+verts But+but+but C'est+pas+footu Courbis+fait+son+trou+(de+balle) Courbis+pousse+la+balle+un+peu+loin Elle+est+ou+la+baballe Foot+de+fou Fou+de+foot Vive+le+foot+avec+Courbis Mozilla/6.0+(Windows;+U;+Windows+NT+5.1;+ru;+rv:1.9.0.1)+Gecko/2008070208+Firefox/4 Courbis,+Acteur+de+l'Internet+depuis+1988 Courbis,+logiciels+gratuits+pour+Pabx+Alcatel+4400 Courbis,+trucs+et+astuces+pour+la+Varadero+125 Courbis,+trucs+et+astuces+pour+le+Tomtom+Rider Courbis+:+Livres+et+logiciels++gratuits,+Meteo+du+RER,+etc... Courbis+:+Livres+et+logiciels+gratuits,+Meteo+du+RER,+etc... Courbis+presente+Voyage+au+centre+de+la+HP28 Courbis+presente+Voyage+au+centre+de+la+HP48 Courbis+presents+a+Journey+to+the+Center+of+the+HP48 Courbis+vous+offre+babel,+un+roman+de+science-fiction+gratuit Courbis+vous+offre+la+meteo+du+RER +Forex+Trading+Network+Organization++(info@netforex.org) +Forex+Trading+Network+Organization++info@netforex.org

DIY+CUSTOM+GRAPHICS+ONLINE

+(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+Creative+ZENcast+v2.00.13) Runnk RSS finder: http://www.runnk.com/il/law : Israeli legal : Mishpat : ????? ??? : ??? ????? +Runnk+RSS+finder:+http://www.runnk.com/il/law+:+Israeli+legal+:+Mishpat+:+?????+???+:+???+?????+ Sawah Bwowser V 1.59 (WinXP) Sawah+Bwowser+V+1.59+(WinXP) document.location.href='http://mrcbug.com' (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; +(compatible;+MSIE+7.0;+Windows+NT+5.1;+.NET+CLR+1.0.3705;+.NET+CLR+2.0.50727;+.NET+CLR+3.0.04506.30; (compatible; MSIE 7.0; Windows NT 5.1; Avant Browser; .NET CLR 1.1.4322) +(compatible;+MSIE+7.0;+Windows+NT+5.1;+Avant+Browser;+.NET+CLR+1.1.4322) (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; FDM) (compatible; MSIE 7.0; Windows NT 5.1; FunWebProducts; .NET CLR 1.1.4322) (compatible; MSIE 7.0; Windows NT 6.0; SV1; SLCC1; .NET CLR 2.0.50727; Media Center PC 5.0; .NET CLR 3.0.04506; InfoPath.2; .NET CLR 1.1.4322) +(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+.NET+CLR+1.1.4322;+FDM) +(compatible;+MSIE+7.0;+Windows+NT+5.1;+FunWebProducts;+.NET+CLR+1.1.4322) +(compatible;+MSIE+7.0;+Windows+NT+6.0;+SV1;+SLCC1;+.NET+CLR+2.0.50727;+Media+Center+PC+5.0;+.NET+CLR+3.0.04506;+InfoPath.2;+.NET+CLR+1.1.4322) (compatible; MSIE 6.0; Windows NT 5.1; SV1) (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; InfoPath.1; .NET CLR 2.0.50727) (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322) (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 1.0.3705; InfoPath.1) (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; InfoPath.1) (compatible; MSIE 6.0; Windows NT 5.1; SV1; FDM) (compatible; MSIE 6.0; Windows NT 5.1; SV1; SU 3.011; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ) (compatible; MSIE 7.0; Windows NT 5.1) (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322) (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30) (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.1) (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.2) (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322; .NET CLR 3.0.04506.30) +(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1) +(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+.NET+CLR+1.0.3705;+.NET+CLR+1.1.4322;+InfoPath.1;+.NET+CLR+2.0.50727) +(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+.NET+CLR+1.1.4322) +(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+.NET+CLR+1.1.4322;+.NET+CLR+1.0.3705;+InfoPath.1) +(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+.NET+CLR+1.1.4322;+.NET+CLR+2.0.50727) +(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+.NET+CLR+1.1.4322;+InfoPath.1) +(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+FDM) +(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+SU+3.011;+Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1)+) +(compatible;+MSIE+7.0;+Windows+NT+5.1) +(compatible;+MSIE+7.0;+Windows+NT+5.1;+.NET+CLR+1.1.4322) +(compatible;+MSIE+7.0;+Windows+NT+5.1;+.NET+CLR+1.1.4322;+.NET+CLR+2.0.50727) +(compatible;+MSIE+7.0;+Windows+NT+5.1;+.NET+CLR+1.1.4322;+.NET+CLR+2.0.50727;+.NET+CLR+3.0.04506.30) +(compatible;+MSIE+7.0;+Windows+NT+5.1;+.NET+CLR+1.1.4322;+.NET+CLR+2.0.50727;+InfoPath.1) +(compatible;+MSIE+7.0;+Windows+NT+5.1;+.NET+CLR+1.1.4322;+.NET+CLR+2.0.50727;+InfoPath.2) +(compatible;+MSIE+7.0;+Windows+NT+5.1;+.NET+CLR+2.0.50727;+.NET+CLR+1.1.4322;+.NET+CLR+3.0.04506.30) 123spider-(Version: 1.02, powered by www.123spider.de 123spider-(Version:+1.02,+powered+by+www.123spider.de 123spider-Bot (Version: 1.02, powered by www.123spider.de 123spider-Bot+(Version:+1.02,+powered+by+www.123spider.de 192.comAgent 4.1.0 Profile 4.1.0+Profile 4.Platz im GIGA-Homepage-Award - http://www.computerproblemboard.de 4.Platz+im+GIGA-Homepage-Award+-+http://www.computerproblemboard.de 411.info 411.info Crawler (http://411.info) 411.info WebBot/0.1 (http://411.info/) 411.info+Crawler+(http://411.info) 411.info+WebBot/0.1+(http://411.info/) 66.249.64.13 - crawl-66-249-64-13.googlebot.com 66.249.64.13+-+crawl-66-249-64-13.googlebot.com 8484 Boston Project v 1.0 8484+Boston+Project+v+1.0 8bo Crawler Bot 8bo+Crawler+Bot “Googlebot/2.1+(+http://www.google.com/bot.html)" “Googlebot/2.1+(+http://www.google.com/bot.html)” “Googlebot/2.1+(+http://www.google.com/bot.html)”. “Googlebot/2.1+(+http://www.googlebot.com/bot.html)” “Googlebot/2.1+(+http://www.googlebot.com/bot.html)” Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) “Googlebot/2.1+(+http://www.googlebot.com/bot.html)”+Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html) A1 Keyword Research/1.0.2 (+http://www.micro-sys.dk/products/keyword-research/) miggibot/2007.03.27 A1 Sitemap Generator/1.4.9 (+http://www.micro-sys.dk/products/sitemap-generator/) miggibot/2007.07.09 A1+Keyword+Research/1.0.2+(+http://www.micro-sys.dk/products/keyword-research/)+miggibot/2007.03.27 A1+Sitemap+Generator/1.4.9+(+http://www.micro-sys.dk/products/sitemap-generator/)+miggibot/2007.07.09 abc/Nutch-0.9-dev (abc; http://abc#11.us; abc at abc dot com) abc/Nutch-0.9-dev+(abc;+http://abc#11.us;+abc+at+abc+dot+com) ABCdatos BotLink/1.0.2 (test links) ABCdatos+BotLink/1.0.2+(test+links) abot/0.1 (abot; http://www.abot.com; abot@abot.com) abot/0.1+(abot;+http://www.abot.com;+abot@abot.com) AcadiaUniversityWebCensusClient Accoona-AI-Agent/1.1.1 (crawler at accoona dot com) Accoona-AI-Agent/1.1.1+(crawler+at+accoona+dot+com) Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com) Accoona-AI-Agent/1.1.2 (aicrawler at accoonadot com) Accoona-AI-Agent/1.1.2+(aicrawler+at+accoonabot+dot+com) Accoona-AI-Agent/1.1.2+(aicrawler+at+accoonadot+com) Ace Explorer Ace+Explorer AcoiRobot Acoon Robot v1.01 (www.acoon.de) Acoon+Robot+v1.01+(www.acoon.de) Acoon-Robot 4.0.0RC2 (http://www.acoon.de) Acoon-Robot 4.0.1 (http://www.acoon.de) Acoon-Robot 4.0.2.17 (http://www.acoon.de) Acoon-Robot+4.0.0RC2+(http://www.acoon.de) Acoon-Robot+4.0.1+(http://www.acoon.de) Acoon-Robot+4.0.2.17+(http://www.acoon.de) Acorn/Nutch-0.9 (Non-Profit Search Engine; acorn.isara.org; acorn at isara dot org) Acorn/Nutch-0.9+(Non-Profit+Search+Engine;+acorn.isara.org;+acorn+at+isara+dot+org) Ad Muncher v4.7 Build 27105/1371 Ad Muncher v4.72 Build 30400/1967 Ad+Muncher+v4.7+Build+27105/1371 Ad+Muncher+v4.72+Build+30400/1967 AdsBot-Google AdsBot-Google (+http://www.google.com/adsbot.html) AdsBot-Google+(+http://www.google.com/adsbot.html) AdSenserBot africa/Nutch-0.9 (africa; localhost; localhost) africa/Nutch-0.9+(africa;+localhost;+localhost) AgentName/0.1libwww-perl/5.805 'Ahoy! The Homepage Finder' 'Ahoy!+The+Homepage+Finder' AIBOT/2.1 By +(www.21seek.com , A Real artificial intelligence search engine , China) AIBOT/2.1 By +(www.21seek.com A Real artificial intelligence search engine China) AIBOT/2.1+By++(www.21seek.com+,+A+Real+artificial+intelligence+search+engine+,+China) AIBOT/2.1+By++(www.21seek.com+A+Real+artificial+intelligence+search+engine+China) AideRSS/1.0 (aiderss.com) AideRSS/1.0+(aiderss.com) aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com) aipbot/1.0+(aipbot;+http://www.aipbot.com;+aipbot@aipbot.com) aipbot/2 (aipbot; http://www.aipbot.com; aipbot@aipbot.com) aipbot/2+(aipbot;+http://www.aipbot.com;+aipbot@aipbot.com) aipbot/2-beta (aipbot dev; http://aipbot.com; aipbot@aipbot.com) aipbot/2-beta (aipdev; http://aipbot.com; aipbot@aipbot.com) aipbot/2-beta+(aipbot+dev;+http://aipbot.com;+aipbot@aipbot.com) aipbot/2-beta+(aipdev;+http://aipbot.com;+aipbot@aipbot.com) AISearchBot (Email: aisearchbot@gmail.com; If your web site doesn't want to be crawled, please send us a email.) AISearchBot (Email: aisearchbot@gmail.com; We love searching and we'll stop crawling immediately depending on your attitude.) AISearchBot+(Email:+aisearchbot@gmail.com;+If+your+web+site+doesn't+want+to+be+crawled,+please+send+us+a+email.) AISearchBot+(Email:+aisearchbot@gmail.com;+We+love+searching+and+we'll+stop+crawling+immediately+depending+on+your+attitude.) AITCSRobot/1.1 ajSitemap ( www.web-max.ca/freeware/ajSitemap ) ajSitemap+(+www.web-max.ca/freeware/ajSitemap+) ajyuldpgw jybkvpfcqwjnweddwuB ajyuldpgw+jybkvpfcqwjnweddwuB AKHBOT/1.1 (compatible; MSIE 7.0; Windows NT 6.0) AKHBOT/1.1+(compatible;+MSIE+7.0;+Windows+NT+6.0) alef/0.0 AlexfDownload AlkalineBOT Allrati/1.1 (+) Allrati/1.1+(+) ALTAB/forum.alta.bz - 31337 Proxy - Freedom For All (Linux; Intel) all ALTAB/forum.alta.bz+-+31337+Proxy+-+Freedom+For+All+(Linux;+Intel)+all AltaVista Intranet V1.0 AltaVista Search Intranet PX V1.0 webmaster@messebasel.ch AltaVista Intranet V1.0 bluewindow.ch webmaster@bluewin.ch AltaVista Intranet V1.0 pta.at webmaster@pta.at AltaVista Intranet V1.0 Re-Index webmaster@bluewin.ch AltaVista Intranet V2.0 Compaq Altavista Eval sveand@altavista.net AltaVista Intranet V2.0 pta.at webmaster@pta.at AltaVista Intranet V2.0 Sear.ch ccc@bluewin.ch AltaVista Intranet V2.0 www.altavista.de search-support@altavista.de AltaVista+Intranet+V1.0+AltaVista+Search+Intranet+PX+V1.0+webmaster@messebasel.ch AltaVista+Intranet+V1.0+bluewindow.ch+webmaster@bluewin.ch AltaVista+Intranet+V1.0+pta.at+webmaster@pta.at AltaVista+Intranet+V1.0+Re-Index+webmaster@bluewin.ch AltaVista+Intranet+V2.0+Compaq+Altavista+Eval+sveand@altavista.net AltaVista+Intranet+V2.0+pta.at+webmaster@pta.at AltaVista+Intranet+V2.0+Sear.ch+ccc@bluewin.ch AltaVista+Intranet+V2.0+www.altavista.de+search-support@altavista.de Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com) Amfibibot/0.07+(Amfibi+Robot;+http://www.amfibi.com;+agent@amfibi.com) amibot - http://www.amidalla.de - tech@amidalla.com libwww-perl/5.805 amibot+-+http://www.amidalla.de+-+tech@amidalla.com+libwww-perl/5.805 Amit Singh/Nutch-0.9 (Amit Singh; www.cse.iitb.ac.in/~amitsingh; amitsingh@gmail.com) Amit+Singh/Nutch-0.9+(Amit+Singh;+www.cse.iitb.ac.in/~amitsingh;+amitsingh@gmail.com) Anon/1.0 AnswerBus (http://www.answerbus.com/) AnswerBus+(http://www.answerbus.com/) AnthillV1.1 Anti-XBOCT/2007 [xxx] (OS; X; JU) Anti-XBOCT/2007+[xxx]+(OS;+X;+JU) AnzwersCrawl/2.0 (anzwerscrawl@anzwers.com.au; http://faq.anzwers.com.au/anzwerscrawl.html) AnzwersCrawl/2.0+(anzwerscrawl@anzwers.com.au;+http://faq.anzwers.com.au/anzwerscrawl.html) AOL_Daniel_Clark_Spider/Nutch-0.9 (AOL Search; danielaclark1@aol.com) AOL_Daniel_Clark_Spider/Nutch-0.9+(AOL+Search;+danielaclark1@aol.com) Apache Apexoo Spider 1.0 Apexoo Spider 1.1 Apexoo+Spider+1.0 Apexoo+Spider+1.1 appie 1.1 (www.walhello.com) appie/1.1 appie+1.1+(www.walhello.com) AppleSyndication/54 AR Araby(compatible; Mozilla/5.0; GoogleBot; FAST Crawler 6.4; http://www.araby.com;) Araby(compatible;+Mozilla/5.0;+GoogleBot;+FAST+Crawler+6.4;+http://www.araby.com;) ArabyBot (compatible; Mozilla/5.0; GoogleBot; FAST Crawler 6.4; http://www.araby.com;) ArabyBot+(compatible;+Mozilla/5.0;+GoogleBot;+FAST+Crawler+6.4;+http://www.araby.com;) Arachnoidea (arachnoidea@euroseek.com) Arachnoidea+(arachnoidea@euroseek.com) Arachnophilia Araneo/0.7 (araneo@esperantisto.net; http://esperantisto.net) Araneo/0.7+(araneo@esperantisto.net;+http://esperantisto.net) aranhabot AraybOt/1.0 (+http://www.araykoo.com/araybot.html) AraybOt/1.0+(+http://www.araykoo.com/araybot.html) ArchitextSpider archive.org_bot aria2 arks/1.0 ASAHA Search Engine Turkey V.001 (http://www.asaha.com/) ASAHA+Search+Engine+Turkey+V.001+(http://www.asaha.com/) asked/Nutch-0.8 (web crawler; http://asked.jp; epicurus at gmail dot com) asked/Nutch-0.8+(web+crawler;+http://asked.jp;+epicurus+at+gmail+dot+com) ASpider/0.09 asterias/2.02 ATN_Worldwide Atomic_Email_Hunter/4.0 Atomz/1.0 Attentio/Nutch-0.9-dev (Attentio's beta blog crawler; www.attentio.com; info@attentio.com) Attentio/Nutch-0.9-dev+(Attentio's+beta+blog+crawler;+www.attentio.com;+info@attentio.com) Attributor.comBot Attributor/Dejan-1.0-dev (Test crawler; http://www.attributor.com; info at attributor com) Attributor/Dejan-1.0-dev+(Test+crawler;+http://www.attributor.com;+info+at+attributor+com) Attributor/Nutch-1.0-dev (Test crawler; http://www.attributor.com; info at attributor com) Attributor/Nutch-1.0-dev+(Test+crawler;+http://www.attributor.com;+info+at+attributor+com) AURESYS/1.0 AurNet07 autokrawl 'autokrawl' autowebdir 1.1 (www.autowebdir.com) autowebdir+1.1+(www.autowebdir.com) aWapClient Axmorobot indexing your site for search.axmo.com - World Wide Search Engine from Axmo.com Axmorobot+indexing+your+site+for+search.axmo.com+-+World+Wide+Search+Engine+from+Axmo.com Axmoroindexing your site for search.axmo.com - World Wide Search Engine from Axmo.com Axmoroindexing+your+site+for+search.axmo.com+-+World+Wide+Search+Engine+from+Axmo.com axounwjqiteIye hnfa7hjohsnyjpptgpyubwl axounwjqiteIye+hnfa7hjohsnyjpptgpyubwl aXqmgmnrfwty 3kXiinaawafaokxj aXqmgmnrfwty+3kXiinaawafaokxj baa [the_sheep] baa+[the_sheep] BaboomBot/1.[0-255].[0-255] (\+http://www.baboom.us) BaboomBot/1.[0-255].[0-255]+(\+http://www.baboom.us) Baiduspider ( http://www.baidu.com/search/spider.htm) Baiduspider ( http://www.baidu.com/search/spider_jp.html) BaiduSpider+ (+; http://www.baidu.com/search/spider.htm; Ubuntu; Compatible; Version; Platform; .NET CLR 2.0.50727; Version) Baiduspider+ (+http://www.baidu.com/search/spider_jp.html; MSIE 7.0; Windows NT 6.0; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; SLCC1; .NET CLR 2.0.50727; .NET CLR 3.0.04506; MEGAUPLOAD Baiduspider+(+http://help.baidu.jp/system/05.html) Baiduspider+(+http://www.baidu.com/search/spider.htm) Baiduspider+(+http://www.baidu.com/search/spider_jp.html Baiduspider+(+http://www.baidu.com/search/spider_jp.html) BaiduSpider++(+;+http://www.baidu.com/search/spider.htm;+Ubuntu;+Compatible;+Version;+Platform;+.NET+CLR+2.0.50727;+Version) Baiduspider++(+http://www.baidu.com/search/spider_jp.html;+MSIE+7.0;+Windows+NT+6.0;+Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1)+;+SLCC1;+.NET+CLR+2.0.50727;+.NET+CLR+3.0.04506;+MEGAUPLOAD baiduspider-mobile-gate Balihoo/Nutch-1.0-dev (Crawler for Balihoo.com search engine - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com) Balihoo/Nutch-1.0-dev+(Crawler+for+Balihoo.com+search+engine+-+obeys+robots.txt+and+robots+meta+tags+;+http://balihoo.com/index.aspx;+robot+at+balihoo+dot+com) Barca/2.0.xxxx Basalt v090b Basalt+v090b BatchScan BaySpider bbot/0.100 BDFetch beast/Nutch-0.9 (agentspider; beast@mail.com) beast/Nutch-0.9+(agentspider;+beast@mail.com) BebopBot/2.5.1 ( crawler http://www.apassion4jazz.net/bebopbot.html ) BebopBot/2.5.1+(+crawler+http://www.apassion4jazz.net/bebopbot.html+) BeckyBot/2.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322) BeckyBot/2.0+(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+.NET+CLR+1.1.4322) bender/Nutch-0.8.1 (myd@cs.stanford.edu) bender/Nutch-0.8.1+(myd@cs.stanford.edu) betaBot Big Brother Big+Brother Biglotron-3.01 larbin2.6.3@unspecified.mail Biglotron-3.01 robot@too.org Biglotron-3.01+larbin2.6.3@unspecified.mail Biglotron-3.01+robot@too.org Bigsearch.ca/Nutch-0.9-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com) Bigsearch.ca/Nutch-0.9-dev+(Bigsearch.ca+Internet+Spider;+http://www.bigsearch.ca/;+info@enhancededge.com) Bigsearch.ca/Nutch-1.0-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com) Bigsearch.ca/Nutch-1.0-dev+(Bigsearch.ca+Internet+Spider;+http://www.bigsearch.ca/;+info@enhancededge.com) BilgiBot/1.0(beta) (http://www.bilgi.com/; bilgi at bilgi dot com) BilgiBot/1.0(beta)+(http://www.bilgi.com/;+bilgi+at+bilgi+dot+com) Bimbot/1.0 BinGet/1.00.A (http://www.bin-co.com/php/scripts/load/) BinGet/1.00.A+(http://www.bin-co.com/php/scripts/load/) BitvoUserAgent (+http://www.bitvo.com) Bitvo/0.9b BitvoUserAgent+(+http://www.bitvo.com)+Bitvo/0.9b Biyubi/x.x (Sistema Fenix; G11; Familia Toledo; es-mx) Biyubi/x.x+(Sistema+Fenix;+G11;+Familia+Toledo;+es-mx) Bjaaland/0.5 BKA WebSiteChecker/0.98-20080419 BKA+WebSiteChecker/0.98-20080419 BLA blackspider BlackWidow Blaiz-Bee/2.00.5502 (+http://www.blaiz.net) Blaiz-Bee/2.00.5502+(+http://www.blaiz.net) Blaiz-Bee/2.00.5622 (+http://www.blaiz.net) Blaiz-Bee/2.00.5622+(+http://www.blaiz.net) Blaiz-Bee/2.00.5655 (+http://www.blaiz.net) Blaiz-Bee/2.00.5655+(+http://www.blaiz.net) Blaiz-Bee/2.00.6082 (+http://www.blaiz.net) Blaiz-Bee/2.00.6082+(+http://www.blaiz.net) Blaiz-Bee/2.00.8315 (BE Internet Search Engine http://www.rawgrunt.com) Blaiz-Bee/2.00.8315+(BE+Internet+Search+Engine+http://www.rawgrunt.com) bleeding-sucker-bot (+http://www.suckingbleeder.org) bleeding-sucker-bot+(+http://www.suckingbleeder.org) Blern 1.4 Blern+1.4 blind-dice BlockNote.Net Blog Conversation Project; blogs@iq.harvard.edu; http://gking.harvard.edu/blogconv/ Blog+Conversation+Project;+blogs@iq.harvard.edu;+http://gking.harvard.edu/blogconv/ BlogBridge 3.0.1 Discoverer (http://www.blogbridge.com/) BlogBridge 4.0 Discoverer (http://www.blogbridge.com/) Java/1.5.0_03 BlogBridge Service (http://www.blogbridge.com/) Java/1.5.0_09 BlogBridge+3.0.1+Discoverer+(http://www.blogbridge.com/) BlogBridge+4.0+Discoverer+(http://www.blogbridge.com/)+Java/1.5.0_03 BlogBridge+Service+(http://www.blogbridge.com/)+Java/1.5.0_09 BlogCorpusCrawler 1.414213 BlogCorpusCrawler+1.414213+ Bloglines/2.1 (http://www.bloglines.com; xx subscribers) Bloglines/2.1+(http://www.bloglines.com;+xx+subscribers) Bloglines/3.1 (http://www.bloglines.com) Bloglines/3.1+(http://www.bloglines.com) BlogPulseLive (support@blogpulse.com) BlogPulseLive+(support@blogpulse.com) BlogRangerCrawler/1.0 BlogSearch/1.0 +http://www.icerocket.com/ BlogSearch/1.0++http://www.icerocket.com/ blogsearchbot-pumpkin-2 BloobyBot Bloodhound/Nutch-0.9 (Testing Crawler for Research - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; roat balihoo dot com) Bloodhound/Nutch-0.9 (Testing Crawler for Research - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com) Bloodhound/Nutch-0.9+(Testing+Crawler+for+Research+-+obeys+robots.txt+and+robots+meta+tags+;+http://balihoo.com/index.aspx;+roat+balihoo+dot+com) Bloodhound/Nutch-0.9+(Testing+Crawler+for+Research+-+obeys+robots.txt+and+robots+meta+tags+;+http://balihoo.com/index.aspx;+robot+at+balihoo+dot+com) Blubberlutsch/1.0 BlueDragon BND WebSiteChecker/0.95-20080408 BND+WebSiteChecker/0.95-20080408 bob/Nutch-0.9 (bob; http://www.google.com; x@y) bob/Nutch-0.9+(bob;+http://www.google.com;+x@y) BobCrawl/Nutch-0.9 (Test/Development crawler; http://notavalable.com; notavailable@notavailable.com) BobCrawl/Nutch-0.9+(Test/Development+crawler;+http://notavalable.com;+notavailable@notavailable.com) boitho.com-dc/0.82 ( http://www.boitho.com/dcbot.html ) boitho.com-dc/0.82+(+http://www.boitho.com/dcbot.html+) boitho.com-dc/0.83 ( http://www.boitho.com/dcbot.html ) boitho.com-dc/0.83+(+http://www.boitho.com/dcbot.html+) boitho.com-dc/0.85 ( http://www.boitho.com/dcbot.html ) boitho.com-dc/0.85+(+http://www.boitho.com/dcbot.html+) boitho.com-dc/0.86 ( http://www.boitho.com/dcbot.html ) boitho.com-dc/0.86+(+http://www.boitho.com/dcbot.html+) Bookdog/4.3.0 Bookdog/5.1.12 Bookdog/5.1.36 BookmarkSync/2.3.2(Windows; U; Microsoft Windows NT 5.1.2600 Service Pack 2; en-US;) BookmarkSync/2.3.2(Windows; U; Microsoft Windows NT 5.1.2600 Service Pack 3; en-US;) BookmarkSync/2.3.2(Windows;+U;+Microsoft+Windows+NT+5.1.2600+Service+Pack+2;+en-US;) BookmarkSync/2.3.2(Windows;+U;+Microsoft+Windows+NT+5.1.2600+Service+Pack+3;+en-US;) borg-bot/0.9 Bot Apoena 2.0; http://www.katatudo.com.br/ajuda/ bot/1.0 bot/1.0 (bot; http://; bot@bot.bot) bot/1.0 (bot; http://www.bot.bot; bot@bot.bot) bot/1.0+(bot;+http://;+bot@bot.bot) bot/1.0+(bot;+http://www.bot.bot;+bot@bot.bot) Bot+Apoena+2.0;+http://www.katatudo.com.br/ajuda/ BotBuster/2.0 (compatible; MSIE 6.0; Windows NT 5.1) BotBuster/2.0 (compatible; MSIE 6.0; Windows NT 5.1; .NET CLR 3.0.04506.30) BotBuster/2.0+(compatible;+MSIE+6.0;+Windows+NT+5.1) BotBuster/2.0+(compatible;+MSIE+6.0;+Windows+NT+5.1;+.NET+CLR+3.0.04506.30) BPImageWalker/2.0 (www.bdbrandprotect.com) BPImageWalker/2.0+(www.bdbrandprotect.com) Brand New Crawler Brand+New+Crawler BrightCrawler (http://www.brightcloud.com/brightcrawler.asp) BrightCrawler 1.0 (http://www.brightcloud.com/brightcrawler.asp; brightcrawler@brightcloud.com) BrightCrawler+(http://www.brightcloud.com/brightcrawler.asp) BrightCrawler+1.0+(http://www.brightcloud.com/brightcrawler.asp;+brightcrawler@brightcloud.com) Bruin(+http://webarchive.cs.ucla.edu/bruinbot.html) BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html) BruinBot+(+http://webarchive.cs.ucla.edu/bruinbot.html) BSpider/1.0 libwww-perl/0.40 Btsearch/1.1 (Btsearch; http://www.baotongsoft.com/search.html; Btsearch-agent@baotongsoft.com) Btsearch/1.1+(Btsearch;+http://www.baotongsoft.com/search.html;+Btsearch-agent@baotongsoft.com) BuildCMS crawler (http://www.buildcms.com/crawler) BuildCMS+crawler+(http://www.buildcms.com/crawler) BurstFindCrawler/1.1 (crawler.burstfind.com; http://crawler.burstfind.com; crawler@burstfind.com) BurstFindCrawler/1.1+(crawler.burstfind.com;+http://crawler.burstfind.com;+crawler@burstfind.com) bwh3_user_agent bwh3_user_agent (compatible; MSIE 7.0; Windows NT 6.0) FirePHP/0.1.2 bwh3_user_agent FirePHP/0.1.2 bwh3_user_agent+(compatible;+MSIE+7.0;+Windows+NT+6.0)+FirePHP/0.1.2 bwh3_user_agent+FirePHP/0.1.2 bzBot/0.5-dev (BusyBot Event Crawler; http://busytonight.com/bot.html; ) bzBot/0.5-dev+(BusyBot+Event+Crawler;+http://busytonight.com/bot.html;++) Cabot/Nutch-1.0-dev (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com) Cabot/Nutch-1.0-dev+(Amfibi's+web-crawling+robot;+http://www.amfibi.com/cabot/;+agent@amfibi.com) CacheServer CACTVS Chemistry Spider CACTVS+Chemistry+Spider caizhi/infomation/Nutch-0.8.1 Calif Univ Tools Calif/0.6 (kosarev@tnps.net; http://www.tnps.dp.ua) Calif/0.6+(kosarev@tnps.net;+http://www.tnps.dp.ua) Calif+Univ+Tools Canookle/1.1 (+http://www.canookle.ca/spider.html) Canookle/1.1+(+http://www.canookle.ca/spider.html) Carracas 1.4.1 Carracas+1.4.1 CatchBot/1.0; +http://www.catchbot.com CatchBot/1.0;++http://www.catchbot.com Cazoodle/Nutch-0.9-dev (Cazoodle Nutch Crawler; http://www.cazoodle.com; mqbot@cazoodle.com) Cazoodle/Nutch-0.9-dev+(Cazoodle+Nutch+Crawler;+http://www.cazoodle.com;+mqbot@cazoodle.com) CazoodleBot/0.0.2 (http://www.cazoodle.com/contact.php; cbot@cazoodle.com) CazoodleBot/0.0.2 (http://www.cazoodle.com; cazoodlebot@cazoodle.com) CazoodleBot/0.0.2+(http://www.cazoodle.com/contact.php;+cbot@cazoodle.com) CazoodleBot/0.0.2+(http://www.cazoodle.com;+cazoodlebot@cazoodle.com) CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com) CazoodleBot/CazoodleBot-0.1 (CazoodleCrawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com) CazoodleBot/CazoodleBot-0.1+(CazoodleBot+Crawler;+http://www.cazoodle.com/cazoodlebot;+cazoodlebot@cazoodle.com) CazoodleBot/CazoodleBot-0.1+(CazoodleCrawler;+http://www.cazoodle.com/cazoodlebot;+cazoodlebot@cazoodle.com) CazoodleBot/Nutch-0.9-dev (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com) CazoodleBot/Nutch-0.9-dev (CazoodleBot Crawler; http://www.cazoodle.com; mqbot@cazoodle.com) CazoodleBot/Nutch-0.9-dev (CazoodleCrawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com) CazoodleBot/Nutch-0.9-dev (CazoodleCrawler; http://www.cazoodle.com; mqbot@cazoodle.com) CazoodleBot/Nutch-0.9-dev+(CazoodleBot+Crawler;+http://www.cazoodle.com/cazoodlebot;+cazoodlebot@cazoodle.com) CazoodleBot/Nutch-0.9-dev+(CazoodleBot+Crawler;+http://www.cazoodle.com;+mqbot@cazoodle.com) CazoodleBot/Nutch-0.9-dev+(CazoodleCrawler;+http://www.cazoodle.com/cazoodlebot;+cazoodlebot@cazoodle.com) CazoodleBot/Nutch-0.9-dev+(CazoodleCrawler;+http://www.cazoodle.com;+mqbot@cazoodle.com) CCBot/1.0 (+http://www.commoncrawl.org/bot.html) CCBot/1.0+(+http://www.commoncrawl.org/bot.html) ccim-gsa-robot (Enterprise; GIX-01845; webmaster@cciminstitute.com) ccim-gsa-robot+(Enterprise;+GIX-01845;+webmaster@cciminstitute.com) ccubee/2008 ccubee/3.5 CentiverseBot - investigator CentiverseBot - investigator/3.0 (http://www.centiverse-project.net) CentiverseBot+-+investigator CentiverseBot+-+investigator/3.0+(http://www.centiverse-project.net) cf_crawler/0.1 libwww-perl/5.808 cf_crawler/0.1+libwww-perl/5.808 cfetch/1.0 CFG_SPIDER_USER_AGENT CFNetwork/1.1 CFNetwork/10.4.3 CFNetwork/129.13 CFNetwork/129.16 CFNetwork/129.18 CFNetwork/129.19 CFNetwork/129.20 CFNetwork/129.21 CFNetwork/129.22 CFNetwork/152.4 CFNetwork/217 CFNetwork/220 CFNetwork/221.5 CFNetwork/330 CFNetwork/330.4;afcid=M1b8c4d35092ddb4ebe51f30bfeb6c5fa CFNetwork/4.0 Charlotte check_http/1.81 (nagios-plugins 1.4) check_http/1.81+(nagios-plugins+1.4) Checkbot/x.xx LWP/5.x Checkbot/x.xx+LWP/5.x Chickety China (the Chinese Chicken) Chickety China (the Chinese Chicken) / Nutch-0.9 Chickety+China+(the+Chinese+Chicken) Chickety+China+(the+Chinese+Chicken)+/+Nutch-0.9 Chilkat/1.0.0 (+http://www.chilkatsoft.com/ChilkatHttpUA.asp) Chilkat/1.0.0+(+http://www.chilkatsoft.com/ChilkatHttpUA.asp) China Local Browse 2.6 China+Local+Browse+2.6 Chitika ContentHit 1.0 Chitika+ContentHit+1.0 ChitikaBot/1.1 (+http://www.chitika.com/bot.html) ChitikaBot/1.1+(+http://www.chitika.com/bot.html) chudo chWWW/0.3 +http:// chWWW/0.3++http:// chWWW/0.4 +http:// chWWW/0.4++http:// chWWW/0.5 +http:// chWWW/0.5++http:// cIeNcIaFiCcIoN.nEt Spider (http://www.cienciaficcion.net) cIeNcIaFiCcIoN.nEt+Spider+(http://www.cienciaficcion.net) Cityreview Robot (+http://www.cityreview.org/crawler/) Cityreview+Robot+(+http://www.cityreview.org/crawler/) CJNetworkQuality; http://www.cj.com/networkquality CJNetworkQuality;+http://www.cj.com/networkquality ClamAV 0.92 ClamAV+0.92 Clown Epoch Clown+Epoch CMC/0.01 CobWeb/1.0 (auto classifier) CobWeb/1.0+(auto+classifier) ColdFusion combine/0.0 Combine/3 http://combine.it.lth.se/ Combine/3+http://combine.it.lth.se/ compatible; Googlebot/2.1; +http://www.google.com/bot.html compatible;+Googlebot/2.1;++http://www.google.com/bot.html complex_network_group/Nutch-0.9-dev (discovering the structure of the world-wide-web; http://cantor.ee.ucla.edu/~networks/crawl; nimakhaj@gmail.com) complex_network_group/Nutch-0.9-dev+(discovering+the+structure+of+the+world-wide-web;+http://cantor.ee.ucla.edu/~networks/crawl;+nimakhaj@gmail.com) ComputingSite Robi/1.0 (robi@computingsite.com) ComputingSite+Robi/1.0+(robi@computingsite.com) Confuzzledbot/X.X (+http://www.confuzzled.lu/bot/) Confuzzledbot/X.X+(+http://www.confuzzled.lu/bot/) Connotea libwww-perl/5.808 Connotea+libwww-perl/5.808 ContactBot/0.2 ConveraCrawler/0.7 (+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.7+(+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.8 (+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.8+(+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.9 (+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.9+(+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.9d+(+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.9e (+http://ews.converasearch.com/crawl.htm) ConveraCrawler/0.9e (+http://www.authoritativeweb.com/crawl) ConveraCrawler/0.9e+(+http://ews.converasearch.com/crawl.htm) ConveraCrawler/0.9e+(+http://www.authoritativeweb.com/crawl) CookieMonster CoolBot CoralWebPrx/0.1.19 (See http://coralcdn.org/) CoralWebPrx/0.1.19+(See+http://coralcdn.org/) CorenSearchBot/1.0 libwww-perl/5.807 CorenSearchBot/1.0 libwww-perl/5.808 CorenSearchBot/1.0+libwww-perl/5.807 CorenSearchBot/1.0+libwww-perl/5.808 core-project/1.0 cosmos/0.3 cr4nk.com/4.7 [en] (Windows 3.1; I) [Netscape] cr4nk.com/4.7+[en]+(Windows+3.1;+I)+[Netscape] crawl test/Nutch-1.0-dev crawl+test/Nutch-1.0-dev Crawler Crawler for Sika Solutions (http://www.sika-sol.co.uk/) crawler root@localhost Crawler.MyCrawler Crawler/1.0+http://elibron.com crawler/10.36 Crawler+for+Sika+Solutions+(http://www.sika-sol.co.uk/) crawler+root@localhost Crawler0.1 crawler43.ejupiter.com CrawlPaper/n.n.n (Windows n) CrawlPaper/n.n.n+(Windows+n) crawly_2.6.3 crawly@commandcom.com crawly_2.6.3+crawly@commandcom.com csci_b659/0.13 CSE HTML Validator Professional (http://www.htmlvalidator.com/) CSE HTML Validator Std 8.04 (http://www.htmlvalidator.com/) CSE+HTML+Validator+Professional+(http://www.htmlvalidator.com/) CSE+HTML+Validator+Std+8.04+(http://www.htmlvalidator.com/) cSpider cugeCrawler 1.2 - cuge.org cugeCrawler+1.2+-+cuge.org curl/7.10.2 (powerpc-apple-darwin7.0) libcurl/7.10.2 OpenSSL/0.9.7l zlib/1.1.4 curl/7.10.2+(powerpc-apple-darwin7.0)+libcurl/7.10.2+OpenSSL/0.9.7l+zlib/1.1.4 curl/7.10.6 (i386-redhat-linux-gnu) libcurl/7.10.6 OpenSSL/0.9.7a ipv6 zlib/1.1.4 curl/7.10.6 (x86_64-unknown-linux-gnu) libcurl/7.10.6 OpenSSL/0.9.7a ipv6 zlib/1.1.4 curl/7.10.6+(i386-redhat-linux-gnu)+libcurl/7.10.6+OpenSSL/0.9.7a+ipv6+zlib/1.1.4 curl/7.10.6+(x86_64-unknown-linux-gnu)+libcurl/7.10.6+OpenSSL/0.9.7a+ipv6+zlib/1.1.4 curl/7.12.1 (i386-redhat-linux-gnu) libcurl/7.12.1 OpenSSL/0.9.7a zlib/1.2.1.2 libidn/0.5.6 curl/7.12.1 (i686-redhat-linux-gnu) libcurl/7.12.1 OpenSSL/0.9.7a zlib/1.2.1.2 libidn/0.5.6 curl/7.12.1+(i386-redhat-linux-gnu)+libcurl/7.12.1+OpenSSL/0.9.7a+zlib/1.2.1.2+libidn/0.5.6 curl/7.12.1+(i686-redhat-linux-gnu)+libcurl/7.12.1+OpenSSL/0.9.7a+zlib/1.2.1.2+libidn/0.5.6 curl/7.12.2 (i686-pc-linux-gnu) libcurl/7.12.2 OpenSSL/0.9.8a zlib/1.1.3 curl/7.12.2+(i686-pc-linux-gnu)+libcurl/7.12.2+OpenSSL/0.9.8a+zlib/1.1.3 curl/7.13.1 (i386-portbld-freebsd4.10) libcurl/7.13.1 OpenSSL/0.9.7d zlib/1 curl/7.13.1 (i386-portbld-freebsd4.10) libcurl/7.13.1 OpenSSL/0.9.7d zlib/1.1.4 curl/7.13.1 (powerpc-apple-darwin8.0) libcurl/7.13.1 OpenSSL/0.9.7g zlib/1.2.3 curl/7.13.1 (powerpc-apple-darwin8.0) libcurl/7.13.1 OpenSSL/0.9.7i zlib/1.2.3 curl/7.13.1 (powerpc-apple-darwin8.0) libcurl/7.13.1 OpenSSL/0.9.7l zlib/1.2.3 curl/7.13.1+(i386-portbld-freebsd4.10)+libcurl/7.13.1+OpenSSL/0.9.7d+zlib/1 curl/7.13.1+(i386-portbld-freebsd4.10)+libcurl/7.13.1+OpenSSL/0.9.7d+zlib/1.1.4 curl/7.13.1+(powerpc-apple-darwin8.0)+libcurl/7.13.1+OpenSSL/0.9.7g+zlib/1.2.3 curl/7.13.1+(powerpc-apple-darwin8.0)+libcurl/7.13.1+OpenSSL/0.9.7i+zlib/1.2.3 curl/7.13.1+(powerpc-apple-darwin8.0)+libcurl/7.13.1+OpenSSL/0.9.7l+zlib/1.2.3 curl/7.13.2 (x86_64-unknown-linux-gnu) libcurl/7.13.2 zlib/1.2.2 curl/7.13.2+(x86_64-unknown-linux-gnu)+libcurl/7.13.2+zlib/1.2.2 curl/7.14.0 (i386-portbld-freebsd5.4) libcurl/7.14.0 OpenSSL/0.9.7e zlib/1.2.1 curl/7.14.0+(i386-portbld-freebsd5.4)+libcurl/7.14.0+OpenSSL/0.9.7e+zlib/1.2.1 curl/7.14.1 (i386-portbld-freebsd4.3) libcurl/7.14.1 OpenSSL/0.9.6b zlib/1.1.4 libidn/0.5.18 curl/7.14.1+(i386-portbld-freebsd4.3)+libcurl/7.14.1+OpenSSL/0.9.6b+zlib/1.1.4+libidn/0.5.18 curl/7.15.1 (i486-pc-linux-gnu) libcurl/7.15.1 OpenSSL/0.9.8a zlib/1.2.3 libidn/0.5.18 curl/7.15.1+(i486-pc-linux-gnu)+libcurl/7.15.1+OpenSSL/0.9.8a+zlib/1.2.3+libidn/0.5.18 curl/7.15.3 (i386-portbld-freebsd6.0) libcurl/7.15.3 OpenSSL/0.9.7e zlib/1.2.2 curl/7.15.3 (i686-pc-linux-gnu) libcurl/7.15.3 OpenSSL/0.9.7a zlib/1.2.1.2 libidn/0.5.6 curl/7.15.3+(i386-portbld-freebsd6.0)+libcurl/7.15.3+OpenSSL/0.9.7e+zlib/1.2.2 curl/7.15.3+(i686-pc-linux-gnu)+libcurl/7.15.3+OpenSSL/0.9.7a+zlib/1.2.1.2+libidn/0.5.6 curl/7.15.4 (i386-portbld-freebsd6.0) libcurl/7.15.4 OpenSSL/0.9.7e zlib/1.2.2 c-ares/1.3.1 curl/7.15.4 (i586-pc-mingw32msvc) libcurl/7.15.4 zlib/1.2.2 curl/7.15.4+(i386-portbld-freebsd6.0)+libcurl/7.15.4+OpenSSL/0.9.7e+zlib/1.2.2+c-ares/1.3.1 curl/7.15.4+(i586-pc-mingw32msvc)+libcurl/7.15.4+zlib/1.2.2 curl/7.15.5 (i686-redhat-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8a zlib/1.2.3 libidn/0.6.2 curl/7.15.5 (i686-redhat-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.5 curl/7.15.5 (x86_64-redhat-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.5 curl/7.15.5+(i686-redhat-linux-gnu)+libcurl/7.15.5+OpenSSL/0.9.8a+zlib/1.2.3+libidn/0.6.2 curl/7.15.5+(i686-redhat-linux-gnu)+libcurl/7.15.5+OpenSSL/0.9.8b+zlib/1.2.3+libidn/0.6.5 curl/7.15.5+(x86_64-redhat-linux-gnu)+libcurl/7.15.5+OpenSSL/0.9.8b+zlib/1.2.3+libidn/0.6.5 curl/7.16.0 (i686-pc-linux-gnu) libcurl/7.16.0 OpenSSL/0.9.7a zlib/1.2.1.2 curl/7.16.0+(i686-pc-linux-gnu)+libcurl/7.16.0+OpenSSL/0.9.7a+zlib/1.2.1.2 curl/7.16.2 (i686-pc-linux-gnu) libcurl/7.16.2 OpenSSL/0.9.7a zlib/1.2.1.2 libidn/0.5.6 curl/7.16.2 (x86_64-redhat-linux-gnu) libcurl/7.16.2 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.8 curl/7.16.2+(i686-pc-linux-gnu)+libcurl/7.16.2+OpenSSL/0.9.7a+zlib/1.2.1.2+libidn/0.5.6 curl/7.16.2+(x86_64-redhat-linux-gnu)+libcurl/7.16.2+OpenSSL/0.9.8b+zlib/1.2.3+libidn/0.6.8 curl/7.16.3 (amd64-portbld-freebsd6.3) libcurl/7.16.3 OpenSSL/0.9.7e zlib/1.2.3 curl/7.16.3 (powerpc-apple-darwin8.0) libcurl/7.16.3 OpenSSL/0.9.7l zlib/1.2.3 curl/7.16.3 (powerpc-apple-darwin9.0) libcurl/7.16.3 OpenSSL/0.9.7l zlib/1.2.3 curl/7.16.3+(amd64-portbld-freebsd6.3)+libcurl/7.16.3+OpenSSL/0.9.7e+zlib/1.2.3 curl/7.16.3+(powerpc-apple-darwin8.0)+libcurl/7.16.3+OpenSSL/0.9.7l+zlib/1.2.3 curl/7.16.3+(powerpc-apple-darwin9.0)+libcurl/7.16.3+OpenSSL/0.9.7l+zlib/1.2.3 curl/7.16.4 (i386-redhat-linux-gnu) libcurl/7.16.4 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.8 curl/7.16.4 (x86_64-pc-linux-gnu) libcurl/7.16.4 OpenSSL/0.9.8g zlib/1.2.3 curl/7.16.4+(i386-redhat-linux-gnu)+libcurl/7.16.4+OpenSSL/0.9.8b+zlib/1.2.3+libidn/0.6.8 curl/7.16.4+(x86_64-pc-linux-gnu)+libcurl/7.16.4+OpenSSL/0.9.8g+zlib/1.2.3 curl/7.17.1 (i686-pc-linux-gnu) curl/7.17.1 (i686-pc-linux-gnu) libcurl/7.17.1 OpenSSL/0.9.7a zlib/1.2.1.2 libidn/0.5.6 curl/7.17.1+(i686-pc-linux-gnu) curl/7.17.1+(i686-pc-linux-gnu)+libcurl/7.17.1+OpenSSL/0.9.7a+zlib/1.2.1.2+libidn/0.5.6 curl/7.18.0 (i486-pc-linux-gnu) libcurl/7.18.0 OpenSSL/0.9.8g zlib/1.2.3.3 libidn/1.1 curl/7.18.0+(i486-pc-linux-gnu)+libcurl/7.18.0+OpenSSL/0.9.8g+zlib/1.2.3.3+libidn/1.1 curl/7.9.8 (i686-pc-linux-gnu) libcurl 7.9.8 (OpenSSL 0.9.6b) (ipv6 enabled) curl/7.9.8 (i686-pc-linux-gnu) libcurl 7.9.8 (OpenSSL 0.9.7a) (ipv6 enabled) curl/7.9.8+(i686-pc-linux-gnu)+libcurl+7.9.8+(OpenSSL+0.9.6b)+(ipv6+enabled) curl/7.9.8+(i686-pc-linux-gnu)+libcurl+7.9.8+(OpenSSL+0.9.7a)+(ipv6+enabled) Cusco/3.2 Custo 2.0 (www.netwu.com) Custo+2.0+(www.netwu.com) Cuttlefish*:._.:**:._.:*> CWD DTeam Link Verifier - http://www.childrenwithdiabetes.com/ - jeffh@castleweb.com for comments CWD+DTeam+Link+Verifier+-+http://www.childrenwithdiabetes.com/+-+jeffh@castleweb.com+for+comments CyberPatrol SiteCat Webbot (http://www.cyberpatrol.com/cyberpatrolcrawler.asp) CyberPatrol+SiteCat+Webbot+(http://www.cyberpatrol.com/cyberpatrolcrawler.asp) CyberSpyder/2.1 CydralSpider/3.0 (Cydral Image Search; http://www.cydral.com) CydralSpider/3.0+(Cydral+Image+Search;+http://www.cydral.com) CydralSpider/X.X (Cydral Web Image Search; http://www.cydral.com/) CydralSpider/X.X+(Cydral+Web+Image+Search;+http://www.cydral.com/) Cynthia 1.0 Cynthia+1.0 DA 7.0 DA+7.0 Daruma/1.08 (Windows 98; U) [en] Daruma/1.08+(Windows+98;+U)+[en] darxi/1.1 darxi/1.1 (http://darxi.com/projects.asp) darxi/1.1+(http://darxi.com/projects.asp) DataCha0s/2.0 DataFountains/1.0 DataFountains/DMOZ Downloader DataFountains/Dmoz Downloader (http://ivia.ucr.edu/useragents.shtml) DataFountains/DMOZ Feature Vector Corpus Creator (http://ivia.ucr.edu/useragents.shtml) DataFountains/DMOZ+Downloader DataFountains/Dmoz+Downloader+(http://ivia.ucr.edu/useragents.shtml) DataFountains/DMOZ+Feature+Vector+Corpus+Creator+(http://ivia.ucr.edu/useragents.shtml) DB_DEBUG DeadLinkCheck/0.4.0 libwww-perl/5.63 DeadLinkCheck/0.4.0 libwww-perl/5.800 DeadLinkCheck/0.4.0 libwww-perl/5.803 DeadLinkCheck/0.4.0+libwww-perl/5.63 DeadLinkCheck/0.4.0+libwww-perl/5.800 DeadLinkCheck/0.4.0+libwww-perl/5.803 DealGates Bot/1.1 by Luc Michalski (http://spider.dealgates.com/bot.html) DealGates+Bot/1.1+by+Luc+Michalski+(http://spider.dealgates.com/bot.html) Deebo v.5 Deebo+v.5 DERIbot/Nutch-1.0-dev (DERIbot; http://deri.org ; info@deri.ie) DERIbot/Nutch-1.0-dev+(DERIbot;+http://deri.org+;+info@deri.ie) DesertRealm.com; 0.2; [J]; DesertRealm.com;+0.2;+[J]; Deviance devil in disguise (v. 2.0.1a) devil+in+disguise+(v.+2.0.1a) Deweb/1.01 DiamondBot Die Blinde Kuh Die+Blinde+Kuh dienstspider/1.0 Digger/1.0 JDK/1.3.0 Digger/1.0+JDK/1.3.0 Digger/2.0 JDK/1.4.2 Digger/2.0+JDK/1.4.2 Digimarc CGIReader/1.0 Digimarc WebReader/1.2 Digimarc+CGIReader/1.0 Digimarc+WebReader/1.2 DIIbot Dillo/0.8.0 Dillo/0.8.3 disco/Nutch-0.9 (experimental crawler ... please email imagine@gmail.com if problems observed; imagine@gmail.com) disco/Nutch-0.9 (experimental crawler ... please email imagine@gmail.com if problems observed; nedrocks@gmail.com) disco/Nutch-0.9 (experimental crawler; nedrocks@gmail.com) disco/Nutch-0.9+(experimental+crawler;+nedrocks@gmail.com) disco/Nutch-0.9+(experimental+crawler+...+please+email+imagine@gmail.com+if+problems+observed;+imagine@gmail.com) disco/Nutch-0.9+(experimental+crawler+...+please+email+imagine@gmail.com+if+problems+observed;+nedrocks@gmail.com) disco/Nutch-1.0-dev (experimental crawler; www.discoveryengine.com/robot.html; disco-crawl@discoveryengine.com) disco/Nutch-1.0-dev (experimental crawler; www.discoveryengine.com; disco-crawl@discoveryengine.com) disco/Nutch-1.0-dev+(experimental+crawler;+www.discoveryengine.com/robot.html;+disco-crawl@discoveryengine.com) disco/Nutch-1.0-dev+(experimental+crawler;+www.discoveryengine.com;+disco-crawl@discoveryengine.com) dlw3robot/x.y (in TclX by http://hplyot.obspm.fr/~dl/) dlw3robot/x.y+(in+TclX+by+http://hplyot.obspm.fr/~dl/) dmoz_tool3 DNAbot/1.0 dnScoop Tool dnScoop+Tool DNSMine 0.9 (http://www.DNSmine.com) DNSMine+0.9+(http://www.DNSmine.com) DNSRight.com WebBot Link Ckeck Tool. Report abuse to: dnsr@dnsright.com DNSRight.com+WebBot+Link+Ckeck+Tool.+Report+abuse+to:+dnsr@dnsright.com DoCoMo/1.0/D501i DoCoMo/1.0/N505i/c20/TB/W20H10 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) DoCoMo/1.0/N505i/c20/TB/W20H10+(compatible;+Googlebot-Mobile/2.1;++http://www.google.com/bot.html) DoCoMo/1.0/Nxxxi/c10 DoCoMo/1.0/P502i/c10 (Google CHTML Proxy/1.0) DoCoMo/1.0/P502i/c10+(Google+CHTML+Proxy/1.0) DoCoMo/2.0 DoCoMo/2.0 F900i DoCoMo/2.0 F905i(c100;TB;W24H17),gzip(gfe) (via translate.google.com) DoCoMo/2.0 N905i(c100;TB;W24H16) (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) DoCoMo/2.0 P900i(c100;TB;W24H11) DoCoMo/2.0 P902i(c100;TB;W24H12) DoCoMo/2.0 P904i( m65bot/0.1; c; http://m65.jp/bot.html ) DOCOMO/2.0 P906i(c100;TB;W24H15) DoCoMo/2.0 SH902i (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html) DoCoMo/2.0 SH905i(c100;TB;W24H16) DoCoMo/2.0+F900i DoCoMo/2.0+F905i(c100;TB;W24H17),gzip(gfe)+(via+translate.google.com) DoCoMo/2.0+N905i(c100;TB;W24H16)+(compatible;+Googlebot-Mobile/2.1;++http://www.google.com/bot.html) DoCoMo/2.0+P900i(c100;TB;W24H11) DoCoMo/2.0+P902i(c100;TB;W24H12) DoCoMo/2.0+P904i(+m65bot/0.1;+c;+http://m65.jp/bot.html+) DOCOMO/2.0+P906i(c100;TB;W24H15) DoCoMo/2.0+SH902i+(compatible;+Y!J-SRD/1.0;+http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html) DoCoMo/2.0+SH905i(c100;TB;W24H16) dodgebot/experimental Domain Dossier utility (http://CentralOps.net/) Domain+Dossier+utility+(http://CentralOps.net/) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/appointmentnet.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/botsvsbrowsers.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/canoemarathon.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/cutaboverealtyagents.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/dealershipnet.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/dentist-search.net) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/dinnerbot.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/findafootdr.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/findanursingschool.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/findasurgeononline.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/lawschoollocator.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localallergists.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localbeautyschools.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localcardiologists.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localchiros.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localculinaryschools.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localdermatologists.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localearnoseandthroat.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localemergencymedicine.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localendocrinologists.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localeyedoctor.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localfamilypractice.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localflightschools.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localgeriatrics.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localhomelenders.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localinternalmedicine.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localmassageschool.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localoncologists.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localorthopedists.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localpathology.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localpediatrics.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localpsychiatrists.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localsportsmedicine.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/localtruckingschools.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/massagetherapist-search.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/obgyn-search.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/plasticsurgeonweb.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/quickcityinfo.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/therightfinancialadvisor.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/therightmover.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/therightstorage.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/toptruckingcarriers.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/unicodemap.com) DomainCrawler/1.0 (info@domaincrawler.com; http://www.domaincrawler.com/domains/view/unicodemap.org) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/appointmentnet.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/botsvsbrowsers.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/canoemarathon.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/cutaboverealtyagents.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/dealershipnet.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/dentist-search.net) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/dinnerbot.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/findafootdr.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/findanursingschool.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/findasurgeononline.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/lawschoollocator.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localallergists.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localbeautyschools.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localcardiologists.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localchiros.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localculinaryschools.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localdermatologists.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localearnoseandthroat.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localemergencymedicine.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localendocrinologists.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localeyedoctor.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localfamilypractice.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localflightschools.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localgeriatrics.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localhomelenders.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localinternalmedicine.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localmassageschool.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localoncologists.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localorthopedists.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localpathology.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localpediatrics.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localpsychiatrists.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localsportsmedicine.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/localtruckingschools.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/massagetherapist-search.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/obgyn-search.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/plasticsurgeonweb.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/quickcityinfo.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/therightfinancialadvisor.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/therightmover.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/therightstorage.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/toptruckingcarriers.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/unicodemap.com) DomainCrawler/1.0+(info@domaincrawler.com;+http://www.domaincrawler.com/domains/view/unicodemap.org) DomainsDB.net MetaCrawler v.0.9.7b (http://domainsdb.net/) DomainsDB.net MetaCrawler v.0.9.7c (http://domainsdb.net/) DomainsDB.net+MetaCrawler+v.0.9.7b+(http://domainsdb.net/) DomainsDB.net+MetaCrawler+v.0.9.7c+(http://domainsdb.net/) DopodC720 Doris/1.15 [en] (Symbian) Doris/1.15+[en]+(Symbian) Doris/1.17 [en] (Symbian) Doris/1.17+[en]+(Symbian) DorkBoy DotBot/1.0.1 (http://www.dotnetdotcom.org/#info, crawler@dotnetdotcom.org) DotBot/1.0.1 (http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org) DotBot/1.0.1+(http://www.dotnetdotcom.org/#info,+crawler@dotnetdotcom.org) DotBot/1.0.1+(http://www.dotnetdotcom.org/,+crawler@dotnetdotcom.org) Download Demon/3.5.0.11 Download Ninja 3.0 Download Ninja 7.0 Download+Demon/3.5.0.11 Download+Ninja+3.0 Download+Ninja+7.0 dpicella-fertilityweb.net DragonBot/1.0 libwww/5.0 DragonBot/1.0+libwww/5.0 Dragonfly File Reader dragonfly(ebingbong#playstarmusic.com) dragonfly(ebingbong@playstarmusic.com) Dragonfly+File+Reader Drupal (+http://drupal.org/) Drupal+(+http://drupal.org/) dtSearch DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html) DuckDuckBot/1.0;+(+http://duckduckgo.com/duckduckbot.html) DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html) DuckDuckBot/1.1;+(+http://duckduckgo.com/duckduckbot.html) Dumbot(version 0.1 beta - http://www.dumbfind.com/dumbot.html) Dumbot(version 0.2 beta - http://www.searchles.com/ Searchles Inc.) Dumbot(version+0.1+beta+-+http://www.dumbfind.com/dumbot.html) Dumbot(version+0.2+beta+-+http://www.searchles.com/+Searchles+Inc.) Duppies DuxeT :) / Firefox2 / Win XP || Tylko Lechia!! DuxeT+:)+/+Firefox2+/+Win+XP+||+Tylko+Lechia!! DWCP/2.0 EasyDL/3.04 http://keywen.com/Encyclopedia/Bot EasyDL/3.04+http://keywen.com/Encyclopedia/Bot EbiNess/0.01a eCatch/3.0 ecxi/Nutch-1.0-dev (esCERT-UPC-ecxi; http://escert.upc.edu/; admin escert edu) ecxi/Nutch-1.0-dev+(esCERT-UPC-ecxi;+http://escert.upc.edu/;+admin+escert+edu) education portal/Nutch-0.9 (Please do not forbid, its for your benefit) education+portal/Nutch-0.9+(Please+do+not+forbid,+its+for+your+benefit) Eisoo Blog Backup Eisoo+Blog+Backup EIT-Link-Verifier-Robot/0.2 elfinbot Elric/Emperor_of_Melnibone (Hellsword; StormBringer - Devourer of Souls) Elric/Emperor_of_Melnibone+(Hellsword;+StormBringer+-+Devourer+of+Souls) Emacs-w3/v[0-9\.]+ Email Spider by AlexW Email+Spider+by+AlexW EmailSearch EmailSiphon EmailSpider EmailWolf 1.00 EmailWolf+1.00 EMC Spider EMC+Spider EmeraldShield.com Web Spider (http://www.emeraldshield.com/webbot.aspx) EmeraldShield.com+Web+Spider+(http://www.emeraldshield.com/webbot.aspx) eMule EnaBot/1.1 (http://www.enaball.com/crawler.html) EnaBot/1.1+(http://www.enaball.com/crawler.html) EnaBot/1.2 (http://www.enaball.com/crawler.html) EnaBot/1.2+(http://www.enaball.com/crawler.html) Encourage/6.16 (Win95) Encourage/6.16+(Win95) envolk/1.7 (+http://www.envolk.com/envolkspiderinfo.html) envolk/1.7+(+http://www.envolk.com/envolkspiderinfo.html) Envolo ePochta_Extractor/4.0 EroCrawler esculapio/1.1 ESIRover v1.0 ESIRover+v1.0 ESISmartSpider/2.0 e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/) esther eStyleSearch 4 eStyleSearch+4 eSyndiCat Bot eSyndiCat+Bot EuripBot/0.4 (+http://www.eurip.com) GetFile EuripBot/0.4 (+http://www.eurip.com) PreCheck EuripBot/0.4+(+http://www.eurip.com)+GetFile EuripBot/0.4+(+http://www.eurip.com)+PreCheck EuripBot/0.5 (+http://www.eurip.com) PreCheck EuripBot/0.5+(+http://www.eurip.com)+PreCheck EuripBot/1.0 (+http://www.eurip.com) GetFile EuripBot/1.0 (+http://www.eurip.com) PreCheck EuripBot/1.0+(+http://www.eurip.com)+GetFile EuripBot/1.0+(+http://www.eurip.com)+PreCheck Eurobot/1.0 (http://www.ayell.eu) Eurobot/1.0+(http://www.ayell.eu) Eurobot/Nutch-1.0-dev (1.0) Eurobot/Nutch-1.0-dev+(1.0) Evaal/0.7.1 (Evaal; http://search.evaal.com/bot.html; bot@evaal.com) Evaal/0.7.1+(Evaal;+http://search.evaal.com/bot.html;+bot@evaal.com) eventBot Everest-Vulcan Inc./0.1 (R&D project; host=e-1-23; http://everest.vulcan.com/crawlerhelp) Everest-Vulcan+Inc./0.1+(R&D+project;+host=e-1-23;+http://everest.vulcan.com/crawlerhelp) Evliya Celebi v0.151 - http://ilker.ulak.net.tr Evliya+Celebi+v0.151+-+http://ilker.ulak.net.tr Exabot/2.0 Exabot/3.0 Exabot-Test/1.0 ExactSearch exactseek.com exooba crawler/0.5.1 (crawler for exooba.com; http://www.exooba.com/; info at exooba dot com) exooba crawler/exooba crawler (crawler for exooba.com; http://www.exooba.com/; info at exooba dot com) exooba/exooba crawler (exooba; exooba) exooba/exooba+crawler+(exooba;+exooba) exooba+crawler/0.5.1+(crawler+for+exooba.com;+http://www.exooba.com/;+info+at+exooba+dot+com) exooba+crawler/exooba+crawler+(crawler+for+exooba.com;+http://www.exooba.com/;+info+at+exooba+dot+com) EXPLORER explorersearch Express WebPictures (www.express-soft.com) Express+WebPictures+(www.express-soft.com) facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php) facebookexternalhit/1.0+(+http://www.facebook.com/externalhit_uatext.php) facebookscraper/1.0 (+http://www.facebook.com/sharescraper_help.php) facebookscraper/1.0(+http://www.facebook.com/sharescraper_help.php) facebookscraper/1.0+(+http://www.facebook.com/sharescraper_help.php) falcon/13.0 FANGCrawl/0.01 FAST Enterprise Crawler 6 used by EPFL (raul.rabionet@epfl.ch) FAST Enterprise Crawler 6 used by LexisNexis (lnbot@lexisnexis.com) FAST Enterprise Crawler 6 used by Singapore Press Holdings (crawler@sphsearch.sg) FAST Enterprise Crawler 6 used by Verizon Superpages Powered By FAST (crawler_admin@superpages.com) FAST Enterprise Crawler 6 used by Verizon Superpages Powered By FAST (kevin.watters@fastsearch.com) FAST Enterprise Crawler 6 used by ypc (krao@yellowpages.com) FAST Enterprise Crawler used by ILU ( http://www.ilu.co.jp/ ) FAST Enterprise Crawler/6.4 (crawler@fast.no) FAST Enterprise Crawler/6.4 (helpdesk at fast.no) FAST ESP Document Retriever/CVS HEAD 2007-10-18 23:53:34 UTC FAST MetaWeb Crawler (helpdesk at fastsearch dot com) FAST+Enterprise+Crawler/6.4+(crawler@fast.no) FAST+Enterprise+Crawler/6.4+(helpdesk+at+fast.no) FAST+Enterprise+Crawler+6+used+by+EPFL+(raul.rabionet@epfl.ch) FAST+Enterprise+Crawler+6+used+by+LexisNexis+(lnbot@lexisnexis.com) FAST+Enterprise+Crawler+6+used+by+Singapore+Press+Holdings+(crawler@sphsearch.sg) FAST+Enterprise+Crawler+6+used+by+Verizon+Superpages+Powered+By+FAST+(crawler_admin@superpages.com) FAST+Enterprise+Crawler+6+used+by+Verizon+Superpages+Powered+By+FAST+(kevin.watters@fastsearch.com) FAST+Enterprise+Crawler+6+used+by+ypc+(krao@yellowpages.com) FAST+Enterprise+Crawler+used+by+ILU+(+http://www.ilu.co.jp/+) FAST+ESP+Document+Retriever/CVS+HEAD+2007-10-18+23:53:34+UTC FAST+MetaWeb+Crawler+(helpdesk+at+fastsearch+dot+com) FastCrawler 3.0.X (crawler@1klik.dk) - http://www.1klik.dk FastCrawler+3.0.X+(crawler@1klik.dk)+-+http://www.1klik.dk fastlwspider/1.0 FAST-SoccerCrawler/2.2-pre-cvs (oyvinda@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-SoccerCrawler/2.2-pre-cvs+(oyvinda@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler FAST-WebCrawler/2.0.10 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.0.10+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.0.9 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.0.9+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1.pre.2000-04-14.1 (ashen@looksmart.net) FAST-WebCrawler/2.1.pre.2000-04-14.1+(ashen@looksmart.net) FAST-WebCrawler/2.1.pre.2000-04-18.1 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1.pre.2000-04-18.1+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1.prealpha.2000-04-07.1 (ashen@looksmart.net) FAST-WebCrawler/2.1.prealpha.2000-04-07.1+(ashen@looksmart.net) FAST-WebCrawler/2.1-pre10 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre10+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre11 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre11+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre12 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre12+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre13 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre13+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre14 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre14+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre2 (ashen@looksmart.net) FAST-WebCrawler/2.1-pre2+(ashen@looksmart.net) FAST-WebCrawler/2.1-pre4 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre4+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre5 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre5+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre6 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre6+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre7 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.1-pre7+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2.5 - Lycos/Alltheweb/Fast FAST-WebCrawler/2.2.5+-+Lycos/Alltheweb/Fast FAST-WebCrawler/2.2-pre1 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2-pre1+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2-pre2 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2-pre2+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2-pre3 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2-pre3+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2-pre4 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2-pre4+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2-pre5 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2-pre5+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2-pre8 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2-pre8+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2-pre9 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/2.2-pre9+(crawler@fast.no;+http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) FAST-WebCrawler/3.6+(atw-crawler+at+fast+dot+no;+http://fast.no/support/crawler.asp) Fauxzilla 1.0 Fauxzilla+1.0 FavOrg favorstarbot/1.0 (+http://favorstar.com/bot.html) favorstarbot/1.0+(+http://favorstar.com/bot.html) FAX search FAX+search Faxobot/1.0 FBI CheckCategory/0.91-20080319 libwww-perl/5.76 FBI+CheckCategory/0.91-20080319+libwww-perl/5.76 Feed::Find/0.06 FeedBurner/1.0 FeedBurner/1.0 (http://www.FeedBurner.com) FeedBurner/1.0+(http://www.FeedBurner.com) FeedChecker/0.01 FeedDemon/2.7 (http://www.newsgator.com/; Microsoft Windows XP) FeedDemon/2.7+(http://www.newsgator.com/;+Microsoft+Windows+XP) FeedFetcher-Google; (+http://www.google.com/feedfetcher.html) FeedFetcher-Google;+(+http://www.google.com/feedfetcher.html) FeedHub FeedDiscovery/1.0 (http://www.feedhub.com) FeedHub MetaDataFetcher/1.0 (http://www.feedhub.com) FeedHub+FeedDiscovery/1.0+(http://www.feedhub.com) FeedHub+MetaDataFetcher/1.0+(http://www.feedhub.com) Feedjit Crawler 2.1 Feedjit+Crawler+2.1 FeedValidator/1.3 FelixIDE/1.0 fetch libfetch/2.0 fetch+libfetch/2.0 fido/0.9 Harvest/1.4.pl2 fido/0.9+Harvest/1.4.pl2 fido/1.0 Harvest/1.4.pl2 fido/1.0+Harvest/1.4.pl2 Filthish/1.0 (Windows NT 5.1; en-GB; http://www.leytonjay.co.uk/about-you/ - I am not a robot, just a browser passing through....) Firefox/2 Filthish/1.0+(Windows+NT+5.1;+en-GB;+http://www.leytonjay.co.uk/about-you/+-+I+am+not+a+robot,+just+a+browser+passing+through....)+Firefox/2 Findexa Crawler (http://www.findexa.no/gulesider/article26548.ece) Findexa+Crawler+(http://www.findexa.no/gulesider/article26548.ece) findfiles.org/0.9 (Robot;robot@findfiles.org) findfiles.org/0.9+(Robot;robot@findfiles.org) findfiles.org/0.91 (Robot;robot@findfiles.org) findfiles.org/0.91+(Robot;robot@findfiles.org) findlinks/0.939 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.939+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.944 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.944+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.945 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.945+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.956 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.956+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.968 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.968+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.973 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.973+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.975 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.975+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.976 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.976+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.999 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/0.999+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.0 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.0.8 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.0.8+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.0.8-a5 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.0.8-a5+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.0.9 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.0.9+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.0.9-a2 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.0.9-a2+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.0+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.06 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.06+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.07 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.07+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.08 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.08+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.1 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.1+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.1-a1 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.1-a1+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.1-a2 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.1-a2+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.1-a5 ( http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.1-a5 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.1-a5+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.2-a3 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.2-a3+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.2-a5 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.2-a5+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta1 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta1+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta2 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta2+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta3 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta3+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta4 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta4+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta6 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta6+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta7 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta7+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta8 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta8+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta9 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.3-beta9+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.4-beta1 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1.4-beta1+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1-a3 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1-a3+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1-a7 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1-a7+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1-a8 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1-a8+(+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1-a9 (+http://wortschatz.uni-leipzig.de/findlinks/) findlinks/1.1-a9+(+http://wortschatz.uni-leipzig.de/findlinks/) Firebat 2.7.13 Firebat 2.8.1 (http://lms.virtual-presence.org) Firebat 2.8.2 (http://lms.virtual-presence.org) Firebat 2.8.3 (http://lms.virtual-presence.org) Firebat 2.8.4 (http://lms.virtual-presence.org) Firebat 2.8.5 (http://lms.virtual-presence.org) Firebat+2.7.13 Firebat+2.8.1+(http://lms.virtual-presence.org) Firebat+2.8.2+(http://lms.virtual-presence.org) Firebat+2.8.3+(http://lms.virtual-presence.org) Firebat+2.8.4+(http://lms.virtual-presence.org) Firebat+2.8.5+(http://lms.virtual-presence.org) firefox google bot firefox googlebot Firefox/2.0.0.16 ( Linux i686; bot batech 1.7;) Firefox/2.0.0.16+(+Linux+i686;+bot+batech+1.7;) firefox+google+bot firefox+googlebot FirePHP Fish-Search-Robot FlashGet flatlandbot/baypup (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot; jason@flatlandindustries.com) flatlandbot/baypup+(Flatland+Industries+Web+Spider;+http://www.flatlandindustries.com/flatlandbot;+jason@flatlandindustries.com) flatlandbot/flatland(Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot.php; jason@flatlandindustries.com) flatlandbot/flatland(Flatland+Industries+Web+Spider;+http://www.flatlandindustries.com/flatlandbot.php;+jason@flatlandindustries.com) flatlandbot/flatlandbot (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot.php; jason@flatlandindustries.com) flatlandbot/flatlandbot (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot; jason@flatlandindustries.com) flatlandbot/flatlandbot+(Flatland+Industries+Web+Spider;+http://www.flatlandindustries.com/flatlandbot.php;+jason@flatlandindustries.com) flatlandbot/flatlandbot+(Flatland+Industries+Web+Spider;+http://www.flatlandindustries.com/flatlandbot;+jason@flatlandindustries.com) flyindex.net 1.0/http://www.flyindex.net flyindex.net+1.0/http://www.flyindex.net foo/1.0 foo_1.0.0.9 foo1.2.2.3 foobar/Nutch-1.0-dev (foobar; foobar.com; foo@bar.com) foobar/Nutch-1.0-dev+(foobar;+foobar.com;+foo@bar.com) foobar2000/0.9.5.1 Fooky.com/ScorpionBot/ScoutOut; http://www.fooky.com/scorpionbots Fooky.com/ScorpionBot/ScoutOut;+http://www.fooky.com/scorpionbots ForAll.pl-Crawler/1.0 Forschungsportal/0.8-dev (Testinstallation; http://www.forschungsportal.net/; fpcrawler@rrzn.uni-hannover.de) Forschungsportal/0.8-dev+(Testinstallation;+http://www.forschungsportal.net/;+fpcrawler@rrzn.uni-hannover.de) Freecrawl FreeSurfer software from SunnyScript - www.sunnyscript.com FreeSurfer+software+from+SunnyScript+-+www.sunnyscript.com Frelicbot/1.0 +http://www.frelic.com/ Frelicbot/1.0++http://www.frelic.com/ FunnelWeb-1.0 FunWebProducts fusion-ware.com Fusion-ware.com bot Fusion-ware.com+bot FyberSpider (+http://www.fybersearch.com/fyberspider.php) FyberSpider/1.3 (http://www.fybersearch.com/fyberspider.php) FyberSpider/1.3+(http://www.fybersearch.com/fyberspider.php) FyberSpider+(+http://www.fybersearch.com/fyberspider.php) g3.pl/0.1 libwww-perl/5.65 g3.pl/0.1 libwww-perl/5.803 g3.pl/0.1+libwww-perl/5.65 g3.pl/0.1+libwww-perl/5.803 GAIS Robot/1.0B2 GAIS+Robot/1.0B2 Gaisbot/3.0+(robot05@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php) Gaisbot/3.0+(robot06@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php) Gaisbot/3.0+(robot-response@widelab.org;+http://www.widelab.org/robot.html) Gallent Search Spider v1.4 Robot 5 (http://robot.GallentSearch.com) Gallent+Search+Spider+v1.4+Robot+5+(http://robot.GallentSearch.com) GameBox gammaSpider xxxxxxx ()/ gammaSpider+xxxxxxx+()/ Gandalf/Grey (Shadowfax; Wind) White_Staff Gandalf/Grey+(Shadowfax;+Wind)+White_Staff gazz/1.0 gbot gcreep/1.0 gemiusbot Generic Mobile Phone (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) Generic+Mobile+Phone+(compatible;+Googlebot-Mobile/2.1;++http://www.google.com/bot.html) genie(http://64.5.245.11/faq/faq.html) genieBot (http://64.5.245.11/faq/faq.html) genieBot enash@genieknows.com genieBot wgao@genieknows.com geniebot wgao@genieknows.com genieBot+(http://64.5.245.11/faq/faq.html) genieBot+enash@genieknows.com genieBot+wgao@genieknows.com geniebot+wgao@genieknows.com geniewgao@genieknows.com GeoBot/version 1.0 GeoBot/version+1.0 GeonaBot/1.2; http://www.geona.com/ GeonaBot/1.2;+http://www.geona.com/ georg [Bot] georg+[Bot] Georgila/4.0 geosign-crawler (Enterprise; M2-KJL7RPEBUC2JB; pfilsinger@geosign.com) geosign-crawler+(Enterprise;+M2-KJL7RPEBUC2JB;+pfilsinger@geosign.com) gestaltIconoclast/1.0 libwww-FM/2.17 gestaltIconoclast/1.0+libwww-FM/2.17 GetHTMLContents3 GetURL.rexx v1.05 GetURL.rexx+v1.05 Giant/1.0 (Openmaru bot; robot@openmaru.com) Giant/1.0+(Openmaru+bot;+robot@openmaru.com) Gigabot/1.0 Gigabot/2.0 Gigabot/2.0 (http://www.gigablast.com/spider.html) Gigabot/2.0/gigablast.com/spider.html Gigabot/2.0; http://www.gigablast.com/spider.html Gigabot/2.0;+http://www.gigablast.com/spider.html Gigabot/2.0+(http://www.gigablast.com/spider.html) Gigabot/2.0att Gigabot/3 Gigabot/3.0 (http://www.gigablast.com/spider.html) Gigabot/3.0+(http://www.gigablast.com/spider.html) gnome-vfs/2.16.2 neon/0.25.4 gnome-vfs/2.16.2+neon/0.25.4 gnu-classpath/0.92 (libgcj/4.1.2 (Ubuntu 4.1.2-0ubuntu5)) gnu-classpath/0.92+(libgcj/4.1.2+(Ubuntu+4.1.2-0ubuntu5)) GOD WebWasher 3.4 GOD+WebWasher+3.4 GOFORIT( http://www.goforit.com/about/ ) GOFORIT(+http://www.goforit.com/about/+) GOFORITBOT ( http://www.goforit.com/about/ ) GOFORITBOT+(+http://www.goforit.com/about/+) goget/ /image/ goget/+/image/ Goglebot/2.1 (+http://www.goglebot.com/bot.html) Goglebot/2.1+(+http://www.goglebot.com/bot.html) Goldfire Server Goldfire+Server Golem/1.1 gonzo1 mailto:crawleradmin.t-info@telekom.de gonzo1[D] mailto:crawleradmin.t-info@telekom.de gonzo1[D]+mailto:crawleradmin.t-info@telekom.de gonzo1+mailto:crawleradmin.t-info@telekom.de google bot google+bot google1.0 Google2.1 GoogleBot google-bot googlebot 1.0 Googlebot 2,1 Googlebot 2.1 Googlebot 2.1 (New version) Googlebot 2.1 (New version)" useragent="Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Googlebot 2.1 ColdFire/1.1.51.59 Googlebot 2.1 FirePHP/0.2.1 googlebot/1.0 Googlebot/1.0 (googlebot(at)googlebot.com) Googlebot/1.0 (googlebot@googlebot.com http://googlebot.com/) Googlebot/1.0+(googlebot(at)googlebot.com) Googlebot/1.0+(googlebot@googlebot.com+http://googlebot.com/) Googlebot/2!(+http://www.googlebot.com/bot.html) Googlebot/2.0 (+http://googlebot.com/bot.html) Googlebot/2.0 (http://www.googlebot.com/bot.html) Googlebot/2.0 beta (googlebot(at)googlebot.com) Googlebot/2.0+(+http://googlebot.com/bot.html) Googlebot/2.0+(http://www.googlebot.com/bot.html) Googlebot/2.0+beta+(googlebot(at)googlebot.com) Googlebot/2.1 Googlebot/2.1 - Google.com Googlebot/2.1 ( http://127.0.0.1) Googlebot/2.1 ( http://www.google.com/bot.html) Googlebot/2.1 ( http://www.googlebot.com/bot.html) Googlebot/2.1 ( http://www.googlebot.com/bot.html) Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html Googlebot/2.1 ( http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html Googlebot/2.1 ( http://www.googlebot.com/bot.html);afcid=Wf36ac4fee54afd78d944843274ab1511 Googlebot/2.1 (+ http://www.google.com/bot.html) Googlebot/2.1 (+ http://www.googlebot.com/bot.html) Googlebot/2.1 (+ http://www.olivia del rio.com/bot.html) Googlebot/2.1 (+http://127.0.0.1) Googlebot/2.1 (+http://google.com/bot.html) Googlebot/2.1 (+http://googlebot.com/bot.html) Googlebot/2.1 (+http://www.google. com/bot.html) Googlebot/2.1 (+http://www.google.com./bot.html) Googlebot/2.1 (+http://www.google.com/bot.html Googlebot/2.1 (+http://www.google.com/bot.html) Googlebot/2.1 (+http://www.google.com/bot.html) (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.1; MS-RTC LM 8) Googlebot/2.1 (+http://www.google.com/bot.html) Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Googlebot/2.1 (+http://www.google.com/bot.html,gzip(gfe) (via translate.google.com) Googlebot/2.1 (+http://www.google.com/bot.html; Googlebot/2.13; Googlebot/2.12; SaveWealth; .NET CLR 1.1.4322; .NET CLR 1.0.3705) Googlebot/2.1 (+http://www.googlebot.com/bot .html) Googlebot/2.1 (+http://www.googlebot.com/bot.htm Googlebot/2.1 (+http://www.googlebot.com/bot.htm) Googlebot/2.1 (+http://www.googlebot.com/bot.html Googlebot/2.1 (+http://www.googlebot.com/bot.html) Googlebot/2.1 (+http://www.googlebot.com/bot.html),gzip(gfe) (via translate.google.com) Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; PeoplePal 6.6) Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727) Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 6.0; Windows NT 5.1; SV1; Antenna Preview Window) Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022) Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; .NET CLR 2.0.50727; .NET CLR 1.1.4322) Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; PeoplePal 3.0; PeoplePal 6.2) Googlebot/2.1 (+http://www.googlebot.com/bot.html; MSIE 7.0; Windows NT 5.1; PeoplePal 3.0; PeoplePal 6.2; .NET CLR 2.0.50727; Media Center PC 3.0; .NET CLR 1.0.3705; .NET CLR 1.1.4322) Googlebot/2.1 (+http://www.googlebot.com/bot.html; Windows; U; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; .NET CLR 3.0.04506) Googlebot/2.1 (+http://www.googlebot.com/bot.html} Googlebot/2.1 (+http:www.googlebot.com/bot.html) Googlebot/2.1 (♦http://www.googlebot.com/bot.html) Googlebot/2.1 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Googlebot/2.1 (compatible; MSIE 7.0; Windows NT 5.1; Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1) ; .NET CLR 1.1.4322; MEGAUPLOAD 2.0; .NET CLR 2.0.50727) Googlebot/2.1 (compatible; MSIE; Windows; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727) Googlebot/2.1 (Google's crawler; www.googlebot.com; googlebot@google.com) GoogleBot/2.1 (http://googlebot.com/bot.html) Googlebot/2.1 (http://www.googlbot.com/bot.html) Googlebot/2.1 (http://www.google.com/bot.html) Googlebot/2.1 (http://www.google.com/bot/html) Googlebot/2.1 (http://www.googlebot.com/bot.html) Googlebot/2.1 (http://www.googlebot.com/bot.html)http://www.googlebot.com/bot.html Googlebot/2.1 [+http://www.googlebot.com/bot.html] Googlebot/2.1 + (+ http://www.google.com/bot.html) Googlebot/2.1 + (+ http://www.googlebot.com/bot.html) Googlebot/2.1 + (+ http://www.googlebot.com/bot.html),gzip(gfe) (via translate.google.com) GoogleBot/2.1(+http://googlebot.com/bot.html) googlebot/2.1(+http://www.google.com/bot.html) googlebot/2.1(+http://www.googlebot.com/bot.html Googlebot/2.1(+http://www.googlebot.com/bot.html) Googlebot/2.1(http://www.googlebot.com/bot.html) Googlebot/2.1; ( http://www.google.com/bot.html) Googlebot/2.1; (+http://www.google.com/bot.html) Googlebot/2.1; (http://www.google.com/bot.html) Googlebot/2.1; +http://www.google.com/bot.html Googlebot/2.1; +http://www.google.com/bot.html) Googlebot/2.1; +http://www.google.com/bot.html, DynaWeb http://www.dit-inc.us/disclaimer.php Googlebot/2.1; +http;//www.google.com/bot.html Googlebot/2.1; http://www.google.com/bot.html Googlebot/2.1;+(+http://www.google.com/bot.html) Googlebot/2.1;+(+http://www.googlebot.com/bot.html) Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Googlebot/2.1;+(+http://www.googlebot.com/bot.html)+Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html) Googlebot/2.1;+(http://www.google.com/bot.html) Googlebot/2.1;++http://www.google.com/bot.html Googlebot/2.1;++http://www.google.com/bot.html) Googlebot/2.1;++http://www.google.com/bot.html,+DynaWeb+http://www.dit-inc.us/disclaimer.php Googlebot/2.1;++http;//www.google.com/bot.html Googlebot/2.1;+http://www.google.com/bot.html Googlebot/2.1+ Googlebot/2.1+(++http://www.google.com/bot.html) Googlebot/2.1+(++http://www.googlebot.com/bot.html) Googlebot/2.1+(++http://www.olivia+del+rio.com/bot.html) Googlebot/2.1+(+http://127.0.0.1) Googlebot/2.1+(+http://google.com/bot.html) Googlebot/2.1+(+http://googlebot.com/bot.html) Googlebot/2.1+(+http://www.google.+com/bot.html) Googlebot/2.1+(+http://www.google.com./bot.html) Googlebot/2.1+(+http://www.google.com/bot.htm Googlebot/2.1+(+http://www.google.com/bot.html Googlebot/2.1+(+http://www.google.com/bot.html) Googlebot/2.1+(+http://www.google.com/bot.html),gzip(gfe) (via translate.google.com) Googlebot/2.1+(+http://www.google.com/bot.html),gzip(gfe)+(via+translate.google.com) Googlebot/2.1+(+http://www.google.com/bot.html)+(compatible;+MSIE+7.0;+Windows+NT+5.1;+.NET+CLR+1.0.3705;+.NET+CLR+1.1.4322;+.NET+CLR+2.0.50727;+InfoPath.1;+MS-RTC+LM+8) Googlebot/2.1+(+http://www.google.com/bot.html)+Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html) Googlebot/2.1+(+http://www.google.com/bot.html)” Googlebot/2.1+(+http://www.google.com/bot.html)” Googlebot/2.1+(+http://www.google.com/bot.html)” Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Googlebot/2.1+(+http://www.google.com/bot.html)”. Notice the different url Googlebot/2.1+(+http://www.google.com/bot.html)”.+Notice+the+different+url Googlebot/2.1+(+http://www.google.com/bot.html)”+Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html) Googlebot/2.1+(+http://www.google.com/bot.html,gzip(gfe)+(via+translate.google.com) Googlebot/2.1+(+http://www.google.com/bot.html;+Googlebot/2.13;+Googlebot/2.12;+SaveWealth;+.NET+CLR+1.1.4322;+.NET+CLR+1.0.3705) Googlebot/2.1+(+http://www.google.com?bot.html) Googlebot/2.1+(+http://www.googlebot.com/bot.htm Googlebot/2.1+(+http://www.googlebot.com/bot.htm) Googlebot/2.1+(+http://www.googlebot.com/bot.html Googlebot/2.1+(+http://www.googlebot.com/bot.html) Googlebot/2.1+(+http://www.googlebot.com/bot.html)"Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html Googlebot/2.1+(+http://www.googlebot.com/bot.html)"Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html Googlebot/2.1+(+http://www.googlebot.com/bot.html)"Mozilla/5.0+(compatible;+Googlebot/2.1;+http://www.google.com/bot.html Googlebot/2.1+(+http://www.googlebot.com/bot.html),gzip(gfe)+(via+translate.google.com) Googlebot/2.1+(+http://www.googlebot.com/bot.html);afcid=Wf36ac4fee54afd78d944843274ab1511 Googlebot/2.1+(+http://www.googlebot.com/bot.html)+Mozilla/5.0+(compatible;+Googlebot/2.1;+http://www.google.com/bot.html Googlebot/2.1+(+http://www.googlebot.com/bot.html)” Googlebot/2.1+(+http://www.googlebot.com/bot.html)” Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Googlebot/2.1+(+http://www.googlebot.com/bot.html)”+Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html) Googlebot/2.1+(+http://www.googlebot.com/bot.html)Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Googlebot/2.1+(+http://www.googlebot.com/bot.html)Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html) Googlebot/2.1+(+http://www.googlebot.com/bot.html;+MSIE+6.0;+Windows+NT+5.1;+SV1;+.NET+CLR+1.1.4322;+.NET+CLR+2.0.50727;+PeoplePal+6.6) Googlebot/2.1+(+http://www.googlebot.com/bot.html;+MSIE+6.0;+Windows+NT+5.1;+SV1;+.NET+CLR+2.0.50727) Googlebot/2.1+(+http://www.googlebot.com/bot.html;+MSIE+6.0;+Windows+NT+5.1;+SV1;+Antenna+Preview+Window) Googlebot/2.1+(+http://www.googlebot.com/bot.html;+MSIE+7.0;+Windows+NT+5.1;+.NET+CLR+1.1.4322;+.NET+CLR+2.0.50727;+.NET+CLR+3.0.04506.30;+.NET+CLR+3.0.04506.648;+.NET+CLR+3.5.21022) Googlebot/2.1+(+http://www.googlebot.com/bot.html;+MSIE+7.0;+Windows+NT+5.1;+.NET+CLR+2.0.50727;+.NET+CLR+1.1.4322) Googlebot/2.1+(+http://www.googlebot.com/bot.html;+MSIE+7.0;+Windows+NT+5.1;+PeoplePal+3.0;+PeoplePal+6.2) Googlebot/2.1+(+http://www.googlebot.com/bot.html;+MSIE+7.0;+Windows+NT+5.1;+PeoplePal+3.0;+PeoplePal+6.2;+.NET+CLR+2.0.50727;+Media+Center+PC+3.0;+.NET+CLR+1.0.3705;+.NET+CLR+1.1.4322) Googlebot/2.1+(+http://www.googlebot.com/bot.html;+Windows;+U;+Windows+NT+6.0;+SLCC1;+.NET+CLR+2.0.50727;+.NET+CLR+3.0.04506) Googlebot/2.1+(+http://www.googlebot.com/bot.html] Googlebot/2.1+(+http://www.googlebot.com/bot.html} Googlebot/2.1+(+http://www.googlebot.com/bot+.html) Googlebot/2.1+(+http:www.googlebot.com/bot.html) Googlebot/2.1+(♦http://www.googlebot.com/bot.html) Googlebot/2.1+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html) Googlebot/2.1+(compatible;+MSIE;+Windows;+SV1;+.NET+CLR+1.1.4322;+.NET+CLR+2.0.50727) Googlebot/2.1+(compatible;+MSIE+7.0;+Windows+NT+5.1;+Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1)+;+.NET+CLR+1.1.4322;+MEGAUPLOAD+2.0;+.NET+CLR+2.0.50727) Googlebot/2.1+(Google's+crawler;+www.googlebot.com;+googlebot@google.com) GoogleBot/2.1+(http://googlebot.com/bot.html) Googlebot/2.1+(http://www.googlbot.com/bot.html) Googlebot/2.1+(http://www.google.com/bot.html) Googlebot/2.1+(http://www.google.com/bot/html) Googlebot/2.1+(http://www.googlebot.com/bot.html) Googlebot/2.1+(http://www.googlebot.com/bot.html)http://www.googlebot.com/bot.html Googlebot/2.1+[+http://www.googlebot.com/bot.html] Googlebot/2.1+++(++http://www.google.com/bot.html) Googlebot/2.1+++(++http://www.googlebot.com/bot.html) Googlebot/2.1+++(++http://www.googlebot.com/bot.html),gzip(gfe)+(via+translate.google.com) Googlebot/2.1+-+Google.com Googlebot/2.1w (+http://googlebot.com/bot.html) Googlebot/2.1w+(+http://googlebot.com/bot.html) Googlebot/2.3 (+http:\\www.googlebot.com/bot.html) Googlebot/2.3+(+http:\\www.googlebot.com/bot.html) Googlebot/2.X googlebot/2.X (+http://www.google.com/bot.html) Googlebot/2.X (+http://www.googlebot.com/bot.html) Googlebot/2.X (http://www.googlebot.com/bot.html) Googlebot/2.X larbin2.6.3@unspecified.mail googlebot/2.X+(+http://www.google.com/bot.html) Googlebot/2.X+(+http://www.googlebot.com/bot.html) Googlebot/2.X+(http://www.googlebot.com/bot.html) Googlebot/2.X+larbin2.6.3@unspecified.mail googlebot+1.0 Googlebot+2,1 Googlebot+2.1 Googlebot+2.1+(New+version) Googlebot+2.1+(New+version)"+useragent="Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html) Googlebot+2.1+ColdFire/1.1.51.59 Googlebot+2.1+FirePHP/0.2.1 Googlebot2.1 Googlebot-2.1 Googlebot-Image 1.0 Googlebot-Image/1.0 Googlebot-Image/1.0 Googlebot-Image/1.0 ( http://www.googlebot.com/bot.html) Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html Googlebot-Image/1.0 (+http://www.googlebot.com/bot.html) Googlebot-Image/1.0+(+http://www.googlebot.com/bot.html Googlebot-Image/1.0+(+http://www.googlebot.com/bot.html) Googlebot-Image+1.0+Googlebot-Image/1.0 Googlebot-Images GooglebotJZ.1 (+http:.//www.googlebot.com/bot.html) GooglebotJZ.1+(+http:.//www.googlebot.com/bot.html) Googlebot-Mobile Googlebot-w Googlebot-w/2.1 (+http://googlebot.com/bot.html) Googlebot-w/2.1+(+http://googlebot.com/bot.html) googlepages/Nutch-0.9 (googlepages; http://www.googlepages.com; info@googlepages.com) googlepages/Nutch-0.9+(googlepages;+http://www.googlepages.com;+info@googlepages.com) GoogleProject1/0.1 powered by http://superfrink.net/ GoogleProject1/0.1+powered+by+http://superfrink.net/ GoogleProjectTwo/0.1 powered by http://superfrink.net/ GoogleProjectTwo/0.1+powered+by+http://superfrink.net/ GoogleReport Search Engine - http://www.googlereport.org GoogleReport+Search+Engine+-+http://www.googlereport.org Google-Sitemaps/1.0 Googoebot/2.1 grabber Gran PC 5.1 Gran+PC+5.1 GranExplorer 1.0 (compatible; MSIE6.0; Windows NT 5.1) by Gran PC Software GranExplorer+1.0+(compatible;+MSIE6.0;+Windows+NT+5.1)+by+Gran+PC+Software grbot great-plains-web-spider/flatland(Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot.php; jason@flatlandindustries.com) great-plains-web-spider/flatland(Flatland+Industries+Web+Spider;+http://www.flatlandindustries.com/flatlandbot.php;+jason@flatlandindustries.com) great-plains-web-spider/flatlandbot (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot.php; jason@flatlandindustries.com) great-plains-web-spider/flatlandbot+(Flatland+Industries+Web+Spider;+http://www.flatlandindustries.com/flatlandbot.php;+jason@flatlandindustries.com) great-plains-web-spider/gpws (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot.php; jason@flatlandindustries.com) great-plains-web-spider/gpws+(Flatland+Industries+Web+Spider;+http://www.flatlandindustries.com/flatlandbot.php;+jason@flatlandindustries.com) gridwell (http://search.gridwell.com) gridwell+(http://search.gridwell.com) griffon/1.0 Gromit/1.0 Grub/2.0 (Grub.org crawler; http://www.grub.org/; bot@grub.org) Grub/2.0+(Grub.org+crawler;+http://www.grub.org/;+bot@grub.org) grub-client-1.5.3; (grub-client-1.5.3; Crawl your own stuff with http://grub.org) grub-client-1.5.3;+(grub-client-1.5.3;+Crawl+your+own+stuff+with+http://grub.org) gsa-crawler gsa-crawler ( http://www.googlebot.com/bot.html) gsa-crawler (Enterprise; [code]; gsa-admin@test.com) gsa-crawler (Enterprise; GID-01422; jplastiras@google.com) gsa-crawler (Enterprise; GIX-03519;) gsa-crawler (Enterprise; GIX-04637; rex_li@trend.com.tw) gsa-crawler (Enterprise; M2-AQEYHKEBVC2AB; eric@mobitv.com,mohamed@mobitv.com) gsa-crawler+(+http://www.googlebot.com/bot.html) gsa-crawler+(Enterprise;+[code];+gsa-admin@test.com) gsa-crawler+(Enterprise;+GID-01422;+jplastiras@google.com) gsa-crawler+(Enterprise;+GIX-03519;) gsa-crawler+(Enterprise;+GIX-04637;+rex_li@trend.com.tw) gsa-crawler+(Enterprise;+M2-AQEYHKEBVC2AB;+eric@mobitv.com,mohamed@mobitv.com) GSiteCrawler/NB GSiteCrawler/v1.20 rev. 273 (http://gsitecrawler.com/) GSiteCrawler/v1.20+rev.+273+(http://gsitecrawler.com/) GSiteCrawler/v1.23 rev. 286 (http://gsitecrawler.com/) GSiteCrawler/v1.23+rev.+286+(http://gsitecrawler.com/) Gulliver/1.1 Gulliver/1.2 Gulliver/1.3 Gulper Web 0.2.4 (www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot) Gulper Web Bot 0.2.4 (www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot) Gulper+Web+0.2.4+(www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot) Gulper+Web+Bot+0.2.4+(www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot) GurujiBot/1.0 (+http://www.guruji.com/en/WebmasterFAQ.html) GurujiBot/1.0 (+http://www.guruji.com/WebmasterFAQ.html) GurujiBot/1.0+(+http://www.guruji.com/en/WebmasterFAQ.html) GurujiBot/1.0+(+http://www.guruji.com/WebmasterFAQ.html) gvfs/1.0.2 Hackzilla/0.8.15 (Hackits 0.8.15; U; neXt Systems; en-GB; rv:0.8.1.5) spammo/20060508 Hackitfox/1.5.0.4 Hackzilla/0.8.15+(Hackits+0.8.15;+U;+neXt+Systems;+en-GB;+rv:0.8.1.5)+spammo/20060508+Hackitfox/1.5.0.4 hakiaBot/2.1 (vS) hakiaBot/2.1+(vS) HAL 9000; Cyberdyn X3; T1000 autonomous HAL+9000;+Cyberdyn+X3;+T1000+autonomous Hampsters Bumhole Hampsters+Bumhole Hatena Bookmark/0.1 Hatena::Crawler/0.01 Hatena+Bookmark/0.1 Hatena2::RemoteDocument/0.02 HatenaScreenshot (compatible; MSIE 6.0; Windows NT 5.1; SV1) HatenaScreenshot/1.0 (checker) HatenaScreenshot/1.0+(checker) HatenaScreenshot+(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1) havIndex/X.xx[bxx] Hazel's Ferret Web hopper, Hazel's+Ferret+Web+hopper, hbtronix.spider.1 -- http://hbtronix.de/spider.php hbtronix.spider.1+--+http://hbtronix.de/spider.php healia/Nutch-0.9 (the personalized health search engine.; http://www.healia.com; mikes@healia.com) healia/Nutch-0.9+(the+personalized+health+search+engine.;+http://www.healia.com;+mikes@healia.com) heartland A19F2B69-28D6-11DC-BCA0-00304852B7B8 heartland+A19F2B69-28D6-11DC-BCA0-00304852B7B8 Heeii backend ng 1.0 Java/1.5.0_14 Heeii backend ng 1.0 Java/1.6.0_03 heeii/LiveNode heeii/LiveNode Java/1.5.0_10 heeii/LiveNode+Java/1.5.0_10 Heeii/Nutch-0.8.1 (Heeii; www.heeii.com; info@heeii.com) Heeii/Nutch-0.8.1+(Heeii;+www.heeii.com;+info@heeii.com) Heeii/Nutch-0.9 (Heeii; www.heeii.com; info@heeii.com) Heeii/Nutch-0.9+(Heeii;+www.heeii.com;+info@heeii.com) heeii/Nuts Java/1.5.0_10 heeii/Nuts Java/1.5.0_14 heeii/Nuts Java/1.6.0 heeii/Nuts+Java/1.5.0_10 heeii/Nuts+Java/1.5.0_14 heeii/Nuts+Java/1.6.0 Heeii+backend+ng+1.0+Java/1.5.0_14 Heeii+backend+ng+1.0+Java/1.6.0_03 Heilbut HenryTheMiragoRo(http://www.miragorobot.com/scripts/mrinfo.asp) HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp) HenryTheMiragoRobot+(http://www.miragorobot.com/scripts/mrinfo.asp) HKU WWW Robot HKU+WWW+Robot hl_ftien_spider hl_ftien_spider/1.1(compatible; MSIE 5.00; Windows 98) hl_ftien_spider/1.1(compatible;+MSIE+5.00;+Windows+98) hl_ftien_spider_v1.1 HMSE_Robot HMSEbot Holiday Shopping, Inc. Holiday+Shopping,+Inc. holmes/3.10 (http://morfeo.centrum.cz/bot) holmes/3.10.1 (OnetSzukaj/5.0; +http://szukaj.onet.pl) holmes/3.10.1+(OnetSzukaj/5.0;++http://szukaj.onet.pl) holmes/3.10+(http://morfeo.centrum.cz/bot) holmes/3.11 (http://morfeo.centrum.cz/bot) holmes/3.11 (OnetSzukaj/5.0; +http://szukaj.onet.pl) holmes/3.11+(http://morfeo.centrum.cz/bot) holmes/3.11+(OnetSzukaj/5.0;++http://szukaj.onet.pl) holmes/3.12 (http://morfeo.centrum.cz/bot) holmes/3.12 (OnetSzukaj/5.0; +http://szukaj.onet.pl) holmes/3.12.1 (http://morfeo.centrum.cz/bot) holmes/3.12.1+(http://morfeo.centrum.cz/bot) holmes/3.12.2 (http://morfeo.centrum.cz/bot) holmes/3.12.2+(http://morfeo.centrum.cz/bot) holmes/3.12.3 (http://morfeo.centrum.cz/bot) holmes/3.12.3+(http://morfeo.centrum.cz/bot) holmes/3.12.4 (http://morfeo.centrum.cz/bot) holmes/3.12.4+(http://morfeo.centrum.cz/bot) holmes/3.12+(http://morfeo.centrum.cz/bot) holmes/3.12+(OnetSzukaj/5.0;++http://szukaj.onet.pl) holmes/3.9 (OnetSzukaj/5.0; http://szukaj.onet.pl) holmes/3.9 (OnetSzukaj/5.0; +http://szukaj.onet.pl) holmes/3.9+(OnetSzukaj/5.0;++http://szukaj.onet.pl) HolmesBot (http://holmes.ge) HolmesBot+(http://holmes.ge) Holy Shit (compatible; BlackNazi; Windows NT 5.1; WWW.BLACK-NAZI.COM) Holy+Shit+(compatible;+BlackNazi;+Windows+NT+5.1;+WWW.BLACK-NAZI.COM) Hometown Spider Pro Hometown+Spider+Pro Hostcrawler 0.1 (+http://contact.eweb.ws) Hostcrawler+0.1+(+http://contact.eweb.ws) HouxouCrawler/Nutch-0.8.2-dev (houxou.com's nutch-based crawler which serves special interest on-line communities; http://www.houxou.com/crawler; crawler at houxou dot com) HouxouCrawler/Nutch-0.8.2-dev+(houxou.com's+nutch-based+crawler+which+serves+special+interest+on-line+communities;+http://www.houxou.com/crawler;+crawler+at+houxou+dot+com) HouxouCrawler/Nutch-0.9 (houxou.com's nutch-based crawler which serves special interest on-line communities; http://www.houxou.com/crawler; crawler at houxou dot com) HouxouCrawler/Nutch-0.9+(houxou.com's+nutch-based+crawler+which+serves+special+interest+on-line+communities;+http://www.houxou.com/crawler;+crawler+at+houxou+dot+com) HPL/Nutch-0.9 HSmShSkki/0.2 HTC-8100/1.2 Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; PPC; 240x320) UP.Link/6.3.0.0.0 HTC-8100/1.2+Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+CE;+PPC;+240x320)+UP.Link/6.3.0.0.0 htdig/3.1.0b2 HTML Works 5.5 HTML+Works+5.5 HTML2JPG Blackbox, http://www.html2jpg.com HTML2JPG+Blackbox,+http://www.html2jpg.com HTMLgobble v2.2 HTMLgobble+v2.2 HTMLParser/1.41 HTMLParser/1.5 HTMLParser/1.6 HTTP agent HTTP Client HTTP Retriever http sample HTTP Spider/0.9 HTTP/1.0 http://Anonymouse.org/ (Unix) http://Anonymouse.org/+(Unix) http://buytaert.net/crawler http://crawler.spidergrid.net/1.0.5beta; http://gridgroup.de / http://narres.it/) http://crawler.spidergrid.net/1.0.5beta;+http://gridgroup.de+/+http://narres.it/) http://www.almaden.ibm.com/cs/crawler [bc15] http://www.almaden.ibm.com/cs/crawler [fc12] http://www.almaden.ibm.com/cs/crawler [bc20] http://www.almaden.ibm.com/cs/crawler [fc11] http://www.almaden.ibm.com/cs/crawler [hc5] http://www.almaden.ibm.com/cs/crawler+[bc20] http://www.almaden.ibm.com/cs/crawler+[fc11] http://www.almaden.ibm.com/cs/crawler+[hc5] http://www.almaden.ibm.com/cs/crawler+++[bc15] http://www.almaden.ibm.com/cs/crawler+++[fc12] http://www.google.com/bot.html http://www.googlebot.com/bot.html -http://www.googlebot.com/bot.html http://www.information-online.com/ http://www.sygol.com http://www.uni-koblenz.de/~flocke/robot-info.txt HTTP_CLIENT: QuickMarkClient HTTP_CLIENT:+QuickMarkClient HTTP+agent HTTP+Client HTTP+Retriever http+sample HTTP+Spider/0.9 HTTPConnect HttpProxy HttpSession httpunit/1.5 hunter/Nutch-0.8.1 hunter/Nutch-0.9 HyperEstraier/1.4.13 HyperEstraier/1.4.9 I Robot 0.4 (irobot@chaos.dk) I+Robot+0.4+(irobot@chaos.dk) i1searchbot/2.0 (i1search web crawler; http://www.i1search.com; crawler@i1search.com) i1searchbot/2.0+(i1search+web+crawler;+http://www.i1search.com;+crawler@i1search.com) ia_archiver ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com) ia_archiver/4.9 (Windows XP 1.8; en-US;) ia_archiver/4.9+(Windows+XP+1.8;+en-US;) ia_archiver+(+http://www.alexa.com/site/help/webmasters;+crawler@alexa.com) ia_archiver67 ia_archiver-web.archive.org 'IAGENT/1.0' iajaBot/0.1 iaskspider/2.0(+http://iask.com/help/help_index.html) IBM_Planetwide, IBrowse/2.3 (AmigaOS V51) IBrowse/2.3+(AmigaOS+V51) ICC-Crawler(Mozilla-compatible; http://kc.nict.go.jp/icc/crawl.html; icc-crawl(at)ml(dot)nict(dot)go(dot)jp) ICC-Crawler(Mozilla-compatible; http://kc.nict.go.jp/icc/crawl.html; icc-crawl-contact(at)ml(dot)nict(dot)go(dot)jp) ICC-Crawler(Mozilla-compatible;+http://kc.nict.go.jp/icc/crawl.html;+icc-crawl(at)ml(dot)nict(dot)go(dot)jp) ICC-Crawler(Mozilla-compatible;+http://kc.nict.go.jp/icc/crawl.html;+icc-crawl-contact(at)ml(dot)nict(dot)go(dot)jp) ICCrawler - ICjobs (http://www.icjobs.de/bot.htm) iCCrawler (http://www.iccenter.net) iCCrawler (http://www.iccenter.net/bot.htm) iCCrawler+(http://www.iccenter.net) iCCrawler+(http://www.iccenter.net/bot.htm) ICCrawler+-+ICjobs+(http://www.icjobs.de/bot.htm) ichiro/1.0 (ichiro@nttr.co.jp) ichiro/1.0+(ichiro@nttr.co.jp) ichiro/2.0 (http://help.goo.ne.jp/door/crawler.html) ichiro/2.0 (ichiro@nttr.co.jp) ichiro/2.0+(http://help.goo.ne.jp/door/crawler.html) ichiro/2.0+(ichiro@nttr.co.jp) ichiro/3.0 (http://help.goo.ne.jp/door/crawler.html) ichiro/3.0+(http://help.goo.ne.jp/door/crawler.html) Icon Grabber - Setup icon_download Icon+Grabber+-+Setup IEAutoDiscovery iexplore IIITBOT/1.1 (Indian Language Web Search Engine; http://webkhoj.iiit.net; pvvpr at iiit dot ac dot in) IIITBOT/1.1+(Indian+Language+Web+Search+Engine;+http://webkhoj.iiit.net;+pvvpr+at+iiit+dot+ac+dot+in) ilial/Nutch-0.9 (Ilial, Inc. is a Los Angeles based Internet startup company. For more information please visit http://www.ilial.com/crawler; http://www.ilial.com/crawler; crawl@ilial.com) ilial/Nutch-0.9 (Ilial, Inc. is a Los Angeles based Internet startup company.; http://www.ilial.com/crawler; crawl@ilial.com) ilial/Nutch-0.9+(Ilial,+Inc.+is+a+Los+Angeles+based+Internet+startup+company.;+http://www.ilial.com/crawler;+crawl@ilial.com) ilial/Nutch-0.9+(Ilial,+Inc.+is+a+Los+Angeles+based+Internet+startup+company.+For+more+information+please+visit+http://www.ilial.com/crawler;+http://www.ilial.com/crawler;+crawl@ilial.com) ilial/Nutch-0.9-dev IlseBot/1.0 IlseBot/1.1 IlTrovatore/1.2 (IlTrovatore; http://www.iltrovatore.it/bot.html; bot@iltrovatore.it) IlTrovatore/1.2+(IlTrovatore;+http://www.iltrovatore.it/bot.html;+bot@iltrovatore.it) IlTrovatore-Setaccio/1.2 (It search engine; http://www.iltrovatore.it/bot.html; bot@iltrovatore.it) IlTrovatore-Setaccio/1.2 (It-bot;compatible;MSIE 6.0;Mozilla/4.0; http://www.iltrovatore.it/bot.html; bot@iltrovatore.it) IlTrovatore-Setaccio/1.2+(It+search+engine;+http://www.iltrovatore.it/bot.html;+bot@iltrovatore.it) IlTrovatore-Setaccio/1.2+(It-bot;compatible;MSIE+6.0;Mozilla/4.0;+http://www.iltrovatore.it/bot.html;+bot@iltrovatore.it) Image Collector V1.1 Image+Collector+V1.1 imds_monitor/0.1 Inar_spider tspyyp@tom.com Inar_spider+tspyyp@tom.com IncyWincy/1.0b1 Indexer1063 inet library inet+library InetURL:/1.0 InetURL:/1.0;afcid=W6e19ed016dedc5cb43e7fa516dce24a0 Infinity/0.02 [shastye] (Win67; X; SK; ) Infinity/0.02+[shastye]+(Win67;+X;+SK;+) Infoaxe./Nutch-0.9 Informant InfoSeek Robot 1.0 Infoseek Sidewinder InfoSeek Sidewinder/0.9 InfoSeek+Robot+1.0 Infoseek+Sidewinder InfoSeek+Sidewinder/0.9 InfoSpiders/0.1 INGRID/0.1 inspectorwww/1.0 http://www.greenpac.com/inspectorwww.html inspectorwww/1.0+http://www.greenpac.com/inspectorwww.html Internet Cruiser Robot/2.1 Internet Explorer 4.01 Internet Explorer 7 Internet Ninja 5.0 Internet Ninja 6.0 Internet+Cruiser+Robot/2.1 Internet+Explorer+4.01 Internet+Explorer+7 Internet+Ninja+5.0 Internet+Ninja+6.0 InternetArchive/0.8-dev (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org) InternetArchive/0.8-dev+(Nutch;+http://lucene.apache.org/nutch/bot.html;+nutch-agent@lucene.apache.org) InternetSupervision (http://internetsupervision.com/urlmonitor/3) InternetSupervision+(http://internetsupervision.com/urlmonitor/3) IOI/2.0 (ISC Open Index crawler; http://index.isc.org/; bot@index.isc.org) IOI/2.0+(ISC+Open+Index+crawler;+http://index.isc.org/;+bot@index.isc.org) IP*Works! V5 HTTP/S Component - by /n software - www.nsoftware.com IP*Works!+V5+HTTP/S+Component+-+by+/n+software+-+www.nsoftware.com IP2LocationBot/1.00 http://www.ip2location.com IP2LocationBot/1.00+http://www.ip2location.com IP2MapBot/1.3 http://www.ip2map.com IP2MapBot/1.3+http://www.ip2map.com IP2PhraseBot/1.0 http://www.ip2phrase.com IP2PhraseBot/1.0+http://www.ip2phrase.com IPAddressGuideBot/1.0 http://www.ipaddressguide.com IPAddressGuideBot/1.0 http://ww IPAddressGuideBot/1.0 http://www.ipaddressguide.com IPAddressGuideBot/1.0+http://www.ipaddressguide.com IPAddressGuideBot/1.0+http://ww IPAddressGuideBot/1.0+http://www.ipaddressguide.com IPAddressGuideBot/1.1 http://www.ipaddressguide.com IPAddressGuideBot/1.1 http://www.ipaddressguide.com" IPAddressGuideBot/1.1+http://www.ipaddressguide.com IPAddressGuideBot/1.1+http://www.ipaddressguide.com" IRLbot/2.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler) IRLbot/2.0+(compatible;+MSIE+6.0;+http://irl.cs.tamu.edu/crawler) IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler) IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler/) IRLbot/3.0+(compatible;+MSIE+6.0;+http://irl.cs.tamu.edu/crawler) IRLbot/3.0+(compatible;+MSIE+6.0;+http://irl.cs.tamu.edu/crawler/) Iron33/0.0 IRP_edu_bot/Nutch-0.9 ISC Systems iRc Search 2.1 ISC+Systems+iRc+Search+2.1 iSEEKbot/iSEEKbot-0.9-dev (http://beta.iseek.com/iseekbot.html; at iseek dot com) iSEEKbot/iSEEKbot-0.9-dev (http://beta.iseek.com/iseekbot.html; bot at iseek dot com) iSEEKbot/iSEEKbot-0.9-dev+(http://beta.iseek.com/iseekbot.html;+at+iseek+dot+com) iSEEKbot/iSEEKbot-0.9-dev+(http://beta.iseek.com/iseekbot.html;+bot+at+iseek+dot+com) Isidorus/2.0 (Isidorus; http://www.isidorus.com; crawler@isidorus.com) Isidorus/2.0+(Isidorus;+http://www.isidorus.com;+crawler@isidorus.com) iSpider/1.0 IsraeliSearch/1.0 Its Me Dave Its+Me+Dave IUPUI Research Bot v 1.9a IUPUI+Research+Bot+v+1.9a iVia Downloader iVia Page Fetcher (http://ivia.ucr.edu/useragents.shtml) iVia+Downloader iVia+Page+Fetcher+(http://ivia.ucr.edu/useragents.shtml) IxHTTP_Get/3.2.3 (OS/2) IxHTTP_Get/3.2.3+(OS/2) JACK-O`-LANTERN/1.1 JadynAve - http://www.jadynave.com/robot JadynAve+-+http://www.jadynave.com/robot jak1471 Jakarta Commons-HttpClient/2.0.1 Jakarta Commons-HttpClient/2.0.2 Jakarta Commons-HttpClient/2.0final Jakarta Commons-HttpClient/3.0 Jakarta Commons-HttpClient/3.0.1 Jakarta Commons-HttpClient/3.0-rc1 Jakarta Commons-HttpClient/3.0-rc2 Jakarta Commons-HttpClient/3.0-rc4 Jakarta Commons-HttpClient/3.0-rcx Jakarta Commons-HttpClient/3.1 Jakarta Commons-HttpClient/3.1-alpha1 Jakarta Commons-HttpClient/3.1-rc1 Jakarta+Commons-HttpClient/2.0.1 Jakarta+Commons-HttpClient/2.0.2 Jakarta+Commons-HttpClient/2.0final Jakarta+Commons-HttpClient/3.0 Jakarta+Commons-HttpClient/3.0.1 Jakarta+Commons-HttpClient/3.0-rc1 Jakarta+Commons-HttpClient/3.0-rc2 Jakarta+Commons-HttpClient/3.0-rc4 Jakarta+Commons-HttpClient/3.0-rcx Jakarta+Commons-HttpClient/3.1 Jakarta+Commons-HttpClient/3.1-alpha1 Jakarta+Commons-HttpClient/3.1-rc1 Jambot/0.1.1 (Jambot; http://www.jambot.com/blog; crawler@jambot.com) Jambot/0.1.1+(Jambot;+http://www.jambot.com/blog;+crawler@jambot.com) Java 1.5 / IBM HTML Commons Java(TM) 2 Runtime Environment, Standard Edition Java(TM)+2+Runtime+Environment,+Standard+Edition Java/1.4.1_01 Java/1.4.1_04 Java/1.4.2 Java/1.4.2_01 Java/1.4.2_02 Java/1.4.2_03 Java/1.4.2_04 Java/1.4.2_05 Java/1.4.2_07 Java/1.4.2_08 Java/1.4.2_09 Java/1.4.2_10 Java/1.4.2_11 Java/1.4.2_12 Java/1.4.2_13 Java/1.4.2_16 Java/1.5.0 Java/1.5.0_01 Java/1.5.0_02 Java/1.5.0_03 Java/1.5.0_04 Java/1.5.0_05 Java/1.5.0_06 Java/1.5.0_07 Java/1.5.0_08 Java/1.5.0_09 Java/1.5.0_10 Java/1.5.0_11 Java/1.5.0_12 Java/1.5.0_13 Java/1.5.0_14 Java/1.5.0_15 Java/1.5.0-p3 Java/1.6.0 Java/1.6.0_01 Java/1.6.0_01-ea Java/1.6.0_02 Java/1.6.0_03 Java/1.6.0_04 Java/1.6.0_05 Java/1.6.0_05-ea Java/1.6.0_06 Java/1.6.0_07 Java/1.6.0_10 Java/1.6.0_10-beta Java/1.6.0-beta Java/1.6.0-beta2 Java/1.6.0-dp Java/1.6.0-oem Java/1.6.0-rc Java/1.7.0 Java+1.5+/+IBM+HTML+Commons Java1.1.8 Java1.2.2 Java1.3.0 Java1.3.1 Java1.3.1_07 Java1.3.1_18 Java1.4.0 Java1.4.0_01 JavaBee javascript:void(setUserAgent('bwh3_user_agent')); javascript:void(setUserAgent('Googlebot/2.1+(+http://www.google.com/bot.html)')); JCrawler/0.2 JetBrains Omea Reader 2.2 (http://www.jetbrains.com/omea/reader/) JetBrains+Omea+Reader+2.2+(http://www.jetbrains.com/omea/reader/) Jigsaw/2.2.5 W3C_CSS_Validator_JFouffa/2.0 Jigsaw/2.2.5+W3C_CSS_Validator_JFouffa/2.0 JoBo (can be modified by the user) JoBo/1.x (http://www.matuschek.net/jobo.html) JoBo/1.x+(http://www.matuschek.net/jobo.html) JoBo+(can+be+modified+by+the+user) Jobot/0.1alpha libwww-perl/4.0 Jobot/0.1alpha+libwww-perl/4.0 JoeBot/x.x, JubiiRobot/version# JuicyBits_Indexer_0.02 JuicyBits_MAIL_Search_0.02 JuicyBits_Search_0.04 JuicyBits_URL_Search_0.14 jumpstation Jyxobot/1 Kakle- www.kakle.com/0.1 (Kakle- www.kakle.com; http://www.kakle.com/bot.html; support@kakle.com) Kakle-+www.kakle.com/0.1+(Kakle-+www.kakle.com;+http://www.kakle.com/bot.html;+support@kakle.com) KakleBot - www.kakle.com/0.1 (KakleBot - www.kakle.com; http://www.kakle.com/bot.html; support@kakle.com) KakleBot+-+www.kakle.com/0.1+(KakleBot+-+www.kakle.com;+http://www.kakle.com/bot.html;+support@kakle.com) kakle-spider/0.1 (kakle-spider; http://www.kakle.com/bot.html; support@kakle.com) kakle-spider/0.1+(kakle-spider;+http://www.kakle.com/bot.html;+support@kakle.com) kalooga/kalooga-3.4-datahouse (Kalooga; http://www.kalooga.com; info@kalooga.com) kalooga/kalooga-3.4-datahouse+(Kalooga;+http://www.kalooga.com;+info@kalooga.com) kalooga/kalooga-4.0-dev-datahouse (Kalooga; http://www.kalooga.com; info@kalooga.com) kalooga/kalooga-4.0-dev-datahouse+(Kalooga;+http://www.kalooga.com;+info@kalooga.com) kalooga/KaloogaBot (Kalooga; http://www.kalooga.com/info.html?page=crawler) kalooga/KaloogaBot (Kalooga; http://www.kalooga.com/info.html?page=crawler; crawler@kalooga.com) kalooga/KaloogaBot (Kalooga; http://www.kalooga.com; info@kalooga.com) kalooga/KaloogaBot+(Kalooga;+http://www.kalooga.com/info.html?page=crawler) kalooga/KaloogaBot+(Kalooga;+http://www.kalooga.com/info.html?page=crawler;+crawler@kalooga.com) kalooga/KaloogaBot+(Kalooga;+http://www.kalooga.com;+info@kalooga.com) Katipo/1.0 Kazehakase/0.4.3 KBeeBot/0.5 Robot KBeeBot/0.5+Robot KDD-Explorer/0.1 KDDI-CA33 UP.Browser/6.2.0.10.4 (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html) KDDI-CA33 UP.Browser/6.2.0.10.4 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html) KDDI-CA33+UP.Browser/6.2.0.10.4+(compatible;+Y!J-SRD/1.0;+http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html) KDDI-CA33+UP.Browser/6.2.0.10.4+(GUI)+MMP/2.0+(compatible;+Googlebot-Mobile/2.1;++http://www.google.com/bot.html) Keep Out. Keep+Out. Keyword Density Analyzer v1.01 ( http://www.ranks.nl/tools/spider.html ) Keyword+Density+Analyzer+v1.01+(+http://www.ranks.nl/tools/spider.html+) KIT_Fireball/2.0 KIT-Fireball/2.0 libwww/5.0a K-Meleon/0.6 (Windows; U; Windows NT 5.1; en-US; rv:0.9.5) Gecko/20011011 K-Meleon/0.6+(Windows;+U;+Windows+NT+5.1;+en-US;+rv:0.9.5)+Gecko/20011011 Knight/0.2 (Zook Knight; http://knight.zook.in/; knight@zook.in) Knight/0.2+(Zook+Knight;+http://knight.zook.in/;+knight@zook.in) KnowItAll(knowitall@cs.washington.edu) KnowItAll/Nutch-0.9 (Nutch-UW-Crawler; http://cs.washington.edu/homes/mjc/crawler.html; uwcrawler08@gmail.com) KnowItAll/Nutch-0.9+(Nutch-UW-Crawler;+http://cs.washington.edu/homes/mjc/crawler.html;+uwcrawler08@gmail.com) KO_Yappo_Robot/1.0.4(http://yappo.com/info/robot.html) kooba Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1 kooba+Mozilla/5.0+(Windows;+U;+Windows+NT+5.1;+pl;+rv:1.8.1.1)+Gecko/20061204+Firefox/2.0.0.1 KRetrieve/1.1/dbsearchexpert.com Krugle/Krugle,Nutch/0.8+ (Krugle web crawler; http://corp.krugle.com/crawler/info.html; webcrawler@krugle.com) Krugle/Krugle,Nutch/0.8+ (Krugle web crawler; http://www.krugle.com/crawler/info.html; webcrawler@krugle.com) Krugle/Krugle,Nutch/0.8++(Krugle+web+crawler;+http://corp.krugle.com/crawler/info.html;+webcrawler@krugle.com) Krugle/Krugle,Nutch/0.8++(Krugle+web+crawler;+http://www.krugle.com/crawler/info.html;+webcrawler@krugle.com) KS Spider/Nutch-0.9 KS+Spider/Nutch-0.9 ksibot/8.0d (+http://ego.ms.mff.cuni.cz/) ksibot/8.0d+(+http://ego.ms.mff.cuni.cz/) kufcew8xogtibspWmwisigxfc8sbaoactaw KWC-KX16/1.0.26 UP.Browser/6.2.3.6 (GUI) MMP/2.0 KWC-KX16/1.0.26+UP.Browser/6.2.3.6+(GUI)+MMP/2.0 kxipykvDdkpddptsidyhDac LabelGrab/1.1 lanshanbot/1.0 (+http://search.msn.com/msnbot.htm) lanshanbot/1.0+(+http://search.msn.com/msnbot.htm) LapozzBot/1.4 (+http://robot.lapozz.com) LapozzBot/1.4 (+http://robot.lapozz.hu) LapozzBot/1.4+(+http://robot.lapozz.com) LapozzBot/1.4+(+http://robot.lapozz.hu) LapozzBot/1.5 (+http://robot.lapozz.hu) LapozzBot/1.5+(+http://robot.lapozz.hu) larbin (+mail) larbin_2.6.1 larbin2.6.1@unspecified.mail larbin_2.6.1+larbin2.6.1@unspecified.mail larbin_2.6.3 (larbin2.6.3@unspecified.mail) larbin_2.6.3 atat@cs.bilkent.edu.tr larbin_2.6.3 gqnmgsp@ruc.edu.cn larbin_2.6.3 larbin2.6.3@unspecified.mail larbin_2.6.3 wgao@genieknows.com larbin_2.6.3+(larbin2.6.3@unspecified.mail) larbin_2.6.3+atat@cs.bilkent.edu.tr larbin_2.6.3+gqnmgsp@ruc.edu.cn larbin_2.6.3+larbin2.6.3@unspecified.mail larbin_2.6.3+wgao@genieknows.com larbin_xy250 larbin2.6.3@unspecified.mail larbin_xy250+larbin2.6.3@unspecified.mail larbin+(+mail) LarbinWebCrawler (spider@download11.com) LarbinWebCrawler internet@bredband.net LarbinWebCrawler spider@download11.com LarbinWebCrawler+(spider@download11.com) LarbinWebCrawler+internet@bredband.net LarbinWebCrawler+spider@download11.com LargeSmall Crawler LargeSmall+Crawler LBot LeechGet 2006 (www.leechget.net) LeechGet+2006+(www.leechget.net) legs LG-C1500 UP.Browser/6.2.3 (GUI) MMP/1.0 (compatible;YahooSeeker/M1A1-R2D2; http://help.yahoo.com/help/us/ysearch/crawling/crawling-01.html) LG-C1500+UP.Browser/6.2.3+(GUI)+MMP/1.0+(compatible;YahooSeeker/M1A1-R2D2;+http://help.yahoo.com/help/us/ysearch/crawling/crawling-01.html) LGE-VX8100/1.0 UP.Browser/6.2.3.2 (GUI) MMP/2.0 LGE-VX8100/1.0+UP.Browser/6.2.3.2+(GUI)+MMP/2.0 libcurl libcurl-agent/1.0 libwww-perl/5.36 libwww-perl/5.45 libwww-perl/5.50 libwww-perl/5.53 libwww-perl/5.63 libwww-perl/5.65 libwww-perl/5.68 libwww-perl/5.69 libwww-perl/5.75 libwww-perl/5.76 libwww-perl/5.800 libwww-perl/5.801 libwww-perl/5.802 libwww-perl/5.803 libwww-perl/5.805 libwww-perl/5.806 libwww-perl/5.808 libwww-perl/5.810 libwww-perl/5.811 libwww-perl/5.812 libwww-perl/5.813 libwww-perl/5.814 libwww-perl/5.816 libwww-perl/5.819 libwww-perl/5.820 libwww-perl-5.41 LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/; info(a)lijit(d)com) LijitSpider/Nutch-0.9 (Reports crawler; http://www.lijit.com/robot/crawler; info(a)lijit(d)com) LijitSpider/Nutch-0.9+(Reports+crawler;+http://www.lijit.com/;+info(a)lijit(d)com) LijitSpider/Nutch-0.9+(Reports+crawler;+http://www.lijit.com/robot/crawler;+info(a)lijit(d)com) link_checker/1.1 LinkAider Linkidator/0.93 Links SQL (http://gossamer-threads.com/scripts/links-sql/) Links+SQL+(http://gossamer-threads.com/scripts/links-sql/) LinkScan Server/5.5 | LinkScan Workstation/5.5 LinkScan+Server/5.5+|+LinkScan+Workstation/5.5 LinkSiteMaker/1.0 (+http://www.sasfead.com) LinkSiteMaker/1.0+(+http://www.sasfead.com) LinksManager.com (http://linksmanager.com/linkchecker.html) LinksManager.com+(http://linksmanager.com/linkchecker.html) LinkWalker LinkWalker/2.0 linux null linux+null LinxChequer/1.0 ljt_ignoreme:14998 LMQueueBot/0.2 lmspider/Nutch-0.9-dev (For research purposes.; www.nuance.com; lmspider@nuance.com) lmspider/Nutch-0.9-dev+(For+research+purposes.;+www.nuance.com;+lmspider@nuance.com) LocalcomBot/1.2 (+http://www.local.com/bot.htm) LocalcomBot/1.2.2 (+http://www.local.com/bot.htm) LocalcomBot/1.2.2+(+http://www.local.com/bot.htm) LocalcomBot/1.2+(+http://www.local.com/bot.htm) LocalcomBot/1.3.0 (+http://www.local.com/bot.htm) LocalcomBot/1.3.0+(+http://www.local.com/bot.htm) locallytargetbot/locallybotV2 (locallybotV2; http://www.locallytarget.com; bot@locallytarget.com) locallytargetbot/locallybotV2+(locallybotV2;+http://www.locallytarget.com;+bot@locallytarget.com) Lockon/xxxxx logo.gif crawler logo.gif+crawler Lovel as 1.0 ( +http://www.everatom.com) Lovel+as+1.0+(++http://www.everatom.com) Lsearch/sondeur LTH Browser 3.02a (compatible; mozilla ; Windows NT 5.1; SV1; http://www.learntohack.nil; .NET CLR 1.1.4322; http://www.learntohack.nil) LTH Browser 3.02a (compatible; mozilla; Windows NT 5.1; SV1; http://www.learntohack.nil; .NET CLR 1.1.4322; http://www.learntohack.nil) LTH Browser/3.02a LTH Browser/3.02a (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322) LTH Browser/3.02a (http://www.learntohack.nil) LTH Browsery\3.02a (Windows NT 5.1; U) LTH+Browser/3.02a LTH+Browser/3.02a+(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+.NET+CLR+1.1.4322) LTH+Browser/3.02a+(http://www.learntohack.nil) LTH+Browser+3.02a+(compatible;+mozilla;+Windows+NT+5.1;+SV1;+http://www.learntohack.nil;+.NET+CLR+1.1.4322;+http://www.learntohack.nil) LTH+Browser+3.02a+(compatible;+mozilla+;+Windows+NT+5.1;+SV1;+http://www.learntohack.nil;+.NET+CLR+1.1.4322;+http://www.learntohack.nil) LTH+Browsery\3.02a+(Windows+NT+5.1;+U) LTI/LemurProject Nutch Spider/Nutch-1.0-dev (lti cra