User Agent String.Com 

 

List of all Crawlers

ABACHOBotABACHOBot

Abacho's spider. German based portal and search engine. Has localized versions in the following countries: Austria, Switzerland, France, UK, Spain, Italy, Sweden and Turkey.

Click on any string to get more details

ABACHOBot

AbiLogicBot

Checkes links for the AbiLogic web directory

Click on any string to get more details

AbiLogicBot 1.0

Accoona-AI-AgentAccoona-AI-Agent

Accoona's webcrawler

Click on any string to get more details

Accoona-AI-Agent 1.1.1

AnyApexBot

Crawler for the web directory AnyApex

Click on any string to get more details

AnyApexBot 1.0

Arachmo

Japanese Crawler. Seems to be a download tool. Here's some information in japanese. If you can translate than, please let me know

Click on any string to get more details

Arachmo

B-l-i-t-z-B-O-T

Crawler for the German search engine tricus. Spiders German, Dutch, Swiss and Austrian websites. Same as BlitzBOT

Click on any string to get more details

B-l-i-t-z-B-O-T

BaiduspiderBaiduspider

Crawler for the chinese search engine Baidu

Click on any string to get more details

Baiduspider

BecomeBotBecomeBot

Become crawler. Shopping related portal

Click on any string to get more details

BecomeBot 3.0

BecomeBot 2.3

Bimbot

Unknown crawler, gives no information. IP address belongs to Backbone Communications Inc. (BBCOM). Provides converged data and voice services

Click on any string to get more details

Bimbot 1.0

BlitzBOT

Crawler for the German search engine tricus. Spiders German, Dutch, Swiss and Austrian websites. Same as B-l-i-t-z-B-O-T

Click on any string to get more details

BlitzBOT

boitho.com-dc

Boitho's Web Crawler, a distributed crawler that downloads web pages to build the database used by Boitho.com to search in. To allow volunteers to donate their superfluous bandwidth and idle CPU time, they have developed a distributed crawler, like seti@home and Grub. That way people can install a program on their computers and help them with the crawling.

Click on any string to get more details

boitho.com-dc 0.85

boitho.com-dc 0.83

boitho.com-dc 0.82

boitho.com-dc 0.81

boitho.com-dc 0.79

boitho.com-robot

This is an old version of Boitho's boitho.com-dc. It was a more traditional webrobot, run on computers controlled by Boitho, while boitho.com-dc is a distributed crawler run on the computers of volunteers.
The boitho.com-robot isn’t in use any more.

Click on any string to get more details

boitho.com-robot 1.1

boitho.com-robot 1.0

btbot

btbot's search engine for bittorrents, ringtones for cell phones, friends and extraterrestrial intelligence

Click on any string to get more details

btbot 0.4

Cerberian Drtrs


Click on any string to get more details

Cerberian Drtrs 3.2

ConveraCrawler

ConveraCrawler is an experimental web crawler under development since April 2004. ConveraCrawler is owned and operated by Convera Corporation

Click on any string to get more details

ConveraCrawler 0.9d

ConveraCrawler 0.9

cosmos

Crawler from xyleme which indexes XML content on the web.

Click on any string to get more details

cosmos 0.9

DataparkSearchDataparkSearch

Open source web-based search engine released under the GNU General Public License and designed to organize search within a website, group of websites, intranet or local system. DataparkSearch consists of two parts. The first part is indexing mechanism (indexer). Indexer walks over html hypertext references and stores found words and new references into database. The second part is web CGI front-end to provide search using data collected by indexer.

Click on any string to get more details

DataparkSearch 4.37

DataparkSearch 4.36

DataparkSearch 4.35

DiamondBot

Crawler for Claria (formerly Gator). Adware company

Click on any string to get more details

DiamondBot

EmeraldShield.com WebBot

Crawls domains as part of a spam and web filtration services. If a site is determined to contain questionable, or objectionable content it will be added to a blocklist. Ignores the robots.txt file

Click on any string to get more details

EmeraldShield.com WebBot

envolk[ITS]spider

envolk search engine spider [ITS] Internet Tracking Spider(TM)

Click on any string to get more details

envolk[ITS]spider 1.6

EsperanzaBot

Web Crawler of Esperanza Consulting LTD

Click on any string to get more details

EsperanzaBot

Exabot

Exava shopping search engine, belongs now to Become

Click on any string to get more details

Exabot 2.0

FAST Enterprise Crawler

Product of the norvegian company Fast. Part of their FAST ProPublish solution for gathering, processing and delivering reference material to online and offline users.

Click on any string to get more details

FAST Enterprise Crawler 6

FAST-WebCrawler

Crawler for the Fast search engine

Click on any string to get more details

FAST-WebCrawler 3.x

FAST-WebCrawler 3.8

FAST-WebCrawler 3.7

FAST-WebCrawler 3.6

FDSE robotFDSE robot

Search engine of Fluid Dynamics Software Corporation

Click on any string to get more details

FDSE robot

FindLinks

A project of the Automated Speech Processing Group at the Institute of Computer Science at Universität Leipzig.

Click on any string to get more details

FindLinks 1.1.4-beta1

FindLinks 1.1.3-beta9

FindLinks 1.1.3-beta8

FindLinks 1.1.3-beta6

FindLinks 1.1.3-beta4

FindLinks 1.1.3-beta2

FindLinks 1.1.3-beta1

FindLinks 1.1.2-a5

FindLinks 1.1.1-a5

FindLinks 1.1.1-a1

FindLinks 1.1.1

FindLinks 1.1-a9

FindLinks 1.1-a8

FindLinks 1.1-a7

FindLinks 1.1-a5

FindLinks 1.1-a4

FindLinks 1.1-a3

FindLinks 1.1

FindLinks 1.06

FindLinks 1.0.9

FindLinks 1.0.8

FindLinks 1.0

FurlBot

Furl's crawler. Furl is a social bookmark service from LookSmart

Click on any string to get more details

FurlBot Furl Search 2.0

FyberSpiderFyberSpider

FyberSearch web crawler

Click on any string to get more details

FyberSpider

g2crawler

g2crawler : Gnutella2Crawler codename Aenea. Not in use anymore.

Click on any string to get more details

g2crawler

GaisbotGaisbot

Gais - Global Area Information Servers - Search enginge crawler of the National Chung Cheng University Taiwan

Click on any string to get more details

Gaisbot 3.0+

Gaisbot 3.0

genieBot

Web-indexing robot of GenieKnows Local Search Engine

Click on any string to get more details

genieBot

GigabotGigabot

Gigablast's indexing agent

Click on any string to get more details

Gigabot 3.0

Gigabot 2.0

Gigabot 1.0

GirafabotGirafabot


Click on any string to get more details

Girafabot

GooglebotGooglebot


Click on any string to get more details

Googlebot 2.1

Googlebot-ImageGooglebot-Image

Google's image crawler

Click on any string to get more details

Googlebot-Image 1.0

hl_ftien_spider

Web Crawler from China. IP addresses belong to Qipusi Technology Ltd and Rongzhengwuye-ltd from Tjanjin city

Click on any string to get more details

hl_ftien_spider 1.1

hl_ftien_spider

htdig

Crawler of the ht://Dig Group's software package, a system for indexing and searching a finite (not necessarily small) set of sites or intranet. It is not meant to replace any of the many internet-wide search engines. htdig retrieves HTML documents using the HTTP protocol.

Click on any string to get more details

htdig 3.1.6

htdig 3.1.5

ia_archiveria_archiver

Alexa Web crawler

Click on any string to get more details

ia_archiver

ichiro

Japanese Webcrawler for Goo

Click on any string to get more details

ichiro 2.0

IRLbot

IRL-crawler is a Texas A&M University research project sponsored in part by the National Science Foundation that investigates algorithms for mapping the topology of the Internet and discovering the various parts of the web. The crawler downloads random web pages (text only) and follows certain links to find other websites.

Click on any string to get more details

IRLbot 2.0

IssueCrawlerIssueCrawler

Govcom.org Foundation's web bot. Locates and visualizes networks on the Web. The Issue Crawler is used by NGOs and other researchers to answer questions about specific networks and effective networking more generally. You also may do in-depth research with the software. You need an account to use it.

Click on any string to get more details

IssueCrawler

Java


Click on any string to get more details

Java 1.6.0_04

Java 1.6.0_03

Java 1.6.0_02

Java 1.6.0-beta

Java 1.5.0_11

Java 1.5.0_08

Java 1.5.0_06

Java 1.5.0_05

Java 1.5.0_04

Java 1.5.0_03

Java 1.5.0_02

Java 1.5.0_01

Java 1.5.0

Java 1.4.2_11

Java 1.4.2_10

Java 1.4.2_09

Java 1.4.2_08

Java 1.4.2_07

Java 1.4.2_05

Java 1.4.2_04

Java 1.4.2_03

Java 1.4.2_01

Java 1.4.2

Java 1.4.1_04

Java 1.4.1_03

Java 1.4.1_02

Java 1.4.1_01a

Java 1.4.1_01

Java 1.4.1-p3

Java 1.4.1

Java 1.4.0_03

Java 1.4.0_02

Java 1.4.0_01

Java 1.4.0

Java 1.3.1_06

Java 1.3.1_04

Java 1.3.1

Java 1.3.0

Java 1.2.2-JDeveloper

Java 1.2.2

Java 1.2.1

Jyxobot

Czech Webcrawler for Jyxo

Click on any string to get more details

Jyxobot 1

LapozzBotLapozzBot

Hungarian bot. Spiders for the Lapozz search engine.
Üdvözlöm !?!

Click on any string to get more details

LapozzBot 1.4

Larbin

Multi-purpose web crawler

Click on any string to get more details

Larbin spider@download11.co

Larbin 5.0

Larbin 2.6.3

Larbin 2.6.2

Larbin 2.6.1

Larbin 2.5.0

Larbin

libwww-perl


Click on any string to get more details

libwww-perl 5.808

libwww-perl 5.805

libwww-perl 5.803

libwww-perl 5.800

libwww-perl 5.76

libwww-perl 5.75

libwww-perl 5.69

libwww-perl 5.65

libwww-perl 5.64

libwww-perl 5.63

libwww-perl 5.53

libwww-perl 5.50

libwww-perl 5.48

libwww-perl 5.36

LinkWalker

SEVENtwentyfour Inc Link Checker

Click on any string to get more details

LinkWalker 2.0

LinkWalker

lmspider

Collects text from the web as part of a research project at Scansoft (renamed Nuance) ,trying to use web documents to improve the linguistic models used in their speech recognition engine

Click on any string to get more details

lmspider

lwp-trivial

lwp-trivial is the user-agent associated with the Perl code Module LWP::Simple

Click on any string to get more details

lwp-trivial 1.41

lwp-trivial 1.38

lwp-trivial 1.36

lwp-trivial 1.35

lwp-trivial 1.33

mabontland

Crawler for the web directory mabontland

Click on any string to get more details

mabontland

Mediapartners-GoogleMediapartners-Google

Unregistered versions of opera prior to 8.5 contained advertising. To serve up relevant adverts based on what you are browsing Google provided these adverts.
More information

Click on any string to get more details

Mediapartners-Google 2.1

MJ12botMJ12bot

Majestic-12 Web Crawler

Click on any string to get more details

MJ12bot v1.0.8

MJ12bot v1.0.7

MJ12bot v1.0.6

MJ12bot v1.0.5

MnogosearchMnogosearch

Web search engine software for intranet and internet servers from Mnogosearch.org (a project of Lavtech)

Click on any string to get more details

Mnogosearch 3.1.21

mogimogi

Unclear. The IP address belongs to Goo but they don't give any information about that bot. Goo itself uses ichiro for their search engine

Click on any string to get more details

mogimogi 1.0

MojeekBotMojeekBot

MojeekBot (formerly Citenikbot) is the web crawler for the Mojeek search engine.

Click on any string to get more details

MojeekBot 2.0

MojeekBot 0.2

Morning Paper

Crawler for Boutell.com.

Click on any string to get more details

Morning Paper 1.0

msnbotmsnbot

MSN (or Microsoft Service Network) Search Web Crawler

Click on any string to get more details

msnbot 1.1

msnbot 1.0

msnbot 0.9

msnbot 0.11

msnbot 0.1

MSRBot

Microsoft Research web crawler

Click on any string to get more details

MSRBot

MVAClient

I have no information about this one. The ip address belongs to Chunghwa Telecom Co.,Ltd. in Taiwan. It is blacklisted by SORBS. If you know anything about this bot please let me know

Click on any string to get more details

MVAClient

NetResearchServer

Spider for LOOP Improvements. Crawls the web by using the links found in the DMOZ Open Directory Project.

Click on any string to get more details

NetResearchServer 4.0

NetResearchServer 3.5

NetResearchServer 2.8

NetResearchServer 2.7

NetResearchServer 2.5

NetResearchServer

NG-SearchNG-Search

NG-Search is experimental searchengine with new semantic trials to list the most relevance words and groups around your query

Click on any string to get more details

NG-Search 0.9.8

NG-Search 0.86

nicebot


Click on any string to get more details

nicebot

noxtrumbot

Spanish search engine for Spanish and Portuguese pages. Belongs to TPI, Telefónica Publicidad e Información, S.A

Click on any string to get more details

noxtrumbot 1.0

Nusearch Spider

Crawls for the Nusearch search engine. Customizable search engine with some additional features like active bookmarks, and alternative result views.

Click on any string to get more details

Nusearch Spider

NutchCVS

Open source robot

Click on any string to get more details

NutchCVS 0.8-dev

NutchCVS 0.7.2

NutchCVS 0.7.1

NutchCVS 0.7

NutchCVS 0.06-dev

NutchCVS 0.05

obot

German spider from Cobion, now part of Internet Security Systems. Scans the web for their clients looking for copyright infringement

Click on any string to get more details

obot

oegp

The IP address belongs to the Deutsche Telekom in Germany. They don't give any information about that crawler. IP address is blacklisted

Click on any string to get more details

oegp 1.3.0

OmniExplorer_Bot

New crawler for Omni-Explorer. Site not launched yet (February 06)

Click on any string to get more details

OmniExplorer_Bot 6.70

OmniExplorer_Bot 6.65a

OmniExplorer_Bot 6.63b

OmniExplorer_Bot 6.62

OmniExplorer_Bot 6.60

OmniExplorer_Bot 6.47

OmniExplorer_Bot 5.91c

OmniExplorer_Bot 5.28

OmniExplorer_Bot 5.25

OmniExplorer_Bot 5.20

OmniExplorer_Bot 5.01

OmniExplorer_Bot 4.80

OmniExplorer_Bot 4.32

OrbiterOrbiter

Spider for DailyOrbit search engine. Visits only the homepage of a domain.

Click on any string to get more details

Orbiter

PageBitesHyperBotPageBitesHyperBot

Crawler for PageBites, a search engine for job openings and/or résumés. You can also post your résumé and/or job opening to them.

Click on any string to get more details

PageBitesHyperBot 600

polybot

Polybot is a distributed web crawler developed in the Department of Computer and Information Science at Polytechnic University as part of an academic research project that explores new techniques for searching and analyzing the World Wide Web. This bot is not connected to the search site www.polybot.com and it has nothing to do with the virus of the same name

Click on any string to get more details

polybot 1.0

Pompos

Crawler for the french search engine dir

Click on any string to get more details

Pompos 1.3

Pompos 1.2

Pompos 1.1

PsbotPsbot

Image crawler from Picsearch. Indexes images from the web

Click on any string to get more details

Psbot 0.1

PycURL

PycURL is a Python interface to libcurl. PycURL can be used to fetch objects identified by a URL from a Python program, similar to the urllib Python module

Click on any string to get more details

PycURL 7.13.2

PycURL

Python-urllib

Phyton Module for fetching data across the World Wide Web

Click on any string to get more details

Python-urllib 2.5

Python-urllib 2.4

Python-urllib 2.1

Python-urllib 2.0a1

Python-urllib 1.16

Python-urllib 1.15

RAMPyBot

RAMPyBot is giveRamp's (give Relevant Answers with Meticulous Precision) spider. Belongs to Gomvents

Click on any string to get more details

RAMPyBot 0.1

RufusBot

Web Crawler from Webaroo

Click on any string to get more details

RufusBot

SandCrawler

This one belongs to Microsoft. No idea what they are spidering with this one.

Click on any string to get more details

SandCrawler

SBIder

SiteSell web crawler

Click on any string to get more details

SBIder 0.8-dev

ScrubbyScrubby

Scrub the web's crawler

Click on any string to get more details

Scrubby 2.2

Scrubby 2.1

SearchSightSearchSight

Search engine and directory

Click on any string to get more details

SearchSight 2.0

SeekbotSeekbot

Spider for the european seekport search engine.

Click on any string to get more details

Seekbot 1.0

semanticdiscovery

The Semantic Discovery robot collects content from the web to be matched into focused "product and service" taxonomies and then published in multiple search engine directories.

Click on any string to get more details

semanticdiscovery 0.1

Sensis Web CrawlerSensis Web Crawler


Click on any string to get more details

Sensis Web Crawler

SEOChat::Bot


Click on any string to get more details

SEOChat::Bot v1.1

Shim-Crawler

Japanese crawler, collects web pages for researches related to web-search and data mining. The Crawler is used by the members of Chikayama-Taura Laboratory to crawl web-pages only for the research purposes.

Click on any string to get more details

Shim-Crawler

ShopWiki

ShopWiki is a shopping search engine crossed with a wiki. The service crawls the web for product listings, then allows users to write reviews in a collaborative wiki format.

Click on any string to get more details

ShopWiki 1.0

Shoula robot

Shoula Search Engine

Click on any string to get more details

Shoula robot

silk

Web crawler for the Slider DMOZ search engine. Crawls DMOZ entries only. You can add your own site by including a Slider.com search box or button on the main page of your website or by paying.

Click on any string to get more details

silk 1.0

SnappySnappy

UrlTrends' robot for generating Reports

Click on any string to get more details

Snappy 1.1

sogou spider

Chinese spider. Sohu's proprietary search engine, Sogou, which means ‘Search Dog’ in Chinese, initially launched in August 2004

Click on any string to get more details

sogou spider

Speedy Spider

Speedy is an automated web crawler used to build the search engine index at Entireweb

Click on any string to get more details

Speedy Spider 1.3

Speedy Spider 1.0

Sqworm


Click on any string to get more details

Sqworm 2.9.85-BETA

StackRamblerStackRambler

Russian spider. Crawls the web for Ramber.ru, a search engine of Rambler Media

Click on any string to get more details

StackRambler 2.0

SurveyBotSurveyBot

Monitors internet statistics for the Whois Source domain search engine

Click on any string to get more details

SurveyBot 2.3

SynooBot

Spider for the German web directory Synoo. Accepts free submissions of German websites

Click on any string to get more details

SynooBot 0.7.1

TeomaTeoma

The Teoma Crawler is Ask Jeeves' Web-indexing robot

Click on any string to get more details

Teoma

TerrawizBot

Indian search engine bot. TerrawizBot is the user-agent for Terrawiz's web crawler. Terrawiz is a privately held startup with development center in Bangalore, India.

Click on any string to get more details

TerrawizBot 1.0

TheSuBot

Hyro-Mediaservice German crawler

Click on any string to get more details

TheSuBot 0.2

TheSuBot 0.1

Thumbnail.CZ robot

Takes screenshots of websites. Thumbnail.CZ visits the page and checkes if it exists. Later a Konqueror browser visits the site and takes a screenshot of the Homepage. Doesn't follow any links and doesn't obey robots.txt. Provides search engines and catalogues with thumbnail previews of websites to make results more attractive.

Click on any string to get more details

Thumbnail.CZ robot 1.1

TinEye

The TinEye crawler is a web crawler for an open image search project currently being built

Click on any string to get more details

TinEye 1.1

TinEye

TurnitinBot

Turnitin.com's web crawling robot. This robot collects content from the Internet for the sole purpose of helping educational institutions prevent plagiarism. In particular, they compare student papers against the content they find on the Internet to see if they can find similarities.

Click on any string to get more details

TurnitinBot 2.1

TurnitinBot 2.0

TurnitinBot 1.5

updatedupdated

Spider for the product search engine Updated.

Click on any string to get more details

updated 0.1-beta

VoilaBot

French telecom's Voila search engine crawler

Click on any string to get more details

VoilaBot 1.2

Vortex

Vortex Web Indexing Robot, part of a study on internet link distribution

Click on any string to get more details

Vortex 2.2

Vortex 1.2

voyager

voyager is Cosmix Corporation's web crawling robot.It fetches documents from the web to build the index for the Kosmix search engine

Click on any string to get more details

voyager 1.0

VYU2


Click on any string to get more details

VYU2

webcollage

WebCollage is a program that creates collages out of random images found on the Web. More images are being added to the collage about once a minute, so this page will reload itself periodically. Clicking on one of the images in the collage will take you to the page on which it was found.

Click on any string to get more details

webcollage 1.93

webcollage 1.129

webcollage 1.125

webcollage 1.117

webcollage 1.114

Websquash.com

Websquash web crawler

Click on any string to get more details

Websquash.com

wf84

WebFountain™ is a set of research technologies that collect, store and analyze massive amounts of unstructured and semi-structured text. It is built on an open, extensible platform that enables the discovery of trends, patterns and relationships from data. For more information on text analytics research at IBM, please visit UIMA.

Click on any string to get more details

wf84

WoFindeIch RobotWoFindeIch Robot

Crawler for the Switzerland based wofindeich search engine. For .ch and .li Domains only, unless they have Switzerland related content.

Click on any string to get more details

WoFindeIch Robot 1.0

Xaldon_WebSpider

Xaldon Technologies's Webspider crawls the web and copies websites to your harddisk for offline browsing

Click on any string to get more details

Xaldon_WebSpider 2.0.b1

yacyyacy

yacy is a client to the YaCy P2P-based Web indexing network. It can crawl the web, search the web and provide web-services like a web server, file share, a wiki and peer-to-peer messages.

Click on any string to get more details

yacy

Yahoo! SlurpYahoo! Slurp

Yahoo! Slurp - Yahoo!'s Web Crawler

Click on any string to get more details

Yahoo! Slurp

Yahoo! Slurp ChinaYahoo! Slurp China

Yahoo's crawler for China

Click on any string to get more details

Yahoo! Slurp China

YahooSeekerYahooSeeker


Click on any string to get more details

YahooSeeker 1.2

YahooSeeker-TestingYahooSeeker-Testing


Click on any string to get more details

YahooSeeker-Testing v3.9

yoogliFetchAgent

Yoogli search engine (under construction). Should come live february 2006

Click on any string to get more details

yoogliFetchAgent 0.1

Zao

Japanese crawler of Kototoi.org

Click on any string to get more details

Zao 0.1

Zealbot

Crawls all Web sites listed with LookSmart each week to ensure that they are still active, responsive sites.

Click on any string to get more details

Zealbot 1.0

zspider

Crawler for Redkolibri, a new search engine under development, to be released in 2006.

Click on any string to get more details

zspider 0.9-dev

ZyBorg

LookSmart's WiseNut search engine crawler

Click on any string to get more details

ZyBorg 1.0



© 2005 -2008 UserAgentString.com
Wordconstructor - Random Word Generator :: 707 Directory - SEO friendly directory of directories