Форум программистов [Powered by Invision Power Board]

Версия для печати темы
Нажмите сюда для просмотра этой темы в оригинальном формате

Форум программистов > Продвижение и оптимизация сайтов > Поисковики

Автор: Links 18.2.2005, 12:27

Ребята, нужен список иностранных поисковиков. Англоязычных. Как можно более полный.
хелп
*сорри что не в тему*

Автор: Mal Hack 18.2.2005, 14:25

Вот тебе список ботов, который я где-то полгода назад нашел... Тут и русские есть.

Цитата

googlebot=Google.com
slurp@inktomi=Hot Bot
lycos=Lycos.com
whatuseek=What You Seek
ia_archiver=Archive.org
wisenutbot=Looksmart
msnbot=MSN
GigaBlast=Gigablast
Gigabot=Gigablast
archive_org=Archive.org
jeeves=Ask Jeeves
google=Google.com
Asterias=Singingfish Spider
Slurp=Inktomi Spider
ZyBorg=LookSmart Bot
slurp@inktomi=HotBot
lycos=Lycos.com
LinkWalker=Link Walker
Slurp/2.0=HotBot
ABCdatos BotLink/1.0.2=ABC Bot
appie/1.1=Walhello Spider
InfoSeek Robot 1.0=Infoseek
Infoseek Sidewinder=Infoseek
MSNBOT/0.1=MSNBot
Openbot=OpenBot
inktomisearch.com=Yahoo
Slurp.so/1.0=Yahoo
Slurp/2.0j=Yahoo
Slurp/2.0-KiteHourly=Yahoo
Slurp/2.0-OwlWeekly=Yahoo
Slurp/3.0-AU=Yahoo
UltraSeek=InfoSeek
MuscatFerret=WebTop
appie=Walhello
teoma_agent1=Teoma.com
HenryTheMiragoRobot=MiragoBot
Lycos_Spider_(T-Rex)=Lycos
Toutatis 2.5-2=Hoppa.com
Hubater=Hubat.com
IlTrovatore-Setaccio=IlTrovatore.it
IncyWincy=IncyWincy.com
Mole2/1.0=Intags.de
MP3Bot=MP3bot.de
LNSpiderguy=Lexis-Nexis.com
kuloko-bot/0.2=Kuloko.com
NetResearchServer=Look.com
MantraAgent=Look Smart
Arachnoidea=EuroSeek
EZResult=EZResult
ArchitextSpider=Excite
ArchitectSpider=Excite
Inktomi=InktomiBot
GAIS Robot/1.0B2=Seednet
Gulliver/1.2=Northern Light
Infoseek Sidewinder/0.9=Sidewinder
lwp-trivial/1.27=Search 4 Free
Lycos_Spider_(T-Rex)/3.0=Lycos
Scooter/1.0=AltaVista
sexsearcher=Sex Searcher
WebCrawler/3.0 Robot libwww/5.0a=WebCrawler
WebCrawler-AddURL/2.0=WebCrawler
WiseWire=WiseWire
WiseWire-Alpha-1.0=WiseWire
WiseWire-Alpha-Spider=WiseWire
WiseWire-Alpha12-Spider971219a=WiseWire
WiseWire-Alpha12-Spider(971223a)=WiseWire
WiseWire-HotSpider-1.0=WiseWire
WiseWire-Spider=WiseWire
WiseWire-Spider-1.0=WiseWire
WiseWire-Spider2=WiseWire
WiseWire-Widow-1.0=WiseWire
WiseWire-Widow-1.0r=WiseWire
WiseWire-Widow-1.0-ALPHA12=WiseWire
AbachoBOT=Abacho
abcdatos_botlink=ABCDatos
AESOP_com_SpiderMan-AESOP.com
Scooter=AltaVista
Mercator=AltaVista
Scooter2_Mercator_3-1.0=Scooter2 Spider
roach.smo.av.com-1.0=Roach SPider
Wget=All The Web
antibot=AntiSearch.net
Atomz=Atomz
CanSeek/=Can Seek
ChristCRAWLER=Christ CRAWLER
DaAdLe.com ROBOT/=DaAdLe.com
contact/[email protected]=Jylee Spider
RaBot=Daum.net
Agent-admin/=Daum.net
DeepIndex=DeepIndex
DittoSpyder=Ditto.com
Jack=Jack Spider
EZResult=EZResults.com
FyberSearch=FyberSearch.com
GalaxyBot=Galaxy.com
geckobot=geckobot.com
GenCrawler=GenDoor.com
GeonaBot=Geona.com
moget/2.0=goo.ne.jp
JoocerBot=Joocer.com
HenryTheMiragoRobot=Mirago.co.uk
mozDex/=MozDex.com
MSNBOT/0.1=MSN
ObjectsSearch/0.01=ObjectsSearch.com
PicoSearch/=PicoSearch.com
PJspider=PortalJuice.com
DIIbot=PowerInter.net
gazz/1.0=Gazz Spider
NationalDirectory-SuperSpider=NationalDirectory.com
psbot=PicSearch.org
AlkalineBOT=AlkalineBOT
Scrubby/=ScrubTheWeb.com
asterias=SingingFish.com
Kototoi/0.1=Kototoi Spider
Searchspider/=Searchspider.com
SightQuestBot/=SightQuest.com
Spider_Monkey/=Spider_Monkey.ca
teoma_agent1=Teoma.com
ESISmartSpider=Travel-Finder.com
appie=Walhello.com
MuscatFerret=WebTop.com
WSCbot=WorldSearchCenter.com
Yellopet-Spider=Yellopet.com
libwww-perl=Libwww Spider
citenikbot/=CitenikBot
CLIPS-index=CLIPS Spider
cosmos=XYleme.com
DiaGem/=DiaGem Spider
EchO!/2.0=Voila.com
FinaleRobot=FinaleRobot
larbin=Larbin Spider
MultiText=MultiText Spider
OntoSpider=OntoSpider
sherlock_spider=Sherlock Spider
Steeler=Steeler Spider
0.1_hseo(at)cs.rutgers.edu=Rutgers.eduSpider
Zao/0.2=Zao Spider
[email protected]=Xcrawler
xyro=Xyro Spider
WebGather=WebGather Spider
ADSAComponent=ADSA Spider
ADSARobot=ADSARobot
Albert Indexer=Albert Indexer
AnswerChase=AnswerChase
ASPSeek=ASPSeek
ATA-Translation-Service=ATA Spider
AVSearch=AVSearch Spider
beholder=Beholder Spider
e-sense=E-sense Spider
BravoBrian=BravoBrian Spider
Checkbot=Checkbot
contype=ConType Spider
Convera Internet Spider=Convera Spider
DaviesBot=DaviesBot
deepweb=Deepweb Spider
EbiNess=EbiNess Spider
EmailWolf=EmailWolf Spider
Excalibur Internet Spider=Excalibur Spider
Expired Domain Sleuth=Domain Slueth
GigaBaz=GigaBaz Spider
GigaBazVStheWeb=GigaBaz2 Spider
[email protected]=BrainBot Spider
Giskard=Giskard Spider
grub-client=Grub Spider
htdig=HT Dig Spider
http://webwarper.net=WebWarper.net
infoGIST=infoGIST Spider
InterGO=InterGO Spider
InternetArchive=Internet Archive
Internet Ninja=Internet Ninja Spider
InternetSeer=InternetSeer
ipiumBot=ipiumBot
InternetAmi IOR=InternetAmi
InsumaScout/=InsumaScout
Katriona=Katriona Spider
larbin=Larbin Spider
LEIA=LEIA Spider
LexiBot=LexiBot
logikabot=LogikaBot
Mister Pix II=Mister Pix Spider
MOSES 2.0 Spider=Moses 2.0 Spider
Mata Hari=MataHari Spider
metabot=MetaBot
NetCruiser=NetCruiser
NPBot=NPBot
NetZippy=NetZippy
NZBot=NZBot
Opencola=Opencola Spider
ORA_checksite=ORA Spider
Onekit.com - PAD File Get.=Onekit.com
Oxxbot1=Oxxbot1
Pansophica=Pansophica Spider
Phoaks=Phoaks Spider
phpMySearch-Crawler=phpMySearch
PICgrabber=PICgrabber
PictureOfInternet=POI Spider
[email protected]=Malfunction.orgr
PintaSpider=PintaSpider
Pita (Chub.Stanford.EDU)=Pita (Stanford.edu)
PitSpyder Thread<n>0=PitSpyder
psbot=PSbot
PolyBot=PolyBot
PureSight=PureSight
Rumours-Agent=Rumours Spider
Robot2.0(PingSoft)=Robot2.0
SilentSurf=SilentSurf
SlySearch=SlySearch
[email protected]=SlySearch.com
SpaceBison=SpaceBison
SpotOn=SpotOn Spider
SQ Webscanner=Webscanner
Squid=Squid Spider
Sqworm=Sqworm Spider
SurfControl=SurfControl
Tagword=Tagword
TaWWWantula=TaWWWantula
Tcl http client package=TCL Spider
TeraCrawl=TeraCrawl
TurnitinBot=TurnitinBot
UCmore=UCmore
UdmSearch=UdmSearch
unlostBot=unlostBot
[email protected]=Unlost.com
URLBlaze=URLBlaze Spider
utopy=Utopy Spider
[email protected]=Utopy.com
UtilMind HTTPGet=UtilMind Spider
UrlScope=UrlScope Spider
Vagabondo=Vagabondo Spider
VCI WebViewer=VCI Spider
vspider=VSpider
WAVETools=WAVETools Spider
Webbandit=Webbandit Spider
Webclipping.com=Webclipping Spider
webcollage=WebCollage Spider
WebCompass=WebCompas Spider
WebGenie=WebGenie Spider
Web Hound=WebHound Spider
Web Magnet=WebMagnet Spider
WebMiner=WebMiner Spider
Webpush=Webpush Spider
WebSymmetrix=WebSymmetrix Spider
webrank=WebRank Spider
webwasher=WebWasher Spider
WhosTalking=WhosTalking
XupiterToolbar=Xupiter Spider
aport=Aport
yandex=Yandex
stackrambler=Rambler
JetBot=Jet Bot

Автор: Links 19.2.2005, 11:56

Хм.,,.
не понял..
мне нужен список адресов поисковиков,,,,,..... а что это ?

Цитата

WebCompass=WebCompas Spider
WebGenie=WebGenie Spider
Web Hound=WebHound Spider
Web Magnet=WebMagnet Spider
WebMiner=WebMiner Spider
Webpush=Webpush Spider
WebSymmetrix=WebSymmetrix Spider
webrank=WebRank Spider
webwasher=WebWasher Spider
WhosTalking=WhosTalking
XupiterToolbar=Xupiter Spider

Автор: Mal Hack 19.2.2005, 14:29

<текст бота в HTTP_USER_AGENT> = <ИМЯ БОТА>

Цитата(Links @ 19.2.2005, 11:56)

мне нужен список адресов поисковиков

так бы сразу.... Этого сорри нема.

Автор: Links 21.2.2005, 21:03

Хелп