15,030
edits
User agent: Difference between revisions
Jump to navigation
Jump to search
→Search Engine Spiders (Bots)
| Line 3: | Line 3: | ||
== Search Engine Spiders (Bots) == | == Search Engine Spiders (Bots) == | ||
{| | {| | ||
| User Agent | Search Engine | | User Agent || Search Engine | ||
|- | |- | ||
| Scooter | [http://www.altavista.com/web/legal/termsofuse AltaVista] | | Scooter || [http://www.altavista.com/web/legal/termsofuse AltaVista] | ||
|- | |- | ||
| [http://www.wisenut.com/ WISENutbot] | Looksmart | | [http://www.wisenut.com/ WISENutbot] || Looksmart | ||
|- | |- | ||
| IA Archiver | [http://pages.alexa.com/help/webmasters/ Alexa] | | IA Archiver || [http://pages.alexa.com/help/webmasters/ Alexa] | ||
|- | |- | ||
| [http://search.msn.com/msnbot.htm MSNBot] | MSN | | [http://search.msn.com/msnbot.htm MSNBot] || MSN | ||
|- | |- | ||
| Slurp | [http://www.inktomi.com/slurp.html Inktomi]) | | Slurp || [http://www.inktomi.com/slurp.html Inktomi]) | ||
|- | |- | ||
| Fast-Webcrawler | [http://www.fastsearch.com/us/products/fast_web_search/crawler_faq AllTheWeb] | | Fast-Webcrawler || [http://www.fastsearch.com/us/products/fast_web_search/crawler_faq AllTheWeb] | ||
|- | |- | ||
| [http://www.walhello.com/aboutgl.html Walhello appie] | - | | [http://www.walhello.com/aboutgl.html Walhello appie] || - | ||
|- | |- | ||
| Googlebot | ([http://www.google.com/bot.html Google] or [http://www.yam.com/help/doc_sre.html 中文說明]) | | Googlebot || ([http://www.google.com/bot.html Google] or [http://www.yam.com/help/doc_sre.html 中文說明]) | ||
|- | |- | ||
| [http://gais.cs.ccu.edu.tw/robot.php Gaisbot] | - | | [http://gais.cs.ccu.edu.tw/robot.php Gaisbot] || - | ||
|- | |- | ||
| [http://www.openfind.com.tw/robot.html Openbot] | Openfind | | [http://www.openfind.com.tw/robot.html Openbot] || Openfind | ||
|} | |} | ||