14,974
edits
Robots.txt: Difference between revisions
Jump to navigation
Jump to search
→Robots.txt for golbal website or specific folders
No edit summary |
|||
| Line 4: | Line 4: | ||
* [http://www.searchtools.com/robots/robots-meta.html Search Indexing Robots and the Robots META Tag - SearchTools.com] | * [http://www.searchtools.com/robots/robots-meta.html Search Indexing Robots and the Robots META Tag - SearchTools.com] | ||
* [http://www.google.com/support/webmasters/bin/answer.py?answer=40367 網站管理員說明中心 - 我不想將要攔截的每個檔案都列出。我可以使用* 和 $ 模式媒合嗎？]([http://www.google.com/support/webmasters/bin/answer.py?answer=40367&hl=en EN]) | * [http://www.google.com/support/webmasters/bin/answer.py?answer=40367 網站管理員說明中心 - 我不想將要攔截的每個檔案都列出。我可以使用* 和 $ 模式媒合嗎？]([http://www.google.com/support/webmasters/bin/answer.py?answer=40367&hl=en EN]) | ||
* [http://www.mediawiki.org/wiki/Robots.txt Robots.txt - MediaWiki] | |||
robots.txt validator | robots.txt validator | ||
* [http://tool.motoricerca.info/robots-checker.phtml New Robots.txt Syntax Checker: a validator for robots.txt files] | * [http://tool.motoricerca.info/robots-checker.phtml New Robots.txt Syntax Checker: a validator for robots.txt files] | ||
== sitemap == | == sitemap == | ||