Robots.txt: Difference between revisions

Jump to navigation Jump to search
94 bytes added ,  30 July 2007
no edit summary
mNo edit summary
No edit summary
Line 9: Line 9:
robots.txt validator
robots.txt validator
* [http://tool.motoricerca.info/robots-checker.phtml New Robots.txt Syntax Checker: a validator for robots.txt files]
* [http://tool.motoricerca.info/robots-checker.phtml New Robots.txt Syntax Checker: a validator for robots.txt files]
== sitemap ==
Sitemap: URL_of_sitemap_file
[[Google Sitemap Template for MovableType]]




Line 18: Line 25:
: more on [http://www.google.com.tw/support/webmasters/bin/answer.py?answer=35301 網站管理員說明中心 - 我如何從 Google 的索引中移除內容?]
: more on [http://www.google.com.tw/support/webmasters/bin/answer.py?answer=35301 網站管理員說明中心 - 我如何從 Google 的索引中移除內容?]


== meta tag for each webpage ==
=== meta tag for each webpage ===


  <meta name="robots" content="noindex,nofollow" />
  <meta name="robots" content="noindex,nofollow" />

Navigation menu