[svnbook] r3819 committed - Tell web crawlers to stop crawling the older versions of the book.

svnbook at googlecode.com svnbook at googlecode.com
Wed Jan 5 07:55:25 CST 2011


Revision: 3819
Author: cmpilato at gmail.com
Date: Wed Jan  5 05:54:22 2011
Log: Tell web crawlers to stop crawling the older versions of the book.
http://code.google.com/p/svnbook/source/detail?r=3819

Modified:
  /trunk/www/robots.txt

=======================================
--- /trunk/www/robots.txt	Thu May 10 23:44:39 2007
+++ /trunk/www/robots.txt	Wed Jan  5 05:54:22 2011
@@ -3,6 +3,10 @@
  Disallow: /viewcvs
  Disallow: /cgi-bin
  Disallow: /trac
+Disallow: /en/1.0
+Disallow: /en/1.1
+Disallow: /en/1.2
+Disallow: /en/1.4

  User-Agent: MediaPartners-Google
  Allow: /nightly




More information about the svnbook-dev mailing list