[svnbook] r3819 committed - Tell web crawlers to stop crawling the older versions of the book.
svnbook at googlecode.com
svnbook at googlecode.com
Wed Jan 5 07:55:25 CST 2011
Revision: 3819
Author: cmpilato at gmail.com
Date: Wed Jan 5 05:54:22 2011
Log: Tell web crawlers to stop crawling the older versions of the book.
http://code.google.com/p/svnbook/source/detail?r=3819
Modified:
/trunk/www/robots.txt
=======================================
--- /trunk/www/robots.txt Thu May 10 23:44:39 2007
+++ /trunk/www/robots.txt Wed Jan 5 05:54:22 2011
@@ -3,6 +3,10 @@
Disallow: /viewcvs
Disallow: /cgi-bin
Disallow: /trac
+Disallow: /en/1.0
+Disallow: /en/1.1
+Disallow: /en/1.2
+Disallow: /en/1.4
User-Agent: MediaPartners-Google
Allow: /nightly
More information about the svnbook-dev
mailing list