From: Michael Andreen <harv@ruin.nu>
Date: Sun, 17 Aug 2008 00:51:37 +0000 (+0200)
Subject: Pointless to index all the ranking options, better to stick to scorerank and disallow... 
X-Git-Url: https://ruin.nu/git/?p=ndwebbie.git;a=commitdiff_plain;h=484c068bfb54be137e50de0264eaf5f81328aab8

Pointless to index all the ranking options, better to stick to scorerank and disallow the others
---

diff --git a/root/robots.txt b/root/robots.txt
index 2b48efa..6d85911 100644
--- a/root/robots.txt
+++ b/root/robots.txt
@@ -1,2 +1,11 @@
 User-agent: *
 Disallow: /stats/planet/
+Disallow: /ranks/planets/sizerank/
+Disallow: /ranks/planets/valuerank/
+Disallow: /ranks/planets/xprank/
+Disallow: /ranks/galaxies/sizerank/
+Disallow: /ranks/galaxies/valuerank/
+Disallow: /ranks/galaxies/xprank/
+Disallow: /ranks/alliances/sizerank/
+Disallow: /ranks/alliances/valuerank/
+Disallow: /ranks/alliances/xprank/