Trashwiki:Robots.txt

From Trashwiki

We'll probably be hiding most Trashwiki pages from bots through robots.txt - mostly because of Google and shop owners and corporations that are googling for their own names. See also the discussion related to this. See also project:tech.

Feel free to add more lines with Allow and guaka will update the actual robots.txt file. Also check Wikipedia.

User-agent: *
Allow: /
Allow: /en/Main_Page
Allow: /en/Guerrilla_gardening
Allow: /en/Trashwiki:*
Disallow: /w/*
Disallow: /en/*

[edit] Former robots.txt

User-agent: *
Disallow: /w/
Disallow: /w/index.php
Disallow: /w/skins/
Disallow: /en/Special:Random
Disallow: /en/Special%3ARandom
Disallow: /en/Special:Search
Disallow: /en/Special%3ASearch
Disallow: /en/Special:Recentchangeslinked/

[edit] Timeplan

We can keep on updating robots.txt here but I'll probably move trashwiki to another server some time this week. It'll be a good time to change robots.txt. guaka 01:28, 18 March 2009 (UTC)

Now I'm just waiting for DNS propagation. --213.219.157.113 22:19, 23 March 2009 (UTC)