# robots.txt file from http://www.wikimetro.org # All robots will spider the domain User-agent: * Disallow: /manage Disallow: /Admin.aspx Disallow: /Login.aspx Disallow: /Upload.aspx Disallow: /Edit.aspx Disallow: /Search.aspx Disallow: /History.aspx Disallow: /Message.aspx Disallow: /RandPage.aspx Disallow: /Register.aspx Disallow: /RSS.aspx Disallow: /AccessDenied.aspx Disallow: /Language.aspx Disallow: /GetFile.aspx Disallow: /DeadendPages.aspx