# no empty lines in between disallow statements! Sitemap: http://www.silverjuke.net/sitemap.xml # allow the adsense spider to crawl every User-agent: Mediapartners-Google* Disallow: #for all other spiders User-agent: * Disallow: /de/extend Disallow: /de/news.rdf Disallow: /de/rss Disallow: /de/vote Disallow: /en/extend Disallow: /en/news.rdf Disallow: /en/rss Disallow: /en/vote Disallow: /download Disallow: /forum/login Disallow: /forum/post Disallow: /forum/privmsg Disallow: /forum/profile Disallow: /forum/rss Disallow: /forum/search Disallow: /go/ Disallow: /ml/topic