## version 5 Sitemap: https://www.kicksecure.com/sitemap/sitemap-index-wiki.xml User-agent: * #Crawl-delay: 10 ## copied from mediawiki robots.txt Allow: /w/api.php?action=mobileview& Allow: /w/load.php? Allow: /api/rest_v1/?doc Disallow: /w/ Disallow: /api/ Disallow: /trap/ Disallow: /wiki/Special: Disallow: /wiki/Spezial: Disallow: /wiki/Spesial: Disallow: /wiki/Special%3A Disallow: /wiki/Spezial%3A Disallow: /wiki/Spesial%3A ## added: Disallow: /wiki/Module: Disallow: /wiki/Template: Disallow: /wiki/index.php Disallow: /wiki/Special:AWCforum/ Disallow: /wiki/Widget: Disallow: /wiki/UserLogin Disallow: /wiki/User: Disallow: /wiki/Help: Disallow: /wiki/File_talk: Disallow: /wiki/Whonix: Disallow: /wiki/Kicksecure: Disallow: /wiki/Whonix_talk: Disallow: /wiki/Kicksecure_talk: Disallow: /wiki/MediaWiki: Disallow: /wiki/MediaWiki%3A Disallow: /wiki/Homepage Disallow: /wiki/homepage #Disallow: /mw-autogen/ #Disallow: /libs/ #Disallow: /keys/ Allow: /w/images/ Allow: /w/resources/ Allow: /w/skins/ Allow: /w/index.php?title=MediaWiki:*.* # Allow the Internet Archiver to index action=raw and thereby store the raw wikitext of pages User-agent: ia_archiver Allow: /*&action=raw