# /robots.txt User-agent: * Disallow: Crawl-delay: 20 User-agent: Googlebot Disallow: Crawl-delay: 1 User-agent: twiceler Disallow: Crawl-delay: 5 Sitemap: http://saussure.idoneos.com/sitemap.php User-agent: Teoma Disallow: Crawl-delay: 300 User-agent: Gigabot Disallow: Crawl-delay: 300 User-agent: psbot Disallow: Crawl-delay: 300 User-agent: TurnitinBot Disallow: / User-agent: TMCrawler Disallow: / User-agent: SBIder Disallow: / User-agent: OmniExplorer_Bot Disallow: /