# Robot Exclusion File -- robots.txt User-agent: * Disallow: /oldsite Disallow: /js Disallow: /admin Disallow: /private Disallow: /database_images