# robots.txt zu http://www.archaeo-technik.de/ User-agent: * Disallow: /logs/ Crawl-delay: 180