# Robots.txt file from http://www.kereti.de # # Bans spiders from pdf, phaistos and linearA User-agent: * Disallow: /pdf/ Disallow: /phaistos/ Disallow: /linearA/