User-agent: * Disallow: /htdocs/files Disallow: /htdocs/forms Disallow: /htdocs/persistent Disallow: /htdocs/scripts Disallow: /logs