User-Agent: * Disallow: /policies/ Disallow: *.js Disallow: *.css Disallow: *.asp Disallow: *.htmlf