# Bans all robots will spider the domain User-agent: Googlebot Allow: /pdfs/exchange Allow: /pdfs/prayer Allow: /pdfs/canons Allow: /pdfs/ma Allow: /pdfs/bp Allow: /pdfs/policy Disallow: /pdfs Disallow: /_working Disallow: /*.asp$ Disallow: /*.xls$ User-agent: * Disallow: /