User-agent: * Allow: / Allow: .htm$ Allow: .html$ Allow: .asp$ Disallow: /admin Disallow: /manage Disallow: /database Disallow: /templets