User-agent: * Disallow: /web Disallow: /backoffice Disallow: /intranet Disallow: /database Disallow: /default.asp