User-agent: * Disallow: /intranet/ Disallow: /extranet/ Disallow: /admin/ Disallow: /personal/ Disallow: /test/ Disallow: /dev/