User-agent: * Disallow: /private/* Disallow: /portal/* Disallow: /documents/* Disallow: /common/* Disallow: /admin/*