User-agent: * Disallow: /cgi-bin/ Disallow: /admin Disallow: /content Disallow: /data Disallow: /articles Disallow: /adba