User-agent: * Allow: / Allow: /blog User-agent: Googlebot Allow: /blog Allow: / User-agent: * Disallow: /qa/ Disallow: /dev/ Disallow: /qa. Disallow: /dev. Disallow: /crm/