User-agent: gsa-crawler Disallow: /doorsnet/ Disallow: /bugzilla/ Disallow: /manual/ Disallow: /cubit/ User-agent: * Disallow: /cgi-bin/