User-agent: * Disallow: /data1/ Disallow: /agents/ Disallow: /Customer/ Disallow: /Secure/ Allow: / Disallow: /data/