User-agent: * Disallow: /IndexDirectory/ Disallow: /index/ Disallow: /logs/ Disallow: /index/ Disallow: /Stats/ Disallow: /Bin/ Disallow: /XML/