User-agent: * Disallow: /TOOLS/ Disallow: /TOOLT/ Disallow: /SYSTEM/ Disallow: /cfide/ Disallow: /CFIDE/ Disallow: /myApps/ Disallow: /myCss/ Disallow: /myDocs/ Disallow: /myFnct/ Disallow: /images/ Disallow: /includes/ Disallow: /js/ Disallow: /myLout/ Disallow: /myProc/ Disallow: /mySoft/ Disallow: /myTemp/ # but allow htdig to index our doc-tree User-agent: susedig Disallow: # disallow stress test user-agent: stress-agent Disallow: /