To exclude all robots from part of the server
User-agent: *
Disallow: /admin/
Disallow: /design2/
Disallow: /resellers/
Disallow: /source_files/