User-agent: * Disallow: Disallow: /cgi-bin/ Disallow: /images/ #allows all robots to visit all files, #but blocks all robots from the cgi-bin and images directories.