User-agent: * Disallow: /*.txt$ Disallow: /*.lzh$ Disallow: /*.cgi$ Disallow: /*.php$