User-agent: * # All spiders should ignore the following files and folders Disallow: /guestbook Disallow: /upload Disallow: /redirect Disallow: /component Disallow: /buttons Disallow: /usage Disallow: /kim