# This file consists of one or more records separated by one or more blank lines # Allowing Google bot for SEO. Disallow : (blank) means allow 100% for all URLs User-agent: Googlebot Allow: /article/ Disallow: /*?* # Allowing Naver bot for SEO. Naver has 2 bots. naverbot and yeti User-agent: naverbot Disallow: /*?* User-agent: yeti Disallow: /*?* # Allowing Bing bot for SEO. Bing has 2 bots. MSNbot and bingbot User-agent: MSNBot Disallow: /*?* User-agent: bingbot Disallow: /*?* # Allow access to sitemap.xml and blocking all url for other bots. User-agent : * means all other bots which are not mentioned above. User-agent: * Allow: /sitemap.xml Disallow: /