User-agent: * Disallow: /*? Disallow: */catalog/product_compare/ Disallow: */catalog/category/view/ Disallow: */catalog/product/view/ Disallow: */wishlist* Disallow: */admin* Disallow: */checkout* Disallow: */onestepcheckout* Disallow: */customer/ Disallow: */review/product/ Disallow: */sendfriend/ Disallow: */enable-cookies/ #Lets consider each groups of commands separately. #Stop crawling user account and checkout pages by search engine robot: Disallow: */customer/account/ Disallow: */customer/account/login/ #Blocking native catalog and search pages: Disallow: */catalogsearch/ #More reasonable to use canonical tag on these pages. #These commands are not necessary. Search engines are smart enough to avoid including CMS files in their index. #Blocking duplicate content: Disallow: */tag/ Disallow: */review/ User-agent: * Disallow: /*? Disallow: */index.php/ Disallow: */LICENSE.txt Disallow: */LICENSE.html Disallow: */skin/ Disallow: */js/ Disallow: */directory/ #Lets consider each groups of commands separately. #Stop crawling user account and checkout pages by search engine robot: #Sometimes Webmasters block pages with filters.. Disallow: /*?dir* Disallow: /*?dir=desc Disallow: /*?dir=asc Disallow: /*?limit=all Disallow: /*?mode* #More reasonable to use canonical tag on these pages. #Blocking CMS directories. Disallow: /app/ Disallow: /bin/ Disallow: /dev/ Disallow: /lib/ Disallow: /phpserver/ Disallow: /pub/ Sitemap: https://www.kidkraft.com/media/sitemaps/eu/sitemap.xml Sitemap: https://www.kidkraft.com/media/sitemaps/ca/sitemap.xml Sitemap: https://www.kidkraft.com/media/sitemaps/au/sitemap.xml Sitemap: https://www.kidkraft.com/media/sitemaps/uk/sitemap.xml Sitemap: https://www.kidkraft.com/media/sitemaps/fr/sitemap.xml Sitemap: https://www.kidkraft.com/media/sitemaps/de/sitemap.xml Sitemap: https://www.kidkraft.com/media/sitemaps/ca_fr/sitemap.xml Sitemap: https://www.kidkraft.com/media/sitemaps/sitemap.xml