#Robots.txt file from website #All robots will spider the domain User-agent: * Allow: / Disallow: /cart Disallow: /shoppingcart Disallow: /me/ Disallow: /order/ Disallow: /support Disallow: /i/login Disallow: /i/register Disallow: /manifest.json