User-agent: MJ12bot Disallow: / User-agent: Zoominfobot Disallow: / User-agent: Shopit Disallow: / User-agent: Linguee Disallow: / User-agent: PricecloudBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: AhrefsBot Disallow: / Crawl-Delay: 20 User-agent: SeznamBot Disallow: / Request-rate: 1/10m User-agent: CCBot Disallow: / Crawl-Delay: 20 User-agent: dotbot Disallow: / Crawl-delay: 10 User-agent: rogerbot Disallow: / Crawl-delay: 20 User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: Baiduspider Disallow: / User-agent: 360Spider Disallow: / User-agent: Yisouspider Disallow: / User-agent: PetalBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Sogou web spider Disallow: / User-agent: Sogou inst spider Disallow: / # robots.txt automaticaly generated by PrestaShop e-commerce open-source solution # http://www.prestashop.com - http://www.prestashop.com/forums # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # For more information about the robots.txt standard, see: # http://www.robotstxt.org/robotstxt.html User-agent: * # Private pages Disallow: /*?orderby= Disallow: /*?orderway= Disallow: /*?tag= Disallow: /*?id_currency= Disallow: /*?search_query= Disallow: /*?back= Disallow: /*?n= Disallow: /*&orderby= Disallow: /*&orderway= Disallow: /*&tag= Disallow: /*&id_currency= Disallow: /*&search_query= Disallow: /*&back= Disallow: /*&n= Disallow: /*controller=addresses Disallow: /*controller=address Disallow: /*controller=authentication Disallow: /*controller=cart Disallow: /*controller=discount Disallow: /*controller=footer Disallow: /*controller=get-file Disallow: /*controller=header Disallow: /*controller=history Disallow: /*controller=identity Disallow: /*controller=images.inc Disallow: /*controller=init Disallow: /*controller=my-account Disallow: /*controller=order Disallow: /*controller=order-opc Disallow: /*controller=order-slip Disallow: /*controller=order-detail Disallow: /*controller=order-follow Disallow: /*controller=order-return Disallow: /*controller=order-confirmation Disallow: /*controller=pagination Disallow: /*controller=password Disallow: /*controller=pdf-invoice Disallow: /*controller=pdf-order-return Disallow: /*controller=pdf-order-slip Disallow: /*controller=product-sort Disallow: /*controller=search Disallow: /*controller=statistics Disallow: /*controller=attachment Disallow: /*controller=guest-tracking # Directories Disallow: */classes/ Disallow: */config/ Disallow: */download/ Disallow: */mails/ Disallow: */modules/ Disallow: */translations/ Disallow: */tools/ # Files Disallow: /*sv/password-recovery Disallow: /*sv/address Disallow: /*sv/addresses Disallow: /*sv/login Disallow: /*sv/cart Disallow: /*sv/discount Disallow: /*sv/order-history Disallow: /*sv/identity Disallow: /*sv/my-account Disallow: /*sv/order-follow Disallow: /*sv/credit-slip Disallow: /*sv/order Disallow: /*sv/search Disallow: /*sv/quick-order Disallow: /*sv/guest-tracking Disallow: /*sv/order-confirmation # Sitemap Sitemap: http://www.dragkrokslagret.se/1_index_sitemap.xml