User-agent: * Disallow: /store-complete/ Disallow: /search Crawl-delay: 0.5