User-agent: * Host: https://parts01.ru Crawl-delay: 10 Disallow: /price_items/search Disallow: /catalogs/*/pav/* Disallow: /tecdoc2/*/models/* Disallow: /laximo/* Disallow: /levam/* Disallow: /il_catalogs/* Disallow: /acat_catalogs/* Disallow: /price_items/search/* Disallow: /products/price.json Disallow: /backend/*