Yandex Clean-param Generator
Download the list of excluded pages from Yandex and get the value of the Clean-param directive for the robots.txt file.
Frequently Asked Questions
The tool collects all URL parameters for a list of pages and generates a Clean-param directive with these parameters for specifying in the robots.txt file.
Specifying Clean-param in the robots.txt file prevents technical duplicate pages from appearing in Yandex, and merges them with the main pages (without these parameters in the URL).
Additionally, this allows the Yandex search robot to reduce the amount of time it takes to scan pages with the listed parameters, which can reduce the load on the server (where the site is located) and also allows the search robot to spend its crawling budget on pages that are more valuable for promotion.
Get a list of your site's pages with parameters in Yandex Webmaster: in the "Pages in Search" section, select the site and click the "Excluded Pages" tab under the graph. Download this table (XLS or CSV) using the button below and copy the resulting list of pages into our tool.
If your site has just been created or added to Yandex Webmaster, you can simply enter its address as the pages with parameters and then use the advanced directive view with popular parameters.
Adding a properly formatted Clean-param directive to Yandex's robots.txt file helps avoid duplicate parameter pages and improve the efficiency of the crawling search engine.