IndexNow Submitter (for Yandex, Bing and other search engines)
Submit a large number of pages for crawling by search robots using the IndexNow protocol, which is supported by Yandex and other search engines.
How to get the key
To obtain a key, simply create a text file (.txt) in your website's root directory. Use a secret name like 06ffeeed4245cb8f4b6b1c2094 (8 to 128 characters long, containing only Latin letters, numbers, or hyphens). Enter this same secret code as the file's contents. Then use it as a key in our tool!
How does this work
The service sends your pages to selected search engines for crawling using the IndexNow protocol. If the search engines "like" the submitted URL, they will crawl its current content based on their crawl scheduling logic and the available quota (crawl budget) for your site.
Why is this necessary
Firstly, to speed up indexing: the faster your pages appear in search engines, the faster you'll get search traffic. Secondly, to speed up deindexing: perhaps pages have appeared in search results that you'd like to exclude as soon as possible. Thirdly, to speed up the process of updating your website: when you've improved your pages and want search engines to quickly reflect these changes.
Frequently Asked Questions
IndexNow is an open protocol for notifying search engines about the latest changes to a website's content. It allows you to report that the content at the submitted URL has been added, updated, or deleted, enabling the search engine to quickly incorporate these changes into its search results. The protocol is independent (not owned by any specific search engine).
Yes, the IndexNow protocol has a technical limit of 10,000 URLs per request. If you need to submit a larger number of URLs, split your list into groups of 10,000 and send them sequentially (parallel submissions may cause the protocol to return an "HTTP 429 Too Many Requests" error).
Submitting pages via IndexNow ensures that search engines become aware of changes on your site. However, using it does not guarantee that search engines will crawl the submitted URLs or that they will be indexed. Additionally, it often takes time for all changes to be processed by search engines.
Yes, you can submit non-existent pages of the site (with a 404 or 410 response code) to speed up their de-indexation. You can also submit URLs with redirects (response codes 301, 302, as well as meta refresh tags) to notify search engines about the relocation of page content.
Yes, if you use the same key on both sites, you can submit their URLs together.
It makes sense to change the key if it has been compromised. If your competitors learn about it, they could manipulate the crawling of your site or simply spam the IndexNow protocol, making it impossible to use for the site.
Search engines will try not to repeatedly fetch the key file, having loaded and verified site ownership once. However, if they receive a new key, they will definitely crawl it.
No, each subdomain is treated as a separate site and must also contain the key. If the key is placed only on site.ru, you will not be able to submit pages for the subdomain spb.site.ru.
You should not submit the same URL more than once per day. If the page has been changed again, it's advisable to wait at least 10 minutes before resubmitting it to search engines. If your site pages are dynamic and updated regularly (e.g., a sports match page), it is preferable not to use IndexNow to notify about every change.
Yes, it is often necessary despite having an XML sitemap. Although an auto-updated XML sitemap is the most popular way to notify search engines about changes to a site's content, search engines often crawl it infrequently and may learn about changes much faster through the IndexNow protocol.
Yes, crawling each URL submitted via IndexNow consumes the site's available crawling budget. Using this tool, you are simply additionally notifying search engines that the specified URLs should be crawled as a priority.
An excellent way to bypass daily page indexing restrictions in search engines. An indispensable tool if page indexing speed is critical for your website.