Why does the crawl of my project not finish?

There are several reasons why a Crawl struggles to finish. It is very important to identify the positions where the crawler gets stuck.

So first questions first: was the crawler able to fetch any pages at all? Please check the "Crawler-Settings" Tab "Crawler-History" to see how many URLs the crawler already analyzed. If there were no sites at all or a really small amount of sites like up to 10 URLs this means the crawler wasn't able to correctly crawl your website. Please cancel the crawl and check the tab "test settings". Make sure that the header status code is 200 and the field "Part of the project" shows a green checkmark. Please also check if there are links displayed at "local links". Possible reasons might be a 404 header status code or our crawler gets blocked by the server.

If however, the crawler was able to crawl the domain, but it takes a really long time finishing, the issue occurred either during the crawl or while finishing the crawl.

In this case, there are two possible options.
1. Stop the Crawl and restart crawling
2. Send us a Mail at support@ryte.com including the project name. And we will get back to you as soon as possible.

Have more questions? Submit a request

0 Comments

Please sign in to leave a comment.
Powered by Zendesk