Why can´t the crawler access my site?

An explanation for this could be a blocking software, which is denying the access to our crawling bot.

This could be due to the use of bot blockers or bot blocking plugins? Like e.g. Wordfence?

Please make sure that our crawler is allowed to crawl the website. Of course, you can whitelist our crawlers user agent which is "OnPageBot". 

Have more questions? Submit a request

0 Comments

Please sign in to leave a comment.
Powered by Zendesk