RYTE and Yoast say NoIndex via robots.txt

Do you use bot blockers or bot blocking plugins? Like e.g. Wordfence?

One reason why domains might not be indexable according to Ryte are plugins that differentiate between bot visitors and browser visitors.

Please make sure that our crawler is allowed to crawl your website. Of course, you can whitelist our user agent, "Rytebot" to avoid issues.

Have more questions? Submit a request

0 Comments

Please sign in to leave a comment.
Powered by Zendesk