Why should I whitelist the RYTE user agent "OnPageBot"?

If you block our crawler, our clients might think that they are referencing (aka linking to) a broken page. In order to keep their website up to date and clean, they might be inclined to remove this reference to your page based on this false information.
For more information about our crawler bot please check out ryte.com/bot/

 

Have more questions? Submit a request

0 Comments

Please sign in to leave a comment.
Powered by Zendesk