Web host rate limit when using Grok Bot
I followed Thomas’s prompt to set up my first webmaster bot. Almost immediately, it hit a snag when trying to access my WordPress login page—a 429 error for “too many requests.” It said the host had rate-limited it and repeated the attempt several times with cool-down periods between each attempt. I finally told it to stop trying and I would log in myself using its browser. That worked and it was able to access my WP dashboard, but when I tried to have it fix some issues with Jetpack Boost and Divi CSS settings, it hit the same error.
I use DreamHost for my hosting and have been happy with it, but apparently it won't let the bot operate the way I need it to. (I assume this might not be an issue if I were using WP Engine as Thomas does, but that's way overkill for my budget.) Any tips?