- Aug 8, 2020
I was recently looking through my website's log files and noticed that SEMrushBot is crawling my site like crazy. It's out of control and I am concerned that it's using up too much bandwidth. I'm afraid that I'm going to go over my limit and my web hosting company is going to bill me for it. What's the best way to block this bot? I am not using them for anything and I have never used their service. Personally, I find their aggressive crawling very rude. Thank you.