Semrush
Other bots
SemrushBot
Crawls links for Semrush's backlink index.
Follows robots.txt- User agent token
- SemrushBot
- Operator
- Semrush
- Verification
- None published
- Source
- Semrush documentation
What a bot for ads, link previews or SEO tools does
These bots work for a specific product: checking an ad's landing page, drawing the preview when a link is shared, or collecting data for an SEO tool. Some only visit because the site owner asked them to.
Semrush publishes no IP list, so it can only be checked by user agent.
Block or allow SemrushBot in robots.txt
Add one of these to the robots.txt file at the root of your domain. Crawlers read it before they fetch anything else.
Block SemrushBot
User-agent: SemrushBot
Disallow: /Allow SemrushBot
User-agent: SemrushBot
Allow: /More from Semrush
Questions, answered.
SemrushBot is a bot for ads, link previews or SEO tools run by Semrush. Crawls links for Semrush's backlink index.
Yes. Semrush says SemrushBot follows robots.txt. Semrush publishes no IP list, so it can only be checked by user agent.
Add "User-agent: SemrushBot" and "Disallow: /" to your robots.txt.
Semrush publishes no IP list for SemrushBot, so it can only be recognised by its user agent, which other bots can copy.
No. SemrushBot works for one product, such as ad checks, link previews or SEO data, rather than bringing visitors.
Only if you don't use the product it works for. Blocking SemrushBot is safe for your search rankings.
In its own documentation at https://www.semrush.com/bot/. Every fact on this page comes from there.
Still have questions? We're happy to help.
See which bots really read your site.
NoirTrack counts SemrushBot and every other bot apart from real visitors, and its firewall can block them before they reach your pages.
Start free trialFree 14-day trial, no credit card. The server SDK also sees bots that never run JavaScript.