Semrush
Other bots
SemrushBot-SI
Fetches pages for the Semrush On Page SEO Checker.
Follows robots.txt- User agent token
- SemrushBot-SI
- Operator
- Semrush
- Verification
- None published
- Source
- Semrush documentation
What a bot for ads, link previews or SEO tools does
These bots work for a specific product: checking an ad's landing page, drawing the preview when a link is shared, or collecting data for an SEO tool. Some only visit because the site owner asked them to.
Block or allow SemrushBot-SI in robots.txt
Add one of these to the robots.txt file at the root of your domain. Crawlers read it before they fetch anything else.
Block SemrushBot-SI
User-agent: SemrushBot-SI
Disallow: /Allow SemrushBot-SI
User-agent: SemrushBot-SI
Allow: /More from Semrush
Questions, answered.
SemrushBot-SI is a bot for ads, link previews or SEO tools run by Semrush. Fetches pages for the Semrush On Page SEO Checker.
Yes. Semrush says SemrushBot-SI follows robots.txt.
Add "User-agent: SemrushBot-SI" and "Disallow: /" to your robots.txt.
Semrush publishes no IP list for SemrushBot-SI, so it can only be recognised by its user agent, which other bots can copy.
No. SemrushBot-SI works for one product, such as ad checks, link previews or SEO data, rather than bringing visitors.
Only if you don't use the product it works for. Blocking SemrushBot-SI is safe for your search rankings.
In its own documentation at https://www.semrush.com/bot/. Every fact on this page comes from there.
Still have questions? We're happy to help.
See which bots really read your site.
NoirTrack counts SemrushBot-SI and every other bot apart from real visitors, and its firewall can block them before they reach your pages.
Start free trialFree 14-day trial, no credit card. The server SDK also sees bots that never run JavaScript.