Baidu
Search engines
Baiduspider
Crawls pages for Baidu search.
Follows robots.txt- User agent token
- Baiduspider
- Operator
- Baidu
- Verification
- None published
- Source
- Baidu documentation
What a search engine crawler does
A search engine crawler indexes pages for regular search results. Blocking it removes the site from that engine, so most sites keep it allowed.
Block or allow Baiduspider in robots.txt
Add one of these to the robots.txt file at the root of your domain. Crawlers read it before they fetch anything else.
Block Baiduspider
User-agent: Baiduspider
Disallow: /Allow Baiduspider
User-agent: Baiduspider
Allow: /Questions, answered.
Baiduspider is a search engine crawler run by Baidu. Crawls pages for Baidu search.
Yes. Baidu says Baiduspider follows robots.txt.
Add "User-agent: Baiduspider" and "Disallow: /" to your robots.txt.
Baidu publishes no IP list for Baiduspider, so it can only be recognised by its user agent, which other bots can copy.
Yes. Baiduspider indexes pages for Baidu's search results, which send people to your site.
Usually not. Blocking Baiduspider removes your pages from its search results.
In its own documentation at https://www.baidu.com/search/robots_english.html. Every fact on this page comes from there.
Still have questions? We're happy to help.
See which bots really read your site.
NoirTrack counts Baiduspider and every other bot apart from real visitors, and its firewall can block them before they reach your pages.
Start free trialFree 14-day trial, no credit card. The server SDK also sees bots that never run JavaScript.