The NoirTrack blog

Guides on revenue attribution, bot traffic and privacy-first analytics.

SEO

1 article

Small robot crawlers reading pages of a website, some let in through a gate and some held back

NoirTrack team in Bots

GPTBot, ClaudeBot and friends: should you block AI crawlers?

AI companies crawl the web to train models and answer questions. What the main AI bots do, what you gain or lose by blocking them, and a simple way to decide.

Oct 5, 2026·3 min read

Read article

Explore topics

Every subject we write about.

Analytics 14 Revenue 13 Privacy 11 Attribution 6 Bots 3 Firewall 2 AI 1 GDPR 1 Growth 1 Marketing 1 SEO 1 Social 1 UTM 1 X 1

Start seeing the real numbers.

Finally see which traffic makes you money. Live on your site in under two minutes.

Start free trial

Free 14-day trial, no credit card, cookieless mode included