The NoirTrack blog

Know which traffic pays.

Practical guides on revenue attribution, bot traffic and privacy-first analytics for people running a small online business.

Subscribe via RSS
Small robot crawlers reading pages of a website, some let in through a gate and some held back

Bots

GPTBot, ClaudeBot and friends: should you block AI crawlers?

AI companies crawl the web to train models and answer questions. What the main AI bots do, what you gain or lose by blocking them, and a simple way to decide.

·3 min read

Read article