What is Content Gate?
A technique that prevents automated scripts from accessing page content by requiring JavaScript execution.
A content gate is a bot mitigation technique that withholds page content from the initial server response, instead requiring client-side JavaScript execution to render the actual content. Automated scripts that parse raw HTML responses see an empty or placeholder page, while real browsers with JavaScript execution see the full content.
Switch's Content Gate uses document.write() to inject content only after JavaScript execution, effectively blocking scrapers that use simple HTTP requests (curl, wget, Python requests) or headless browsers that don't fully execute JavaScript. This is more effective than CAPTCHAs (which frustrate human users) and more reliable than IP blocking (which catches legitimate visitors).
Content gates are particularly effective against high-volume scraping operations, training data crawlers that don't render JavaScript, and basic automation scripts. They're less effective against sophisticated browser agents that fully execute JavaScript, which is why Switch combines content gating with behavioral detection.
How Switch Helps
Switch's Content Gate feature uses document.write() to protect page content from non-JavaScript scrapers, combined with behavioral detection for full-browser agents.
Get Started FreeRelated Agents
GPTBot
OpenAI
OpenAI's training data crawler for GPT models including ChatGPT and GPT-4.
ClaudeBot
Anthropic
Anthropic's web crawler collecting training data for Claude models.
CCBot
Common Crawl
Common Crawl's open-source web archive used by multiple AI companies for training.
Puppeteer
Google's headless Chrome automation library commonly used for scraping.