Cloudflare Workers Integration
Integrate Index Render at the edge using Cloudflare Workers. This powerful serverless solution intercepts requests instantly, serving pre-rendered HTML to search engine bots while maintaining a high-performance experience for real users.
Enable AI Crawlers
Cloudflare may block AI training crawlers by default. To allow Index Render to serve content to AI bots:
- Select your domain in the Cloudflare Dashboard.
- On the Overview page, find Control AI Crawlers.
- Ensure AI Crawlers is enabled.
Create a New Worker
Create a serverless function that will handle the bot detection logic.
- Go to Compute & AI > Workers & Pages.
- Click Create Application > Create Worker.
- Name your worker (e.g.,
indexrender-proxy) and click Deploy. - Click Edit Code and paste your Index Render worker script.
Configure API Token
Add your API key as a secure environment variable in your worker settings.
- In your Worker dashboard, go to Settings > Variables.
- Add a new variable under Environment Variables:
Set Up Routes
Attach the worker to your domain routes so it can intercept traffic.
- In your Worker settings, go to Domains & Routes.
- Click Add Route and enter your domain pattern (e.g.,
*example.com/*). - Set Failure Mode to Fail Open (Proceed) to ensure your site remains available even if the worker fails.
Verify Integration
To confirm that your integration is active, send a request to your URL while simulating a search engine bot. Run the following command in your terminal:
curl --location 'https://yourdomain.com' \
--header 'User-Agent: googlebot'
In the <head> section of the response, you should see the Index Render metadata tags indicating the page was successfully pre-rendered:
<!--IndexRender-->
<meta name="generator" content="IndexRender/65d6cde" />
<meta name="x-rendered-by" content="IndexRender/65d6cde" />
<meta name="x-rendered-at" content="2026-04-26T18:26:03.1076251Z" />
<meta name="x-render-traceparent" content="00-39f1dd04eeba1243cae01dc5c70e5b47-cdf5cfae992740d8-01" />