Description​

Choose how your forum handles AI training crawlers. AI Crawler Blocklist starts in Monitor mode, maintains supported IP feeds, and lets you switch selected policies to a lightweight HTTP 403 response after reviewing traffic.

Training-only defaults keep AI search, user fetching and social previews unselected. Dedicated crawler IP feeds can catch a different user agent; shared ranges require role-specific evidence unless you opt into provider-wide blocking. Verified Google and Bing traffic is protected.

Meta and Bytespider currently use UA matching. Application blocking still uses PHP bootstrap resources and does not cover upstream cache responses or every disguised crawler.

Key features​

• Monitor, Block and Off modes, with training-only presets and individual crawler controls.
• Supported feed updates and cached Google/Bing verification in background jobs.
• IP/CIDR allow and deny rules; optional ASN rules with scope review.
• Matching-request totals, bounded samples and an exact-IP deny action.
• Offline IP/UA diagnostics, staged-update review and stale-source monitoring fallback.
• Previous-snapshot recovery and an emergency bypass.

Quick setup​

1. Install a verified archive when available and grant the management permission.
2. Open Setup → AI crawler blocklist and let the source jobs run.
3. Keep Monitor active while you review activity and Google/Bing source health.
4. Choose crawler policies, test example decisions, then confirm Block when ready.

Requires XenForo 2.3+, PHP 7.2+ and cURL. Scheduled jobs and supported HTTPS endpoints must be available.

Télécharger V 1.0.0 :