Plugin-Schlagwort: crawler
-
BotObservatory – Live Bot Tracker & Anti-Scraper
Observe human and machine traffic, identify suspicious automation, and optionally quarantine aggressive scrapers.
-
URLs Most Wanted for LiteSpeed LScache
A demand-driven sitemap for LiteSpeed Cache warmup. Record the URLs visitors actually use and warm only what people need.
-
Pixellize Site Issue Scanner
Powerful SEO auditor by Pixellize. Crawls your site to fix broken links, missing meta tags, and unoptimized images.
-
Imedes AI Bot Verify
Verify supported AI bot identities, allow legitimate agents, and block spoofed claims.
-
Whizz MD — Markdown Endpoints for AI Crawlers
Serve every WordPress post and page as a clean .md file with full SEO frontmatter — discoverable by AI crawlers and search engines on the fly.
-
WEO LLMS & AI Crawler Guide
The professional architect for your llms.txt file. Control how AI agents (ChatGPT, Claude, Perplexity) consume your website content with a structured, …
-
Cleotic AI Traffic
See AI crawler visits and AI assistant referrals on your site, with optional signed sync to Cleotic.
-
FocusWeb AI Crawler Monitor – Track, Verify & Block AI Bots
Track, verify and block AI crawlers (GPTBot, ClaudeBot, PerplexityBot). Spot spoofed bots, control robots.txt, measure AI referral traffic.
-
OpenBotAuth – AI Crawler Access Control
Verify AI crawlers with HTTP Signatures and enforce allow/deny/teaser policies; also serves llms.txt and AI-ready feeds.
-
Trimardeau SEO Log : SEO & GEO Bot Analytics
SEO & GEO bot analytics: see Googlebot, ChatGPT, Claude and every AI crawler at work on each post, page and term — full crawl history included.
-
OtterFixer AI Bot Tracker
A lightweight plugin that logs visits from common AI/LLM crawler user-agents and shows a simple report in wp-admin.
-
Aiso AI Crawler Analytics
See which AI assistants — ChatGPT, Claude, Perplexity, Google and more — crawl your site, broken down by assistant, crawler, purpose and page.
-
Bottoll – AI Crawler Control
Detect AI crawlers, apply access policies, and understand automated access to your WordPress content.
-
AILYS Lens
See how AI reads your site. Detects, verifies, and displays AI crawler visits — all data stays on your own server.
-
LLMAffiliate AI Traffic Monetizer
Detect LLM user agents, enforce Google parity, and serve enhanced content through a configurable content service.
-
FacetFence Product Filters
Protect WooCommerce filtered URLs from crawl floods with noindex/canonical controls, signed cookies, rate limits, logs, and rollback.
-
Valvai – AI Traffic Control Center
Block, log and monetise AI crawlers directly from your WordPress dashboard.
-
Rankal LLMs.txt – Get Cited by ChatGPT, Claude & Perplexity
Generate and serve a dynamic, cached /llms.txt AI context index. An add-on that works in partnership with Rankal SEO Optimizer.