WordPress.org

Catalan (Balear)

Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawler

Plugin Tag: crawler

  • Berq Markdown: Markdown Pages for AI & LLM Crawlers

    (0 total ratings)

    Increase your AI visibility. Berq Markdown serves every page as a clean Markdown file so AI assistants and LLM crawlers can read, cite, and recommend …

    BerqWP 10+ active installations Tested with 7.0.1

  • JaspreetChahal’s wordpress bot detector lite

    (1 total ratings)

    This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …

    Jaspreet Chahal 10+ active installations Tested with 4.2.39

  • SEObot Monitor for Googlebot, Bingbot and search engine spiders

    (0 total ratings)

    With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …

    Santiago Alonso 10+ active installations Tested with 5.8.13

  • Page Modified

    (1 total ratings)

    Display the results of your Page Modified crawls right within your WordPress Admin.

    Chris Klosowski 10+ active installations Tested with 4.9.29

  • Robots.txt Extender

    (0 total ratings)

    Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

    bettoadami 10+ active installations Tested with 5.0.25

  • AI Kansoku Lab Tracker

    (0 total ratings)

    Track AI crawler visits such as GPTBot, ClaudeBot, and PerplexityBot server-side and visualize them in WordPress.

    AI Kansoku Lab Fewer than 10 active installations Tested with 7.0.1

  • AI Bot Monitor

    (0 total ratings)

    Tracks and logs AI, Search and Social bots including ChatGPT, Perplexity, Googlebot, Bing and Meta crawlers.

    straightdigital Fewer than 10 active installations Tested with 6.7.5

  • GoVISIBLE AI Bot Tracker

    (0 total ratings)

    Track visits from AI bots like ChatGPT, GPTBot, Claude, Gemini, and Perplexity.

    govisible Fewer than 10 active installations Tested with 7.0.1

  • AI Visibility Control – Dynamic llms.txt & robots.txt Crawler Control

    (0 total ratings)

    Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.

    Techbysh Fewer than 10 active installations Tested with 7.0.1

  • GoBookMart Robots Editor

    (1 total ratings)

    A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.

    Gobookmart Fewer than 10 active installations Tested with 6.9.4

  • Zicy AI Access Monitor

    (0 total ratings)

    Monitor known AI crawlers and AI assistant fetches, with daily rollups, CSV exports, weekly summaries, and page briefs.

    zicygp Fewer than 10 active installations Tested with 7.0.1

  • URLs Most Wanted for LiteSpeed LScache

    (0 total ratings)

    A demand-driven sitemap for LiteSpeed Cache warmup. Record the URLs visitors actually use and warm only what people need.

    imedes Fewer than 10 active installations Tested with 7.1

  • AI Crawler Guard

    (0 total ratings)

    Detect and control AI crawler access with local logging and history.

    aicrawlerguard.com Fewer than 10 active installations Tested with 6.9.4

  • Virtual LLMS.TXT Generator

    (0 total ratings)

    Safely creates a virtual llms.txt dynamically. Features interactive bot targeting, map auto-syncing, and decoupled custom instructions.

    Alex Oreshkin Fewer than 10 active installations Tested with 7.0.1

  • GlobeSign Content Markdown Mirror

    (0 total ratings)

    Makes your WordPress site AI-friendly: generates llms.txt and clean, structured Markdown mirrors of every page and post.

    globesign Fewer than 10 active installations Tested with 7.0.1

  • FocusWeb AI Crawler Monitor – Track, Verify & Block AI Bots

    (1 total ratings)

    Track, verify and block AI crawlers (GPTBot, ClaudeBot, PerplexityBot). Spot spoofed bots, control robots.txt, measure AI referral traffic.

    upi Fewer than 10 active installations Tested with 7.0.1

  • Pixellize Site Issue Scanner

    (2 total ratings)

    Powerful SEO auditor by Pixellize. Crawls your site to fix broken links, missing meta tags, and unoptimized images.

    Pixellize Fewer than 10 active installations Tested with 7.0.1

  • Whizz MD — Markdown Endpoints for AI Crawlers

    (0 total ratings)

    Serve every WordPress post and page as a clean .md file with full SEO frontmatter — discoverable by AI crawlers and search engines on the fly.

    Whizz People Fewer than 10 active installations Tested with 7.0.1

  • AI Crawlers Visibility, Analytics & Control

    (0 total ratings)

    Monitor, block, and analyze AI crawlers like GPTBot, ClaudeBot, and Google-Extended on your WordPress site.

    miniOrange Fewer than 10 active installations Tested with 6.9.4

  • WEO LLMS & AI Crawler Guide

    (2 total ratings)

    The professional architect for your llms.txt file. Control how AI agents (ChatGPT, Claude, Perplexity) consume your website content with a structured, …

    Md Atiar Rahman Ovi Fewer than 10 active installations Tested with 6.9.4