MCP Server Directory

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

Novada MCP io.github.NovadaLabs/novada-mcp

One MCP server for all web data. Scrape, search, crawl, and AI research in one install.

Verified desktop control for agents on Windows and Linux: apps with no API, windows, shell, browser.

AWS, GitHub and connected services from your agent, no keys to paste, plus local shell and browser.

NativePort ai.nativeport/mcp

30+ web-access and AI APIs behind one key: search, scraping, browsers, voice, OCR and LLMs.

lintlab SEO Site QA io.github.lintlab/seo-site-qa

Crawl a site for broken links, redirects and missing SEO tags. Pay per page on Apify.

KDE Plasma 6 Wayland GUI automation for AI agents: 30 tools (EIS input, screenshots, AT-SPI2).

Google News Scraper — Real Publisher URLs, MCP-Ready io.github.paulovitorti/google-news-scraper-real-urls

Scrapes Google News and returns the real publisher URLs, not redirect links.

Site SEO & AI Crawler Audit app.openkrill/site-check

Check public pages for SEO tags, AI crawler rules, AI citation signals and landing page conversion.

Background Windows desktop for AI agents: native GUI automation, screenshots and app testing.

Parseium com.parseium/mcp

Web scraping runtime for agents: parsers, scrapes, batches, crons, and SQL databases.

Website Change Monitor & Deterministic Diff io.github.industrial-platform-ai/web-change

Deterministic webpage change detection, hashes and text diffs for recurring monitoring via x402 MCP.

ai-crawler-readiness com.lumnika/ai-crawler-readiness

Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index

ZAP Imóveis Scraper — Anúncios de Venda e Aluguel io.github.paulovitorti/zap-imoveis-scraper

Extrai anúncios do ZAP Imóveis: venda e aluguel com preço, área, quartos e localização.

estimate net.sitesai/estimate

Browser earthworks takeoff: PDF/DWG/DXF plans, calibrate, draw, cut & fill volumes, pricing.

Framejet Screenshot dev.framejet/screenshot

Clean PNG/JPEG screenshots via REST or MCP, with goal-driven multi-step navigation.

Tell your human in person: a 3D character walks onto their open browser tab and says it out loud.

Drive live Flutter apps: snapshot the Semantics tree, tap, type, scroll and screenshot.

Sitemap Scraper - Extract All URLs to JSON com.ranovam/sitemap-scraper

Extract all URLs from any XML sitemap into clean JSON, including lastmod, changefreq and priority.

Citevana AI visibility tools com.citevana/mcp

Free MCP tools for AI-search visibility: crawler checks, page audits, and llms.txt generation.

Playwright URL Check io.github.sadri-dridi/playwright-url-ok

Check whether a URL can be opened. No browser is launched.

Tabfleet com.tabfleet/tabfleet

Launch, inspect, control, and share isolated cloud browsers for your agents.

Sixteen statutory checks on the signup page AB 2863 rewrote, in your editor and in the browser