MCP Server Directory

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI

AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.

Novada MCP io.github.NovadaLabs/novada-mcp

One MCP server for all web data. Scrape, search, crawl, and AI research in one install.

AWS, GitHub and connected services from your agent, no keys to paste, plus local shell and browser.

NativePort ai.nativeport/mcp

30+ web-access and AI APIs behind one key: search, scraping, browsers, voice, OCR and LLMs.

lintlab SEO Site QA io.github.lintlab/seo-site-qa

Crawl a site for broken links, redirects and missing SEO tags. Pay per page on Apify.

Google News Scraper — Real Publisher URLs, MCP-Ready io.github.paulovitorti/google-news-scraper-real-urls

Scrapes Google News and returns the real publisher URLs, not redirect links.

KDE Plasma 6 Wayland GUI automation for AI agents: 30 tools (EIS input, screenshots, AT-SPI2).

Parseium com.parseium/mcp

Web scraping runtime for agents: parsers, scrapes, batches, crons, and SQL databases.

Site SEO & AI Crawler Audit app.openkrill/site-check

Check public pages for SEO tags, AI crawler rules, AI citation signals and landing page conversion.

ai-crawler-readiness com.lumnika/ai-crawler-readiness

Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index

Background Windows desktop for AI agents: native GUI automation, screenshots and app testing.

Website Change Monitor & Deterministic Diff io.github.industrial-platform-ai/web-change

Deterministic webpage change detection, hashes and text diffs for recurring monitoring via x402 MCP.

Verified desktop control for agents on Windows and Linux: apps with no API, windows, shell, browser.

estimate net.sitesai/estimate

Browser earthworks takeoff: PDF/DWG/DXF plans, calibrate, draw, cut & fill volumes, pricing.

Framejet Screenshot dev.framejet/screenshot

Clean PNG/JPEG screenshots via REST or MCP, with goal-driven multi-step navigation.

Tell your human in person: a 3D character walks onto their open browser tab and says it out loud.

Drive live Flutter apps: snapshot the Semantics tree, tap, type, scroll and screenshot.

Sitemap Scraper - Extract All URLs to JSON com.ranovam/sitemap-scraper

Extract all URLs from any XML sitemap into clean JSON, including lastmod, changefreq and priority.

Playwright URL Check io.github.sadri-dridi/playwright-url-ok

Check whether a URL can be opened. No browser is launched.

Tabfleet com.tabfleet/tabfleet

Launch, inspect, control, and share isolated cloud browsers for your agents.

Sixteen statutory checks on the signup page AB 2863 rewrote, in your editor and in the browser

ZAP Imóveis Scraper — Anúncios de Venda e Aluguel io.github.paulovitorti/zap-imoveis-scraper

Extrai anúncios do ZAP Imóveis: venda e aluguel com preço, área, quartos e localização.

AgentRender io.github.corbinvachal48/agentrender-mcp

URL to screenshot, PDF, or extract for AI agents. Free 150 renders/mo, then $17/mo.