Requires auth4 / 22 checks passed
Generate, validate and check robots.txt rules for AI crawlers. Free; optional Pro key.
- Passed: Updated recently
Not checked yet
Remote MCP servers
Find a server for your workflow, with connection evidence you can inspect.
441 servers
Ordered by checks passedClear filters
- Requires auth4 / 22 checks passedScraper API
scraper-api.comVerified
One API for public web data across social, directories and real estate, as clean JSON.
Real Estate & PropertyBrowser & web scraping
Outdated check
- Passed: Updated recently
Median latency not measured · Last checked
- Requires auth4 / 22 checks passedSemscraper
semscraper.comVerified
Real Google and Google Maps SERPs for AI assistants: pixel positions, AI Overviews and sources.
- Passed: Updated recently
Not checked yet
- Requires auth4 / 22 checks passedSEO Records
seorecords.comVerified
SEO check of any website and AI crawler access test (access pass), and the full Audit.
Marketing & SalesBrowser & web scraping
- Passed: Updated recently
Not checked yet
- Requires auth4 / 22 checks passedseodraft
seodraft.appVerified
Turn the AI you already pay for into an SEO agent: measured topics, SERP briefs, rule-checked drafts
Marketing & SalesBrowser & web scraping
Outdated check
- Passed: Updated recently
Median latency not measured · Last checked
- Requires auth4 / 22 checks passedSeolytics
seolytics.appVerified
SEO & GEO data: keywords, live SERPs with AI Overviews, backlinks, site audits, rank tracking.
Marketing & SalesBrowser & web scraping
Outdated check
- Passed: Updated recently
Median latency not measured · Last checked
- Requires auth4 / 22 checks passedShadowCrawl
DevsHeroVerified
Stealth scraping & search. Bypasses Cloudflare, DataDome & LinkedIn via Cyborg HITL approach.
Developer ToolsBrowser & web scraping
Outdated check
Median latency not measured · Last checked
- Requires auth4 / 22 checks passed
url smoke / headless QA: desktop+phone → pass/fail JSON. MCP shelf.kymac.co
Developer ToolsBrowser & web scraping
- Passed: Updated recently
Not checked yet
- Requires auth4 / 22 checks passedSpider Cloud
spider.cloudVerified
Crawl, scrape, search the web, and automate browsers at scale with anti-bot bypass.
Developer ToolsBrowser & web scraping
- Passed: Updated recently
Not checked yet
- Requires auth4 / 22 checks passedTaskavel
taskavel.comVerified
Headless task management for bots, apps and AI agents. Remote MCP server, OAuth or access token.
Developer ToolsBrowser & web scraping
Outdated check
- Passed: Updated recently
Median latency not measured · Last checked
- Requires auth4 / 22 checks passed
Parse a User-Agent: browser, OS, device, plus bot, search crawler, AI crawler and AI agent flags.
Developer ToolsBrowser & web scraping
- Passed: Updated recently
Not checked yet
- Requires auth4 / 22 checks passedUjeebu
ujeebu.comVerified
Web scraping, Google SERP, Markdown and ChatGPT/Gemini answers as typed tools for AI agents.
Developer ToolsBrowser & web scraping
- Passed: Updated recently
Not checked yet
- Requires auth4 / 22 checks passed
Scrape and crawl websites into queryable tables: products, leads, Shopify catalogs, real estate.
Real Estate & PropertyBrowser & web scraping
Outdated check
- Passed: Updated recently
Median latency not measured · Last checked
- Requires auth4 / 22 checks passedViral Outliers
viraloutliers.comVerified
Find viral outlier posts on TikTok, Instagram and YouTube, pull creator stats, and crawl on demand.
- Passed: Updated recently
Not checked yet
- Requires auth4 / 22 checks passedWholetally
wholetally.comVerified
Cookieless analytics for agents: visitors, pages, sources, AI crawlers, funnels and revenue.
Data & AnalyticsBrowser & web scraping
Outdated check
- Passed: Updated recently
Median latency not measured · Last checked
- Requires auth4 / 22 checks passed
See what GPTBot, ClaudeBot and other crawlers get from a site: robots.txt checks and AI scans.
- Passed: Updated recently
Not checked yet
- Outdated check3 / 22 checks passed
Independent preview-URL QA for coding agents. Playwright heuristics, pass/fail pack.
Developer ToolsBrowser & web scraping
- Passed: Updated recently
Median latency not measured · Last checked
- Requires auth3 / 22 checks passed
Send quick greetings, scrape website content, and generate text or images on demand. Perform web s…
Not checked yet
- Requires auth3 / 22 checks passed
Greet anyone by name with a friendly hello. Scrape webpages to extract content for quick reference…
Not checked yet
- Requires auth3 / 22 checks passed
One MCP for the Web. Easily search, crawl, navigate, and extract websites without getting blocked.…
Developer ToolsBrowser & web scraping
Not checked yet
- Requires auth3 / 22 checks passed
Fetch and process content from specified URLs using the Oxylabs Web Scraper API.
Developer ToolsBrowser & web scraping
Not checked yet
- Requires auth3 / 22 checks passed
Enable language models to perform advanced AI-powered web scraping with enterprise-grade reliabili…
Developer ToolsBrowser & web scraping
Not checked yet
- Requires auth3 / 22 checks passed
UXBERT Labs headless CMS: model, write and publish bilingual content, media, delivery checks.
- Passed: Updated recently
Not checked yet
- Requires auth3 / 22 checks passed
Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
Outdated check
- Passed: Updated recently
Median latency not measured · Last checked
Automated measurements. Not a rating. Unmeasured checks are not failures. How to read the evidence