Agent Crawl Readiness
52FairBounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.
Loading the directory
Browser MCP servers drive a real browser for research, scraping, and UI checks. Prefer servers that pin a package version and document the tools they expose.
557 servers
Bounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.
Browse and inspect sites in your own Kitsuvo browser through an opt-in authenticated relay.
Parse a User-Agent: browser, OS, device, plus bot, search crawler, AI crawler and AI agent flags.
Browser fingerprinting for web apps: integration code for any framework, docs search and pricing.
HTML and CSS to PDF MCP server with page headers, footers and page numbers. No headless browser.
Scrape any public Discourse forum: topic titles, authors, reply counts, views and canonical URLs…
Agent utility API: 28+ free endpoints (hash, QR, DNS, scrape, JWT...) run by an autonomous AI agent.
Open-source web scraper for AI agents with scrape, crawl, and map tools
X/Twitter automation MCP: scrape, post, schedule, analyze, engage. No API key required.
Real signed-browser automation for AI agents, over a local stdio MCP server.
Browser MCP: drive a real Chromium via Playwright with compact ref-addressable page snapshots
Read LinkedIn profiles, companies, jobs and messages via your own browser session
Watch your AI drive a real Chrome live, point, approve, or take the wheel from your phone.
Local browser automation for MCP clients powered by DrissionPage.
Bridge a live Chrome browser to your agent: 150 tools for capture, extraction, and observation.
Fetch, parse, screenshot and browse pages via MCP without a real browser -- no JS execution.
Screenshot any URL and see it, or mint a social card — hosted, SSRF-safe, cached. No Chrome to run.
User story map + kanban with a live browser UI; AI agents and humans plan the same backlog via MCP.
MCP server that drives the real Chrome you already use, through an extension and CDP.
Speech, transcription, voice agents, Trace, Recap, dubbing and narration with browser OAuth.
Drive a browser you are already signed into, through the free T3rnel Browser extension.
Web data for AI agents: scrape, crawl, search, deep research, site monitoring, browser automation
LinkedIn Sales Navigator contact and account search from your logged-in browser.