Skip to contentrobots-txt-checker MCP Server | MCPpediaRrobots-txt-checker MCP Server
Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).
RegistryRemoteryuamarines 47FairInstall
~/Library/Application Support/Claude/claude_desktop_config.json
{
"mcpServers": {
"ryuamarines-robots-txt-checker": {
"url": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
}
}
}
Related servers
OInvestment runtime for AI agents — LLM investment committee, portfolio ledger, decision accounting
ARepo-native task continuity for AI coding agents: a reviewed task-state ledger served over MCP.
This server does not declare environment variables.
Tools show up when the registry metadata or the repository README lists them. GitHub enrichment fills this in when a token is configured.
About
Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).
FAQ
- What is robots-txt-checker?
- Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).
- How do I install robots-txt-checker?
- Pick a client above and copy the generated config. Cursor and VS Code also have a deep link when the server can run locally or remotely.
- Is robots-txt-checker official?
- No. Registry-listed is not the same as vendor-official. Read the methodology for the difference.
- How is the trust score calculated?
- This listing scores 47 (Fair). The formula is published on the methodology page.
Reviews
0 published · no average
Sign in to review this server.
GEL exchange rates from the National Bank of Georgia with per-unit values. Not affiliated with NBG.
FMCP marketplace: AI agents buy services from other agents per call in USDC, plus a bank cash-out
FFinancial news as sourced statements with sentiment and tickers, grouped into developments.
Let an AI agent find and pay for x402 APIs and products in USDC on Base, within owner-set limits.