polite-crawler

io.github.mark1russell7/polite-crawler · v0.1.0

A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.

Description supplied by the publisher in the MCP Registry. We have not tested this server.

Install

npx -y polite-crawler mcp

Assembled from the package metadata in the official MCP Registry (including any subcommand or flag the publisher lists). Some publishers do not list the subcommand that starts MCP mode, so confirm the command in the README, along with any required configuration and credentials, before connecting it to real data.

Signals

GitHub stars	0
npm weekly downloads	0
Last push	3d ago
Licence	MIT
Open issues	0
SECURITY.md	Yes
Language	TypeScript
Latest version published	2026-10-13

Signals captured from GitHub, npm and the official MCP Registry on October 15, 2026. See the scoring method.