crawl plugins

The directory indexes 4 plugins tagged “crawl” from 3 public source repositories, with 26 skills and 1 MCP servers across the collection.

4 plugins3 repositories0 cross-runtimeIndexing methodology →

tag: crawl Clear all

codiris-agentizer
by Iris Lab
Turn any website into an AI-powered agentfront — crawl, generate, deploy in one command.
Codex
1.1kUpdated 13 hours ago
just-scrape
by ScrapeGraph AI
AI-powered web scraping CLI — search, scrape, extract structured JSON, crawl, and monitor web pages via the ScrapeGraph AI API.
Codex1 Skill
1.1kUpdated 2 days ago
ketch
by 1broseidon
Optional Claude Code integration for the ketch CLI: wires up the `ketch mcp serve` MCP server (search, code, docs, scrape, crawl) and installs the bundled ketch research skill. The CLI stays the zero-infrastructure path — this plugin is a convenience, never a prerequisite. Requires the ketch binary >= v0.10.0 on PATH: brew install ketch or go install github.com/1broseidon/ketch@latest.
Claude Code1 MCP serverstdio
591Updated 5 days ago
axon
by dinglebear.ai
Self-hosted RAG engine in Rust: crawl, scrape, ingest, embed, and query any source, with hybrid retrieval and cited LLM synthesis over MCP, CLI, and REST.
Claude Code25 Skills
4Updated 2 weeks ago