spicrawl
v0.1.0Scrape web pages to Markdown, HTML, text or JSON, run batch jobs, keep login sessions, and read request history and usage, through the hosted Spicrawl MCP server.
By SpicrawlLicense: Apache-2.01 GitHub starsUpdated 9 hours ago
Directory evidence
- Runtimes
- Codex and Claude Code
- Parsed components
- 2 skill or MCP entries
- Source updated
- Sep 30, 2026
- Manifest status
- Canonical path parsed
The directory validates manifest shape and source location. It does not execute the plugin or provide a security endorsement. Review the indexing methodology →
Install spicrawl for Codex and Claude Code
codex plugin marketplace add Spicrawl/agent-plugins
codex plugin marketplace upgrade spicrawl-plugins
codex plugin add spicrawl@spicrawl-pluginsPaste and run these commands in a terminal with Codex. They add and refresh the spicrawl-plugins catalog, then install this plugin.
Compatibility: the page URL and API slug “spicrawl” remain stable.
- Codex:
spicrawl@agent-plugin-marketplace→spicrawl@spicrawl-plugins
The installer fetches third-party code from the source repository shown on this page. This directory validates manifest structure and source location, but does not perform a security audit; review the manifest, components, and source before installing.
Get the source manually
git clone https://github.com/Spicrawl/agent-pluginsClone the source repository, then follow its setup instructions to add the plugin to a compatible client. The plugin root is plugins/spicrawl/.
Plugin files
├── .codex-plugin/plugin.json├── .claude-plugin/plugin.json├── skills/spicrawl/SKILL.md└── .mcp.json
Included Skills1
Fetch web pages and read their content with Spicrawl, through its MCP tools, the `spicrawl` CLI or the HTTP API. Use when an agent needs a page's content as Markdown, HTML, text or JSON, has to render JavaScript, extract fields with selectors, scrape a list of URLs as a batch job, keep a logged-in session (cookies and storage), check its request history or usage, or look up Spicrawl's own documentation.
MCP servers1
- url
- https://mcp.spicrawl.com/mcp
Plugin manifests2
{
"name": "spicrawl",
"version": "0.1.0",
"description": "Scrape web pages to Markdown, HTML, text or JSON, run batch jobs, keep login sessions, and read request history and usage, through the hosted Spicrawl MCP server.",
"author": {
"name": "Spicrawl",
"email": "[email protected]",
"url": "https://spicrawl.com"
},
"homepage": "https://docs.spicrawl.com/agents/mcp",
"repository": "https://github.com/Spicrawl/agent-plugins",
"license": "Apache-2.0",
"keywords": [
"scraping",
"web",
"markdown",
"batch",
"sessions",
"mcp"
],
"skills": "./skills/",
"mcpServers": "./mcp/codex.json",
"interface": {
"displayName": "Spicrawl",
"shortDescription": "Scrape web pages, run batch jobs, keep login sessions",
"longDescription": "Scrape web pages to Markdown, HTML, text or JSON, run batch jobs, keep persistent login sessions, and read request history, usage and Spicrawl's docs. Needs a Spicrawl API key in SPICRAWL_API_KEY.",
"developerName": "Spicrawl",
"category": "Developer Tools",
"capabilities": [
"Read"
],
"websiteURL": "https://spicrawl.com",
"defaultPrompt": [
"Use Spicrawl to fetch this page as Markdown and summarize it."
],
"composerIcon": "./logo.png",
"logo": "./logo.png"
}
}{
"name": "spicrawl",
"displayName": "Spicrawl",
"version": "0.1.0",
"description": "Scrape web pages to Markdown, HTML, text or JSON, run batch jobs, keep login sessions, and read request history and usage, through the hosted Spicrawl MCP server.",
"author": {
"name": "Spicrawl",
"email": "[email protected]",
"url": "https://spicrawl.com"
},
"homepage": "https://docs.spicrawl.com/agents/mcp",
"repository": "https://github.com/Spicrawl/agent-plugins",
"license": "Apache-2.0",
"keywords": [
"scraping",
"web",
"markdown",
"batch",
"sessions",
"mcp"
],
"mcpServers": "./mcp/claude.json",
"userConfig": {
"spicrawl_api_key": {
"type": "string",
"title": "Spicrawl API key",
"description": "Create a key at https://app.spicrawl.com (spicrawl_live_... or spicrawl_test_...). The usage tools need the read scope.",
"sensitive": true,
"required": true
}
}
}For maintainers
If you maintain this plugin, link to this source-backed listing from your README so users can review its manifest and indexed components.
[spicrawl on Agent Plugins Marketplace](https://pluginsmp.com/plugins/spicrawl)