Agent Plugins Marketplace
← All plugins

kreuzcrawl

v0.2.2

Web crawling and scraping with HTML→Markdown and headless-Chrome fallback.

Codex7 Skills

By Kreuzberg, Inc.License: MIT1.1k GitHub starsUpdated 13 hours ago

Directory evidence

Runtimes
Codex
Parsed components
7 skill or MCP entries
Source updated
Sep 23, 2026
Manifest status
Canonical path parsed

The directory validates manifest shape and source location. It does not execute the plugin or provide a security endorsement. Review the indexing methodology →

Install kreuzcrawl for Codex

Installs for the current user
codex plugin marketplace add IchenDEV/agent-plugin-mkt
codex plugin marketplace upgrade agent-plugin-marketplace
codex plugin add kreuzcrawl@agent-plugin-marketplace

Paste and run these commands in a terminal with Codex. They add and refresh the PluginsMP catalog, then install this plugin.

The installer fetches third-party code from the source repository shown on this page. This directory validates manifest structure and source location, but does not perform a security audit; review the manifest, components, and source before installing.

Get the source manually
git clone https://github.com/hashgraph-online/awesome-codex-plugins

Clone the source repository, then follow its setup instructions to add the plugin to a compatible client. The plugin root is plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/.

Plugin files

plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/
├── .codex-plugin/plugin.json
├── skills/automating-the-browser/SKILL.md
├── skills/crawling-a-site/SKILL.md
├── skills/headless-fallback/SKILL.md
├── skills/kreuzcrawl/SKILL.md
├── skills/mapping-urls/SKILL.md
├── skills/scraping-html-to-markdown/SKILL.md
└── skills/serving-the-api/SKILL.md

Included Skills7

automating-the-browserskills/automating-the-browser/SKILL.md

Use when extracting a page needs scripted interaction first — click, type, press a key, scroll, wait, screenshot, or run JS before capturing the DOM. Covers `kreuzcrawl interact <url> --actions` with the real action schema, result shape, limits, and external-CDP options.

crawling-a-siteskills/crawling-a-site/SKILL.md

Use when the user wants to follow links across a domain and capture every reachable page as Markdown. Covers `kreuzcrawl crawl` with depth, page caps, concurrency, rate limiting, domain scoping, robots, and output selection.

headless-fallbackskills/headless-fallback/SKILL.md

Use when a static fetch returns nothing useful and the page needs a real browser. Covers `--browser-mode auto|always|never`, external CDP via `--browser-endpoint`, symptoms of JS-only pages and WAF blocks, and the performance cost.

kreuzcrawlskills/kreuzcrawl/SKILL.md

Crawl, scrape, and convert websites to Markdown using the local kreuzcrawl CLI and its MCP server. Use when the user wants to fetch a page, follow links across a domain, enumerate URLs, or drive a real browser. Covers installation, the subcommands (scrape, crawl, map, interact, mcp, serve), output formats (JSON + Markdown), browser fallback, and when to prefer the MCP server over shelling out.

mapping-urlsskills/mapping-urls/SKILL.md

Use when the user wants the list of URLs on a site rather than the page content — sitemap analysis, link planning, or seeding another tool. Covers `kreuzcrawl map <url>` with `--limit`, `--search`, robots, output, and how it differs from a full crawl.

scraping-html-to-markdownskills/scraping-html-to-markdown/SKILL.md

Use when the user wants a single page rendered as clean Markdown plus structured metadata. Covers `kreuzcrawl scrape <url>`, JSON vs Markdown output, what metadata is returned, and how to handle JS-heavy pages.

serving-the-apiskills/serving-the-api/SKILL.md

Use when the user wants a long-running HTTP service for scrape/crawl/map instead of one-shot CLI calls or the MCP server — for example wiring kreuzcrawl into other apps over REST. Covers `kreuzcrawl serve`, the Firecrawl-v1-compatible endpoints, `--host`/`--port`, and when to prefer it.

Plugin manifests1

plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/.codex-plugin/plugin.json
{
  "name": "kreuzcrawl",
  "version": "0.2.2",
  "description": "Web crawling and scraping with HTML→Markdown and headless-Chrome fallback.",
  "author": {
    "name": "Kreuzberg, Inc.",
    "email": "[email protected]",
    "url": "https://kreuzberg.dev"
  },
  "homepage": "https://kreuzberg.dev",
  "repository": "https://github.com/kreuzberg-dev/plugins",
  "license": "MIT",
  "keywords": [
    "web-scraping",
    "crawling",
    "html-to-markdown",
    "headless-chrome"
  ],
  "skills": "./skills/",
  "interface": {
    "displayName": "Kreuzcrawl",
    "shortDescription": "Crawl and scrape sites to clean markdown",
    "longDescription": "Scrape single pages, crawl entire sites, or map a domain's URLs through the local kreuzcrawl CLI. Every page is converted to clean Markdown via the built-in HTML→Markdown engine. WAF-blocked or JS-heavy pages transparently fall back to a headless Chrome backend.",
    "developerName": "Kreuzberg, Inc.",
    "category": "web-scraping",
    "capabilities": [
      "Read",
      "Write"
    ],
    "defaultPrompt": [
      "Crawl this site to markdown",
      "Scrape a single page",
      "Fall back to headless mode"
    ],
    "websiteURL": "https://kreuzberg.dev",
    "privacyPolicyURL": "https://kreuzberg.dev/privacy",
    "termsOfServiceURL": "https://kreuzberg.dev/terms",
    "brandColor": "#7C3AED",
    "composerIcon": "./assets/icon.svg",
    "logo": "./assets/logo.png",
    "screenshots": []
  }
}

For maintainers

If you maintain this plugin, link to this source-backed listing from your README so users can review its manifest and indexed components.

[kreuzcrawl on Agent Plugins Marketplace](https://pluginsmp.com/plugins/kreuzcrawl)