Agent Plugins Marketplace
← All plugins

web-scraper

Intelligent web scraper for extracting blog/news content from any website

CodexClaude Code1 Skill

By Tyrone RossLicense: Apache-2.00 GitHub starsUpdated 3 weeks ago

Directory evidence

Runtimes
Codex and Claude Code
Parsed components
1 skill or MCP entry
Source updated
Sep 24, 2026
Manifest status
Canonical path parsed

The directory validates manifest shape and source location. It does not execute the plugin or provide a security endorsement. Review the indexing methodology →

Install web-scraper for Codex and Claude Code

Installs for the current user
codex plugin marketplace add IchenDEV/agent-plugin-mkt
codex plugin marketplace upgrade agent-plugin-marketplace
codex plugin add web-scraper@agent-plugin-marketplace

Paste and run these commands in a terminal with Codex. They add and refresh the PluginsMP catalog, then install this plugin.

The installer fetches third-party code from the source repository shown on this page. This directory validates manifest structure and source location, but does not perform a security audit; review the manifest, components, and source before installing.

Get the source manually
git clone https://github.com/tyroneross/blog-content-scraper

Clone the source repository, then follow its setup instructions to add the plugin to a compatible client. The repository root is the plugin root.

Plugin files

web-scraper/
├── .codex-plugin/plugin.json
├── .claude-plugin/plugin.json
└── skills/web-scraper/SKILL.md

Included Skills1

web-scraperskills/web-scraper/SKILL.md

Use when user asks to scrape, extract articles, fetch news, get blog posts, discover RSS feeds, or parse sitemaps from websites.

Plugin manifests2

.codex-plugin/plugin.json
{
  "name": "web-scraper",
  "description": "Intelligent web scraper for extracting blog/news content from any website",
  "author": {
    "name": "Tyrone Ross",
    "url": "https://github.com/tyroneross"
  },
  "homepage": "https://github.com/tyroneross/blog-content-scraper",
  "repository": "https://github.com/tyroneross/blog-content-scraper",
  "license": "Apache-2.0",
  "keywords": [
    "scraper",
    "web",
    "blog",
    "rss",
    "content",
    "llm",
    "articles"
  ],
  "skills": "./skills",
  "interface": {
    "displayName": "Web Scraper",
    "shortDescription": "Extract article content from blog and news sites with LLM-ready output.",
    "longDescription": "Scrape single URLs or batches of URLs from blogs and news sites. Returns clean article text, token counts, and chunked output sized for downstream LLM ingestion. Auto-discovers RSS feeds and sitemaps when only a domain is given. Uses Mozilla Readability for extraction with Playwright fallback for JS-rendered pages.",
    "developerName": "Ross Labs",
    "category": "Coding",
    "capabilities": [
      "Read",
      "Write"
    ]
  }
}
.claude-plugin/plugin.json
{
  "name": "web-scraper",
  "description": "Extract blog and news content from any website",
  "author": {
    "name": "Tyrone Ross",
    "url": "https://github.com/tyroneross"
  },
  "homepage": "https://github.com/tyroneross/blog-content-scraper",
  "repository": "https://github.com/tyroneross/blog-content-scraper",
  "license": "Apache-2.0",
  "keywords": [
    "scraper",
    "web",
    "blog",
    "rss",
    "content",
    "llm",
    "articles"
  ],
  "commands": "./commands",
  "skills": "./skills"
}

For maintainers

If you maintain this plugin, link to this source-backed listing from your README so users can review its manifest and indexed components.

[web-scraper on Agent Plugins Marketplace](https://pluginsmp.com/plugins/web-scraper)