plugin-eval
v0.1.2Three-layer quality evaluation framework for agent plugins and skills (Agent Skills / Agent Plugins 1.0) with Elo ranking
By Owen AyresLicense: MIT0 GitHub starsUpdated 2 weeks ago
Directory evidence
- Runtimes
- Codex, Claude Code, and Agent Plugins
- Parsed components
- 1 skill or MCP entry
- Source updated
- Sep 8, 2026
- Manifest status
- Canonical path parsed
The directory validates manifest shape and source location. It does not execute the plugin or provide a security endorsement. Review the indexing methodology →
Install plugin-eval for Codex and Claude Code
claude plugin marketplace add IchenDEV/agent-plugin-mkt
claude plugin marketplace update agent-plugin-marketplace
claude plugin install plugin-eval-3@agent-plugin-marketplacePaste and run these commands in a terminal with Claude Code. They add and refresh the PluginsMP catalog, then install this plugin.
Compatibility: the page URL and API slug “plugin-eval-3” remain stable.
- Codex: Legacy selector
plugin-eval-3@agent-plugin-marketplaceremains documented for migration; install from source for this runtime.
The installer fetches third-party code from the source repository shown on this page. This directory validates manifest structure and source location, but does not perform a security audit; review the manifest, components, and source before installing.
Codex has another source with the same manifest name. This directory does not invent numbered install aliases; use the publisher's catalog or inspect the source manually for that runtime.
Get the source manually
git clone https://github.com/oayres/agent-pluginsClone the source repository, then follow its setup instructions to add the plugin to a compatible client. The plugin root is plugins/plugin-eval/.
Plugin files
├── .codex-plugin/plugin.json├── .claude-plugin/plugin.json├── plugin.json└── skills/evaluation-methodology/SKILL.md
Included Skills1
PluginEval quality methodology — dimensions, rubrics, statistical methods, and scoring formulas. Use this skill when understanding how plugin quality is measured, when interpreting a low score on a specific dimension, when deciding how to improve a skill's triggering accuracy or orchestration fitness, when calibrating scoring thresholds for your marketplace, or when explaining quality badges to stakeholders or partners.
Plugin manifests3
{
"name": "plugin-eval",
"version": "0.1.2",
"description": "Three-layer quality evaluation framework for agent plugins and skills (Agent Skills / Agent Plugins 1.0) with Elo ranking",
"skills": "./skills/",
"interface": {
"displayName": "Plugin Eval",
"shortDescription": "Three-layer quality evaluation framework for agent plugins and skills (Agent Skills / Agent Plugins 1.0) with Elo ranking",
"category": "Coding"
}
}{
"name": "plugin-eval",
"version": "0.1.2",
"description": "Three-layer quality evaluation framework for agent plugins and skills (Agent Skills / Agent Plugins 1.0) with Elo ranking"
}{
"$schema": "https://agent-plugins.org/schemas/1.0.0/plugin.schema.json",
"name": "plugin-eval",
"version": "0.1.2",
"description": "Three-layer quality evaluation framework for agent plugins and skills (Agent Skills / Agent Plugins 1.0) with Elo ranking",
"author": {
"name": "Owen Ayres",
"url": "https://github.com/oayres"
},
"homepage": "https://github.com/oayres/agent-plugins/tree/main/plugins/plugin-eval",
"repository": "https://github.com/oayres/agent-plugins",
"license": "MIT",
"keywords": [
"evaluation",
"quality",
"skills",
"agent-skills",
"agent-plugins",
"linting",
"elo"
]
}For maintainers
If you maintain this plugin, link to this source-backed listing from your README so users can review its manifest and indexed components.
[plugin-eval on Agent Plugins Marketplace](https://pluginsmp.com/plugins/plugin-eval-3)