Agent Plugins Marketplace
← All plugins

benchkit

v0.1.11

External-benchmark (SWE-bench Verified) runner for Claude Code plugins: a typed SWE-bench Instance model, a deterministic fixture-based JSONL loader, and a gated `download` subcommand that shells out to `curl` (no HTTP crate) to fetch the Princeton NLP dataset only on explicit invocation. Subscription-native (one bundled Rust binary).

Claude Code

By yukineko0 GitHub starsUpdated yesterday

Directory evidence

Runtimes
Claude Code
Parsed components
0 skill or MCP entries
Source updated
Sep 23, 2026
Manifest status
Canonical path parsed

The directory validates manifest shape and source location. It does not execute the plugin or provide a security endorsement. Review the indexing methodology →

Install benchkit for Claude Code

Installs for the current user
claude plugin marketplace add IchenDEV/agent-plugin-mkt
claude plugin marketplace update agent-plugin-marketplace
claude plugin install benchkit@agent-plugin-marketplace

Paste and run these commands in a terminal with Claude Code. They add and refresh the PluginsMP catalog, then install this plugin.

The installer fetches third-party code from the source repository shown on this page. This directory validates manifest structure and source location, but does not perform a security audit; review the manifest, components, and source before installing.

Get the source manually
git clone https://github.com/yukineko/claude-harnesses

Clone the source repository, then follow its setup instructions to add the plugin to a compatible client. The plugin root is crates/benchkit/.

Plugin files

crates/benchkit/
└── .claude-plugin/plugin.json

Plugin manifests1

crates/benchkit/.claude-plugin/plugin.json
{
  "name": "benchkit",
  "version": "0.1.11",
  "description": "External-benchmark (SWE-bench Verified) runner for Claude Code plugins: a typed SWE-bench Instance model, a deterministic fixture-based JSONL loader, and a gated `download` subcommand that shells out to `curl` (no HTTP crate) to fetch the Princeton NLP dataset only on explicit invocation. Subscription-native (one bundled Rust binary).",
  "author": {
    "name": "yukineko"
  },
  "keywords": [
    "benchmark",
    "swe-bench",
    "eval",
    "harness",
    "llmops",
    "rust"
  ]
}

For maintainers

If you maintain this plugin, link to this source-backed listing from your README so users can review its manifest and indexed components.

[benchkit on Agent Plugins Marketplace](https://pluginsmp.com/plugins/benchkit)