Agent Plugins Marketplace
← All plugins

aasb-aas-ai-product-evaluation-ops

v19.6.0

Install the "AAS AI Product & Evaluation Ops" workflow plugin from Agentic Awesome Skills.

CodexClaude CodeAgent Plugins13 Skills

By sickn33 and contributorsLicense: MIT47.5k GitHub starsUpdated last week

Directory evidence

Runtimes
Codex, Claude Code, and Agent Plugins
Parsed components
13 skill or MCP entries
Source updated
Oct 13, 2026
Manifest status
Canonical path parsed

The directory validates manifest shape and source location. It does not execute the plugin or provide a security endorsement. Review the indexing methodology →

Install aasb-aas-ai-product-evaluation-ops for Codex and Claude Code

Installs for the current user
codex plugin marketplace add sickn33/agentic-awesome-skills
codex plugin marketplace upgrade agentic-awesome-skills
codex plugin add aasb-aas-ai-product-evaluation-ops@agentic-awesome-skills

Paste and run these commands in a terminal with Codex. They add and refresh the agentic-awesome-skills catalog, then install this plugin.

Compatibility: the page URL and API slug “aasb-aas-ai-product-evaluation-ops” remain stable.

  • Codex: aasb-aas-ai-product-evaluation-ops@agent-plugin-marketplace → aasb-aas-ai-product-evaluation-ops@agentic-awesome-skills

The installer fetches third-party code from the source repository shown on this page. This directory validates manifest structure and source location, but does not perform a security audit; review the manifest, components, and source before installing.

Get the source manually
git clone https://github.com/sickn33/agentic-awesome-skills

Clone the source repository, then follow its setup instructions to add the plugin to a compatible client. The plugin root is plugins/agentic-bundle-aas-ai-product-evaluation-ops/.

Plugin files

plugins/agentic-bundle-aas-ai-product-evaluation-ops/
├── .codex-plugin/plugin.json
├── .claude-plugin/plugin.json
├── plugin.json
├── skills/ab-test-setup/SKILL.md
├── skills/advanced-evaluation/SKILL.md
├── skills/agent-evaluation/SKILL.md
├── skills/agent-evaluation-reporting/SKILL.md
├── skills/ai-wrapper-product/SKILL.md
├── skills/analytics-product/SKILL.md
├── skills/context-window-management/SKILL.md
├── skills/hugging-face-evaluation/SKILL.md
├── skills/kpi-dashboard-design/SKILL.md
├── skills/langfuse/SKILL.md
├── skills/llm-app-patterns/SKILL.md
├── skills/product-manager/SKILL.md
└── skills/skill-security-audit/SKILL.md

Included Skills13

ab-test-setupskills/ab-test-setup/SKILL.md

Use when designing an A/B or split test: define the hypothesis, control and variants, estimate sample size, verify tracking, and predeclare metrics and stopping rules.

advanced-evaluationskills/advanced-evaluation/SKILL.md

Design LLM-as-judge rubrics, direct scores and pairwise comparisons. Use for judge models, evals, position bias and calibration against human labels.

agent-evaluationskills/agent-evaluation/SKILL.md

Evaluate agent behavior with versioned cases and explicit verifiers. Use when comparing agent or prompt changes, reproducing failures, or running agent regression tests.

agent-evaluation-reportingskills/agent-evaluation-reporting/SKILL.md

Use when summarizing agent evaluations where autonomous, assisted, failed, timed-out, or invalid outcomes must remain distinct and comparable.

ai-wrapper-productskills/ai-wrapper-product/SKILL.md

Expert in building products that wrap AI APIs (OpenAI, Anthropic, etc. ) into focused tools people will pay for. Not just "ChatGPT but different" - products that solve specific problems with AI.

analytics-productskills/analytics-product/SKILL.md

Analytics de produto — PostHog, Mixpanel, eventos, funnels, cohorts, retencao, north star metric, OKRs e dashboards de produto.

context-window-managementskills/context-window-management/SKILL.md

Strategies for managing LLM context windows including summarization, trimming, routing, and avoiding context rot

hugging-face-evaluationskills/hugging-face-evaluation/SKILL.md

Add and manage evaluation results in Hugging Face model cards. Supports extracting eval tables from README content, importing scores from Artificial Analysis API, and running custom model evaluations with vLLM/lighteval. Works with the model-index metadata format.

kpi-dashboard-designskills/kpi-dashboard-design/SKILL.md

Comprehensive patterns for designing effective Key Performance Indicator (KPI) dashboards that drive business decisions.

langfuseskills/langfuse/SKILL.md

Expert in Langfuse - the open-source LLM observability platform. Covers tracing, prompt management, evaluation, datasets, and integration with LangChain, LlamaIndex, and OpenAI. Essential for debugging, monitoring, and improving LLM applications in production.

llm-app-patternsskills/llm-app-patterns/SKILL.md

Architecture and integration sketches for LLM applications, with explicit retrieval, tool, privacy and verification boundaries.

product-managerskills/product-manager/SKILL.md

Senior PM agent with 6 knowledge domains, 30+ frameworks, 12 templates, and 32 SaaS metrics with formulas. Pure Markdown, zero scripts.

skill-security-auditskills/skill-security-audit/SKILL.md

Audit an Agent Skill, MCP server, connector, or desktop extension before installation by tracing code, dependencies, permissions, credentials, data flow, and irreversible actions.

Plugin manifests3

plugins/agentic-bundle-aas-ai-product-evaluation-ops/.codex-plugin/plugin.json
{
  "name": "aasb-aas-ai-product-evaluation-ops",
  "version": "19.6.0",
  "description": "Install the \"AAS AI Product & Evaluation Ops\" workflow plugin from Agentic Awesome Skills.",
  "author": {
    "name": "sickn33 and contributors",
    "url": "https://github.com/sickn33/agentic-awesome-skills"
  },
  "homepage": "https://github.com/sickn33/agentic-awesome-skills",
  "repository": "https://github.com/sickn33/agentic-awesome-skills",
  "license": "MIT",
  "keywords": [
    "codex",
    "skills",
    "bundle",
    "aas-ai-product-evaluation-ops",
    "productivity"
  ],
  "skills": "./skills/",
  "interface": {
    "displayName": "AAS AI Product & Evaluation Ops",
    "shortDescription": "Define, evaluate, instrument, and improve AI product features with metrics, tracing, experiments, and model evals.",
    "longDescription": "Define, evaluate, instrument, and improve AI product features with metrics, tracing, experiments, and model evals. Define AI feature success criteria, inspect instruction trust boundaries, calibrate judge rubrics and produce an evidence-based error report. Recommended for: AI PMs, Founders building AI features, LLM product teams. Not for: MCP server or agent implementation as the main task: use Agent & MCP Builder, Evaluation scores without a named dataset, procedure and observed run. Covers AI Wrapper Product, Agent Evaluation, and 11 more skills.",
    "developerName": "sickn33 and contributors",
    "category": "Specialized Product Plugins",
    "capabilities": [
      "Interactive",
      "Write"
    ],
    "websiteURL": "https://aaskills.tech/",
    "privacyPolicyURL": "https://github.com/sickn33/agentic-awesome-skills/blob/main/PRIVACY.md",
    "termsOfServiceURL": "https://github.com/sickn33/agentic-awesome-skills/blob/main/TERMS.md",
    "brandColor": "#111827",
    "defaultPrompt": [
      "Review this AI feature and its intended users. Define success and failure criteria, representative examples, an evaluation rubric and a process for investigating errors. Use only available observations for conclusions and distinguish a proposed evaluation from one actually run.",
      "Use this plugin to review this AI feature for product risk, context limits, eval coverage, and KPI gaps.",
      "Use this plugin to design a dashboard and feedback loop for improving this LLM workflow.",
      "Review this project for the added coverage: Design judge rubrics, position swaps and human-calibrated evaluation; Inspect agent skill instructions and bundled files for unsafe authority or data flows; Report observed agent results, limitations and reproduction evidence. Use only the relevant skills and existing stack. Report observed checks and limitations; prepare drafts before external or production actions."
    ]
  }
}
plugins/agentic-bundle-aas-ai-product-evaluation-ops/.claude-plugin/plugin.json
{
  "name": "agentic-bundle-aas-ai-product-evaluation-ops",
  "version": "19.6.0",
  "description": "Editorial \"AAS AI Product & Evaluation Ops\" bundle for Claude Code from Agentic Awesome Skills.",
  "author": {
    "name": "sickn33 and contributors",
    "url": "https://github.com/sickn33/agentic-awesome-skills"
  },
  "homepage": "https://github.com/sickn33/agentic-awesome-skills",
  "repository": "https://github.com/sickn33/agentic-awesome-skills",
  "license": "MIT",
  "keywords": [
    "claude-code",
    "skills",
    "bundle",
    "aas-ai-product-evaluation-ops",
    "agentic-awesome-skills"
  ]
}
plugins/agentic-bundle-aas-ai-product-evaluation-ops/plugin.json
{
  "$schema": "https://agent-plugins.org/schemas/1.0.0/plugin.schema.json",
  "name": "agentic-bundle-aas-ai-product-evaluation-ops",
  "version": "19.6.0",
  "description": "Portable skills-only \"AAS AI Product & Evaluation Ops\" plugin from Agentic Awesome Skills.",
  "author": {
    "name": "sickn33 and contributors",
    "url": "https://github.com/sickn33/agentic-awesome-skills"
  },
  "homepage": "https://github.com/sickn33/agentic-awesome-skills",
  "repository": "https://github.com/sickn33/agentic-awesome-skills",
  "license": "MIT",
  "keywords": [
    "agent-plugins",
    "agent-skills",
    "bundle",
    "aas-ai-product-evaluation-ops",
    "agentic-awesome-skills"
  ]
}

For maintainers

If you maintain this plugin, link to this source-backed listing from your README so users can review its manifest and indexed components.

[aasb-aas-ai-product-evaluation-ops on Agent Plugins Marketplace](https://pluginsmp.com/plugins/aasb-aas-ai-product-evaluation-ops)