data-engineering

v1.3.2

ETL pipeline construction, data warehouse design, batch processing workflows, and data-driven feature development

CodexClaude Code4 skills

by Seth HobsonMIT38.6kupdated 4 days ago

Source

$ git clone https://github.com/wshobson/agents

Clone the source, then follow the repository's marketplace instructions for your runtime. The plugin root is plugins/data-engineering/ inside the repository.

Layout

plugins/data-engineering/

├── .codex-plugin/plugin.json
├── .claude-plugin/plugin.json
├── skills/airflow-dag-patterns/SKILL.md
├── skills/data-quality-frameworks/SKILL.md
├── skills/dbt-transformation-patterns/SKILL.md
└── skills/spark-optimization/SKILL.md

Skills4

airflow-dag-patternsskills/airflow-dag-patterns/SKILL.md

Build production Apache Airflow DAGs with best practices for operators, sensors, testing, and deployment. Use when creating data pipelines, orchestrating workflows, or scheduling batch jobs.

data-quality-frameworksskills/data-quality-frameworks/SKILL.md

Implement data quality validation with Great Expectations, dbt tests, and data contracts. Use when building data quality pipelines, implementing validation rules, or establishing data contracts.

dbt-transformation-patternsskills/dbt-transformation-patterns/SKILL.md

Master dbt (data build tool) for analytics engineering with model organization, testing, documentation, and incremental strategies. Use when building data transformations, creating data models, or implementing analytics engineering best practices.

spark-optimizationskills/spark-optimization/SKILL.md

Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.

Manifests2

plugins/data-engineering/.codex-plugin/plugin.json

{
  "name": "data-engineering",
  "version": "1.3.2",
  "description": "ETL pipeline construction, data warehouse design, batch processing workflows, and data-driven feature development",
  "skills": "./skills/",
  "author": {
    "name": "Seth Hobson",
    "email": "seth@major7apps.com"
  },
  "license": "MIT",
  "interface": {
    "displayName": "Data Engineering",
    "shortDescription": "ETL pipeline construction, data warehouse design, batch processing workflows, and data-driven feature development",
    "category": "Coding"
  }
}

plugins/data-engineering/.claude-plugin/plugin.json

{
  "name": "data-engineering",
  "version": "1.3.2",
  "description": "ETL pipeline construction, data warehouse design, batch processing workflows, and data-driven feature development",
  "author": {
    "name": "Seth Hobson",
    "email": "seth@major7apps.com"
  },
  "license": "MIT"
}