self-improvement-ci
CI-only self-improvement workflow using gh-aw (GitHub Agentic Workflows). Captures recurring failure patterns and quality signals from pull request checks, emits structured learning candidates, and proposes durable prevention rules without interactive prompts. Use when: you want
Install
npx skills add https://github.com/pskoett/pskoett-ai-skills/tree/main/skills/self-improvement-ci
claude plugin marketplace add https://llmmart.ai/marketplace.json && claude plugin install pskoett-pskoett-ai-skills@llmmart
git clone https://github.com/pskoett/pskoett-ai-skills.git
The skills CLI installs just this skill, for any of its supported agents. Claude Code installs the whole pskoett/pskoett-ai-skills collection as a plugin from our marketplace. Git is the plain clone.
Skill manifest
Self-Improvement CI
Install
gh skill install pskoett/pskoett-skills self-improvement-ci
Fallback using the Agent Skills CLI:
npx skills add pskoett/pskoett-skills/skills/self-improvement-ci
Purpose
Run self-improvement in CI without interactive chat loops:
- Inspect PR check results and CI failures
- Ingest learning candidates from
simplify-and-harden-ci - Ingest
Handoffblocks from.learnings/HEALS.md(filed byself-healing/self-healing-ci) and surface them as promotion candidates - Deduplicate recurring patterns by stable
pattern_key - Emit promotion-ready suggestions for agent context/system prompts
This skill is read-only with respect to the repository (see CI Contract): it does not write .learnings/ entries. Its candidates are emitted as machine-readable output, and promotions are proposed as a PR or comment for human review.
Use self-improvement for interactive/local sessions.
Context Limitation (Important)
CI agents do not have peak task context from the original implementation session. Use this skill to aggregate recurring patterns across runs, not to infer nuanced one-off intent.
Implications:
- Favor stable
pattern_keyrecurrence signals over single-run conclusions - Require recurrence thresholds before promotion
- Route uncertain or high-impact recommendations to interactive review
Prerequisites
- GitHub Actions enabled for the repository
- GitHub CLI authenticated (
gh auth status) gh-awinstalled for authoring/validation:
gh extension install github/gh-aw
CI Contract
The CI skill must:
- Read only PR-scoped data (checks, workflow outcomes, existing learning entries)
- Avoid direct code modifications in CI
- Emit machine-readable learning output
- Recommend promotion only when recurrence thresholds are met
Output Schema
self_improvement_ci:
source:
pr_number: 123
commit_sha: "abc123"
candidates:
- pattern_key: "harden.input_validation"
source: "simplify-and-harden-ci"
recurrence_count: 3
first_seen: "2026-02-01"
last_seen: "2026-02-20"
severity: "high"
suggested_rule: "Validate and bound-check external inputs before use."
promotion_ready: true
summary:
candidates_total: 4
promotion_ready_total: 1
followup_required: true
Recurrence and Promotion Rules
- Track recurrence by
pattern_key - Default threshold for promotion:
recurrence_count >= 3- seen in
>= 2distinct tasks/runs - within a 30-day window
- Promotion targets:
CLAUDE.mdAGENTS.md.github/copilot-instructions.mdSOUL.md/TOOLS.mdwhen using openclaw workspace memory
Authoring Workflow (gh-aw)
Example-only templates live in references/workflow-example.md.
Keep examples outside .github/workflows until you explicitly decide to enable CI automation.
When ready:
- Copy the template into
.github/workflows/self-improvement-ci.md - Customize tool access, outputs, and policy thresholds
- Validate:
gh aw compile --validate --strict
- Trigger test run manually:
gh aw run self-improvement-ci --push
Heal Handoff Intake
self-healing-ci appends Handoff blocks to .learnings/HEALS.md entries that meet the promotion rule. On each run:
- Read
.learnings/HEALS.md(read-only) and collect entries with aHandoffblock - Map each to a candidate:
pattern_keyfrom the HEAL'sPattern-Key,suggested_rulefrom theDistilled Rule, recurrence fields from the entry metadata - Mark
promotion_ready: truewhen the promotion rule holds, and include the candidate in the output schema alongsidesimplify-and-harden-cicandidates - Propose the promotion (target file + rule text) as a PR or comment — never write instruction files directly from CI
Integration with Other Skills
- Pair with
simplify-and-harden-cito ingestsimplify_and_harden.learning_loop.candidates - Pair with
self-healing-ci, whose HEALS.mdHandoffblocks this skill consumes (see Heal Handoff Intake) - Feed promoted patterns back into
self-improvementmemory workflow for durable prevention rules
Files (pskoett-ai-skills)
-
references
-
workflow-example.md 1 KB
Loading…
-
-
SKILL.md 4.5 KB
--- name: self-improvement-ci description: "CI-only self-improvement workflow using gh-aw (GitHub Agentic Workflows). Captures recurring failure patterns and quality signals from pull request checks, emits structured learning candidates, and proposes durable prevention rules without interactive prompts. Use when: you want automated learning capture in CI/headless pipelines." --- # Self-Improvement CI ## Install ```bash gh skill install pskoett/pskoett-skills self-improvement-ci ``` Fallback using the Agent Skills CLI: ```bash npx skills add pskoett/pskoett-skills/skills/self-improvement-ci ``` ## Purpose Run self-improvement in CI without interactive chat loops: - Inspect PR check results and CI failures - Ingest learning candidates from `simplify-and-harden-ci` - Ingest `Handoff` blocks from `.learnings/HEALS.md` (filed by `self-healing` / `self-healing-ci`) and surface them as promotion candidates - Deduplicate recurring patterns by stable `pattern_key` - Emit promotion-ready suggestions for agent context/system prompts This skill is read-only with respect to the repository (see CI Contract): it does not write `.learnings/` entries. Its candidates are emitted as machine-readable output, and promotions are proposed as a PR or comment for human review. Use `self-improvement` for interactive/local sessions. ## Context Limitation (Important) CI agents do **not** have peak task context from the original implementation session. Use this skill to aggregate recurring patterns across runs, not to infer nuanced one-off intent. Implications: - Favor stable `pattern_key` recurrence signals over single-run conclusions - Require recurrence thresholds before promotion - Route uncertain or high-impact recommendations to interactive review ## Prerequisites 1. GitHub Actions enabled for the repository 2. GitHub CLI authenticated (`gh auth status`) 3. `gh-aw` installed for authoring/validation: ```bash gh extension install github/gh-aw ``` ## CI Contract The CI skill must: 1. Read only PR-scoped data (checks, workflow outcomes, existing learning entries) 2. Avoid direct code modifications in CI 3. Emit machine-readable learning output 4. Recommend promotion only when recurrence thresholds are met ## Output Schema ```yaml self_improvement_ci: source: pr_number: 123 commit_sha: "abc123" candidates: - pattern_key: "harden.input_validation" source: "simplify-and-harden-ci" recurrence_count: 3 first_seen: "2026-02-01" last_seen: "2026-02-20" severity: "high" suggested_rule: "Validate and bound-check external inputs before use." promotion_ready: true summary: candidates_total: 4 promotion_ready_total: 1 followup_required: true ``` ## Recurrence and Promotion Rules - Track recurrence by `pattern_key` - Default threshold for promotion: - `recurrence_count >= 3` - seen in `>= 2` distinct tasks/runs - within a 30-day window - Promotion targets: - `CLAUDE.md` - `AGENTS.md` - `.github/copilot-instructions.md` - `SOUL.md` / `TOOLS.md` when using openclaw workspace memory ## Authoring Workflow (gh-aw) Example-only templates live in `references/workflow-example.md`. Keep examples outside `.github/workflows` until you explicitly decide to enable CI automation. When ready: 1. Copy the template into `.github/workflows/self-improvement-ci.md` 2. Customize tool access, outputs, and policy thresholds 3. Validate: ```bash gh aw compile --validate --strict ``` 4. Trigger test run manually: ```bash gh aw run self-improvement-ci --push ``` ## Heal Handoff Intake `self-healing-ci` appends `Handoff` blocks to `.learnings/HEALS.md` entries that meet the promotion rule. On each run: 1. Read `.learnings/HEALS.md` (read-only) and collect entries with a `Handoff` block 2. Map each to a candidate: `pattern_key` from the HEAL's `Pattern-Key`, `suggested_rule` from the `Distilled Rule`, recurrence fields from the entry metadata 3. Mark `promotion_ready: true` when the promotion rule holds, and include the candidate in the output schema alongside `simplify-and-harden-ci` candidates 4. Propose the promotion (target file + rule text) as a PR or comment — never write instruction files directly from CI ## Integration with Other Skills - Pair with `simplify-and-harden-ci` to ingest `simplify_and_harden.learning_loop.candidates` - Pair with `self-healing-ci`, whose HEALS.md `Handoff` blocks this skill consumes (see Heal Handoff Intake) - Feed promoted patterns back into `self-improvement` memory workflow for durable prevention rules
Comments (0)
Sign in to join the conversation.
Reviews (0)
No reviews yet.
No comments yet.