production-excellence
Build cross-domain production evidence from readiness, migration, recovery, capacity/cost, and incident learning into launch or operational decisions. Do not use this skill for a single specialist's risk packet and launch gate; use `production-readiness` for that readiness review
Install
npx skills add https://github.com/magnus919/agent-skills/tree/main/production-excellence
claude plugin marketplace add https://llmmart.ai/marketplace.json && claude plugin install magnus919-agent-skills@llmmart
git clone https://github.com/magnus919/agent-skills.git
The skills CLI installs just this skill, for any of its supported agents. Claude Code installs the whole magnus919/agent-skills collection as a plugin from our marketplace. Git is the plain clone.
README
Production Excellence
Assemble cross-domain production evidence into a defensible launch or operational decision — go, no-go, defer, exception, or escalation — with an accountable owner and a post-launch learning path.
Why Install This Skill
When a service or change is heading to production, evidence is scattered across multiple domains: a readiness review in one place, a migration plan in another, recovery-exercise results somewhere else, a capacity model in a spreadsheet, and incident history in yet another tool. Without a single acceptance layer, teams either launch with invisible gaps or drown in coordination overhead. Production Excellence gives your agent that layer — a thin, structured gate model that reads evidence from every specialist domain and produces one of five clear, defensible outcomes with an accountable owner attached.
After installing, your agent can run a production gate review for any change — from a low-risk docs update to a high-risk customer-facing launch with migration, recovery, and cost/SLO tradeoffs. The bundle composes the specialist catalog (production-readiness, migration-engineering, resilience-and-recovery, capacity-and-cost-engineering, incident-learning, plus SRE, release, platform, security, data, and QA) without copying a single runbook. Post-launch, it routes outcomes into incident-learning and product-lifecycle-learning so production evidence flows back into decisions instead of being forgotten.
What You Get
| Path | What it provides |
|---|---|
SKILL.md |
Thin umbrella entry point: readiness routing table for 5 production-domain routes and 7 supporting specialists, cross-domain entry evidence requirements, gate/exception model (go/no-go/defer/exception/escalation), operational handoff, and post-launch learning paths |
AGENTS.md |
Agent-specific loading notes: nested-skill behavior, harness compatibility, and progressive-disclosure guidance |
README.md |
This human-facing overview |
references/discovery-brief.md |
Bounded discovery brief comparing the bundle against 13 existing production and release skills (SRE, release, platform, security, data, QA, plus the 5 milestone production skills and verification/lifecycle-learning) |
references/evidence-packet.md |
Production evidence packet specification: entry-evidence requirements for readiness, migration, recovery, capacity/cost, and incident-learning domains — usable for both new services and changes to existing systems |
references/gates.md |
Full gate and exception model: go, no-go, defer, exception, and escalation outcomes, each with conditions, evidence requirements, risk-class applicability, and post-gate handoff rules |
references/handoff-record.md |
Operational handoff record template: service identification, gate outcome, evidence summary, gap register, post-launch learning paths (incident-learning and product-lifecycle-learning), and sign-off fields |
evals/evals.json |
Five integrated evaluation cases covering normal release, untested rollback, data migration, dependency outage, and cost/SLO conflict |
manifest.yaml |
Machine-readable bundle manifest (schema v1): purpose, audience, stages, included skills, prerequisites, outputs, handoffs, conflicts, and eval suite |
Quick Start
- Identify the service or change and its risk class (Low / Standard / High per production-readiness).
- Gather entry evidence from each applicable domain using the evidence packet (
references/evidence-packet.md). Every domain needs a named source or an explicit gap with an owner and due date. - Run the gate model (
references/gates.md): evaluate the evidence against the five outcomes. Record the outcome with the accountable owner. - Populate the operational handoff record (
references/handoff-record.md) — even for non-Go outcomes. - Route post-launch observations to incident-learning and product-lifecycle-learning per the handoff record's learning path.
Triggers
- "Is this ready for production?"
- "Run a production gate review"
- "Assemble the production evidence packet"
- "We need a go/no-go decision for this launch"
- "Coordinate the production readiness review across teams"
- "What evidence is missing before we can launch?"
- "We have a migration, a recovery exercise, and a capacity model — are we clear to go?"
- "Route this launch outcome into our incident-learning process"
- A cross-team launch needs a single acceptance contract before proceeding
- A cost/SLO conflict needs a structured decision with accountable owners
Requirements
- No runtime dependencies, API keys, or external services.
- The bundle routes to 12 specialist skills for detailed domain work; those skills must be present in the catalog for full routing capability (production-readiness, migration-engineering, resilience-and-recovery, capacity-and-cost-engineering, incident-learning, site-reliability-engineering, release-engineering, platform-engineering, secure-software-engineering, data-engineering, qa-methodology, verification-methodology — all currently exist in the repository).
Skill manifest
Production Excellence
A thin composition bundle that assembles cross-domain production evidence into a defensible launch or operational decision. It owns the acceptance and handoff layer — the gate model that reads evidence from specialist skills and produces go / no-go / defer / exception / escalation outcomes with accountable owners. It does not own any specialist's runbook.
When to load this
Load when:
- A service or change is approaching a launch decision and evidence from multiple production domains must be assembled.
- You need a structured gate model (go/no-go/defer/exception/escalation) with conditions, evidence, and accountable owners.
- Cross-domain evidence (readiness, migration, recovery, capacity/cost, incident history) must be combined into one operational handoff record.
- A launch or change needs a post-launch learning path routed to incident-learning and product-lifecycle-learning.
- You are coordinating a production change across SRE, release, platform, security, data, and QA specialists and need a single acceptance contract.
When not to use
Do not load this bundle for:
- Incident command or SLO operations — those are owned by site-reliability-engineering.
- Release-pipeline mechanics, versioning, or deployment strategies — those are owned by release-engineering.
- Platform architecture or internal-developer-platform design — those are owned by platform-engineering.
- Threat modeling, security review procedure, or vulnerability assessment — those are owned by secure-software-engineering.
- Data-pipeline design, ETL, or storage architecture — those are owned by data-engineering.
- Test-strategy design, regression-suite management, or test-automation framework design — those are owned by qa-methodology.
- A generic checklist detached from service ownership, risk, evidence, and verification — every gate in this bundle requires a named service owner, assessed risk, verified evidence, and a declaration of the verification boundary. A bare checklist is never a valid outcome.
This bundle composes specialists. It never replaces them and never re-derives their methods. If the task is wholly within one specialist's domain, load that specialist directly.
Readiness routing table
The bundle routes each production concern to the specialist that owns it. The bundle itself owns only the acceptance and handoff layer — the cross-domain assembly and the gate decision.
Primary production-domain routes
| Domain | Specialist skill | What the specialist owns | What the bundle adds |
|---|---|---|---|
| Production readiness | production-readiness | Risk-scaled evidence packet (11 categories), go/no-go/defer/exception launch decisions, accountable owners | Cross-domain assembly with migration, recovery, capacity/cost, and incident evidence; gate integration |
| Migration | migration-engineering | Expand/contract, compatibility windows, dual-running, backfills, reconciliation, cutover, recovery paths | Migration evidence as input to the gate model; handoff of migration verification to the operational record |
| Resilience and recovery | resilience-and-recovery | Failure modes, degradation choices, RTO/RPO, restore testing, DR, game days, failover, data integrity | Recovery evidence as a gate condition; exercise results feed the handoff record |
| Capacity and cost | capacity-and-cost-engineering | Demand/capacity/scaling/utilization models, unit-cost connection to SLO decisions, cost-constrained scenarios | Capacity/cost evidence as a gate condition; SLO/cost tradeoff decisions feed the gate model |
| Incident learning | incident-learning | Observed facts, causal hypotheses, contributing conditions, follow-up work mapping, verified closure | Pre-existing incident evidence as a gate condition; post-launch incidents routed back to incident-learning |
Supporting specialist routes
| Domain | Specialist skill | When routed |
|---|---|---|
| Reliability / SLOs | site-reliability-engineering | SLO/error-budget status required for gate entry; incident response for post-launch issues |
| Release mechanics | release-engineering | Release plan, rollout/rollback strategy required for gate entry |
| Platform | platform-engineering | Service-catalog entry, paved-road status for new services |
| Security | secure-software-engineering | Security review evidence for trust-boundary changes |
| Data | data-engineering | Data-quality and pipeline evidence for data-path changes |
| QA | qa-methodology | Verification evidence for all launches |
| Verification | verification-methodology | Boundary labeling and gap declaration for evidence assessment |
Cross-domain entry evidence
Before the gate model runs, entry evidence must exist from every applicable domain. The bundle does not gather this evidence — it requires it. The complete evidence packet specification is in references/evidence-packet.md.
Summary:
- Every evidence domain (readiness, migration, recovery, capacity/cost, incident-learning) has a named source or an explicit gap with an owner and due date.
- The packet is usable for both new services and changes to existing systems — domains irrelevant to the change are explicitly marked "not applicable" with a reason.
- Missing evidence is never silently omitted. Every gap is recorded.
Gate and exception model
The gate model produces exactly one of five outcomes for every production change. Full definitions, conditions, and evidence requirements are in references/gates.md.
| Outcome | Meaning | Key condition |
|---|---|---|
| Go | Authorized to proceed to production | All required evidence domains are sourced; no blocking gaps |
| No-go | Blocked; must not proceed | A required domain has a blocking gap, or an irreversible step has no verified recovery path |
| Defer | Postponed with explicit conditions | A non-blocking gap or dependency has a committed resolution date; re-evaluation is scheduled |
| Exception | Proceeds under an explicit waiver | A human authority (not the agent, not the service owner alone) approves a time-bounded, risk-bounded exception |
| Escalation | Decision escalated to a higher body | Irreconcilable gate conflict, trust-boundary security gap, cross-team authority gap, or regulatory boundary |
Every outcome is anchored to service ownership, risk, evidence, and verification. No gate passes on a bare checklist. Each outcome names the accountable owner and records the evidence that supports it.
Operational handoff and post-launch learning
After a gate outcome is reached, the operational handoff record (references/handoff-record.md) is populated.
Post-launch learning paths
Launch outcomes and post-launch observations feed two learning routes:
Incident learning — post-launch incidents (SLO degradations, unexpected failures, capacity breaches) are routed to incident-learning. The handoff record provides the launch context; the incident-learning skill's verified-closure requirement ensures follow-up items are tracked to completion.
Lifecycle learning — expected outcomes recorded in the handoff (SLO targets, capacity assumptions, cost projections) are routed to product-lifecycle-learning for expected-vs-observed comparison at the handoff's review cadence. The lifecycle-learning skill's continue/improve/harvest/pivot/pause/retire decisions are informed by the gap between predicted and observed production behavior.
The handoff record is populated for every outcome — not only Go. No-go, Defer, Exception, and Escalation each produce a handoff record with the blocking condition, the follow-up path, and the accountable owner.
Loading and nested-skill behavior
This bundle is the discoverable entry point. It does not contain nested
sub-skills under a skills/ directory. All routed skills are top-level catalog
skills referenced via relative markdown links. Harnesses that support progressive
disclosure will discover this bundle through its SKILL.md frontmatter and load
the referenced specialists on trigger.
See AGENTS.md for agent-specific loading notes.
File map
| Path | Loaded when |
|---|---|
| references/discovery-brief.md | Understanding the bundle's boundary against existing production and release skills |
| references/evidence-packet.md | Assembling cross-domain evidence for a production decision |
| references/gates.md | Running the gate model — go/no-go/defer/exception/escalation |
| references/handoff-record.md | Producing the operational handoff record and post-launch learning path |
| manifest.yaml | Machine-readable composition contract (schema v1): purpose, audience, stages, included skills, prerequisites, outputs, handoffs, conflicts, and eval suite; consumed by the lifecycle capability matrix |
Files (agent-skills)
-
evals
-
evals.json 12.3 KB
{ "schema_version": 1, "skill_name": "production-excellence", "evals": [ { "id": "normal-release-safe-launch", "prompt": "We are launching a new user-facing API service to production. The readiness review is complete with all 11 evidence categories sourced: ownership is assigned to the API platform team, SLOs are defined (99.9% availability, p99 latency < 200ms), security review passed, rollback plan uses blue-green deployment, capacity model shows 3x headroom at launch, restore test passed yesterday, and QA verification confirms all acceptance criteria pass at the integration boundary. The risk class is Standard. Run the production-excellence gate model and produce the operational handoff record.", "expected_output": "The gate model produces a Go outcome. The operational handoff record includes the service name (API service), risk class (Standard), outcome (Go), the accountable service owner (API platform team lead), evidence summary for all domains (readiness, migration: none, resilience: restore test dated yesterday, capacity/cost: 3x headroom, incident learning: no prior incidents, security: passed, release: blue-green plan, QA: integration-boundary verification), no gaps, and post-launch learning paths routed to incident-learning and product-lifecycle-learning with a review cadence.", "assertions": [ "gate outcome is Go", "all evidence domains are sourced with named references", "no gaps exist in the evidence packet", "operational handoff record names the service owner", "post-launch learning paths reference incident-learning and product-lifecycle-learning", "risk class is Standard" ] }, { "id": "blocked-launch-untested-rollback", "prompt": "We are launching a database schema migration for our payment service — a High-risk change because it crosses a trust boundary and is irreversible without a verified rollback. The migration plan expands the schema with a new column, backfills data, and then drops the old column. The readiness review is otherwise complete (ownership, SLOs, security, QA all pass). However, the rollback procedure has never been tested — the team wrote a rollback script but has not run it against a production-like snapshot. The migration-engineering specialist confirms the step is irreversible without the tested rollback. Run the production-excellence gate model.", "expected_output": "The gate model produces a No-go outcome. The blocking reason is: the rollback procedure has never been tested and the migration step is irreversible without it. The evidence packet records the gap in the migration domain (no tested rollback). The handoff record records the No-go with the gap owner (the migration team lead), the gap description (untested rollback for irreversible schema migration), and the condition for re-evaluation (successful rollback rehearsal against a production-like snapshot). The risk class (High) prohibits exceptions — no exception is offered without escalation. Claims are scoped to the harness, model, fixtures, and revision under test.", "assertions": [ "gate outcome is No-go or blocked", "blocking reason explicitly references untested rollback", "evidence packet records the migration-domain gap", "gap owner is named", "no exception is granted for a High-risk irreversible migration without tested rollback", "the handoff record is populated even for the No-go outcome", "risk class High prevents exception without escalation" ] }, { "id": "data-migration-routes-to-migration-engineering", "prompt": "We are migrating 200M customer records from an on-premises PostgreSQL database to a cloud-hosted database. The migration-engineering specialist has produced a plan: dual-write for 30 days, backfill the historical data with checksum verification, run reconciliation queries daily, and cut over with a 5-minute maintenance window. A rollback path exists: keep the on-premises database in read-only mode for 14 days post-cutover. The readiness review is complete, capacity model shows the cloud instance can handle 2x peak load, and QA has verified reconciliation correctness. The risk class is High. Run the production-excellence gate model and produce the operational handoff record.", "expected_output": "The gate model produces a Go outcome because: the migration plan from migration-engineering includes dual-write, backfill, reconciliation, cutover, and a rollback path (14-day read-only window). The evidence packet references the migration-engineering artifacts explicitly. The handoff record captures the migration type (data migration), recovery path (rollback via 14-day read-only window), verification method (daily reconciliation queries + checksum), and cutover window (5 minutes). Post-launch learning routes to incident-learning for any reconciliation failures and to product-lifecycle-learning for expected-vs-observed data integrity comparison.", "assertions": [ "gate outcome is Go", "migration domain evidence references migration-engineering artifacts", "recovery path is explicit: 14-day read-only rollback window", "cutover window is specified", "reconciliation and checksum verification are cited", "handoff record routes post-launch to incident-learning and product-lifecycle-learning", "risk class is High but all evidence domains are sourced" ] }, { "id": "integrated-migration-reconciliation-failure", "prompt": "We are migrating 200M customer records from an on-premises PostgreSQL database to a cloud-hosted database, with a 30-day dual-write window and a 14-day read-only rollback path already planned by migration-engineering. Mid-migration, the daily reconciliation job detects a mismatch: 0.4% of migrated rows have an amount-column divergence between source and target (800,000 rows affected). The migration owner asks whether we can proceed with the planned cutover and fix the mismatches after launch, since the mismatch rate is 'small.' Run the production-excellence gate model and decide how the launch should proceed.", "expected_output": "The gate model produces a No-go outcome: the cutover must not proceed while reconciliation is failing. The reconciliation failure is recorded as evidence in the production evidence packet with the mismatch rate (0.4%), the affected population (800,000 rows), and the affected column (amount). The trajectory routes to migration-engineering's reconciliation-failure handling — it does not paper over the mismatch. The gate records a recovery decision (rollback to the dual-write state or roll-forward after the root cause is fixed and reconciliation re-passes) with an accountable owner named. Re-evaluation is conditioned on reconciliation passing for 100% of the population; no launch or successful production-readiness verdict is issued while the mismatch exists. The handoff record is populated for the No-go outcome: it captures the reconciliation failure, the recovery decision, the owner, and the re-evaluation condition, and it does NOT route to post-launch learning because no launch occurred. Claims are scoped to the harness, model, fixtures, and revision under test.", "assertions": [ "gate outcome is No-go or blocked — the launch does not proceed", "reconciliation failure evidence is recorded in the evidence packet with mismatch rate, affected population, and affected column", "the trajectory routes to migration-engineering reconciliation-failure handling rather than proceeding", "a rollback or roll-forward recovery decision is recorded with an accountable owner", "no launch or successful production-readiness verdict is issued while the mismatch exists", "re-evaluation is conditioned on reconciliation passing for the full population", "the handoff record is populated for the No-go outcome with the failure, decision, owner, and re-evaluation condition" ] }, { "id": "dependency-outage-routes-to-resilience", "prompt": "We are launching a mobile notification service that depends on an upstream push-notification provider. The resilience-and-recovery assessment reveals that the upstream provider had a 45-minute outage last month affecting 30% of notifications, and the provider's SLA is 99.5% (below our service's 99.9% SLO target). The resilience specialist recommends a circuit-breaker with a fallback queue and a degraded-mode UX that shows 'delayed delivery' instead of silent failure. However, the circuit-breaker has not been exercised in a game day — the team has the code but has not run a dependency-failure simulation. All other domains are sourced. The risk class is Standard. Run the production-excellence gate model.", "expected_output": "The gate model produces a Defer outcome (or No-go, depending on whether the untested circuit-breaker is considered a blocking gap for Standard risk). The resilience domain has a gap: the circuit-breaker has not been exercised. The evidence packet records this gap with the resilience owner and a due date for the game-day exercise. If Defer: the condition for re-evaluation is a successful dependency-failure simulation. If No-go: the blocking reason is that the upstream dependency's SLA (99.5%) conflicts with the service's SLO (99.9%) and the mitigation (circuit-breaker) has not been tested. In either case, the handoff record records the resilience gap explicitly and routes post-launch dependency monitoring to incident-learning.", "assertions": [ "gate outcome is Defer or No-go", "resilience domain gap is explicitly recorded: untested circuit-breaker or dependency-failure simulation", "upstream provider SLA vs service SLO conflict is cited", "degraded-mode UX is referenced as part of the resilience plan", "handoff record captures the gap with owner and resolution condition", "post-launch learning references incident-learning for dependency monitoring" ] }, { "id": "cost-slo-conflict", "prompt": "We are scaling our data-processing pipeline to handle 10x daily volume. The capacity-and-cost-engineering specialist has produced a model: at current unit cost, scaling to 10x would increase monthly infrastructure spend from $50K to $420K. The budget constraint is $300K/month. Two options exist: (A) scale to 8x within budget but relax the SLO from p99 < 500ms to p99 < 2s during peak hours, or (B) scale to 10x with a budget increase to $420K requiring VP approval. The SRE team confirms the SLO relaxation (option A) would still meet user expectations. The readiness review is otherwise complete, and the risk class is Standard. Run the production-excellence gate model to resolve this cost/SLO conflict.", "expected_output": "The gate model identifies a cost/SLO conflict and produces either: (1) Go with option A (scale to 8x, relaxed SLO) if the SRE and capacity evidence supports it, recording the tradeoff decision with the accountable owner; or (2) Exception if option B is chosen and VP approval is granted for the budget increase; or (3) Escalation if the choice between A and B cannot be resolved at the service-owner level. In any outcome, the decision is explicitly anchored to: service ownership (who owns the cost/SLO tradeoff), risk (the risk of relaxing the SLO vs the risk of budget overrun), evidence (the capacity model with explicit assumptions, the SRE SLO assessment), and verification (how the scaled system's latency will be verified post-launch). The handoff record captures the capacity/cost domain evidence, the SLO decision, and routes post-launch cost and latency monitoring to product-lifecycle-learning for expected-vs-observed comparison.", "assertions": [ "cost/SLO conflict is explicitly identified", "capacity-and-cost-engineering model is cited with unit cost and budget constraint", "at least two options are compared with tradeoffs", "the decision is anchored to service ownership, risk, evidence, and verification", "handoff record captures the capacity/cost evidence and the SLO decision", "post-launch learning routes to product-lifecycle-learning for expected-vs-observed comparison", "outcome is Go, Exception, or Escalation — not No-go without exploring the tradeoff" ] } ] }
-
-
references
-
discovery-brief.md 6.7 KB
# Production-Excellence Bundle — Bounded Discovery Brief ## Purpose This brief records the pre-implementation survey of existing production and release skills in the `magnus919/agent-skills` repository. It establishes what the production-excellence bundle owns, what it routes to, and what it must not duplicate. It satisfies acceptance criterion "A bounded discovery brief compares the bundle with existing production and release skills" (issue #195). ## Surveyed skills Each skill below was inspected before the bundle was authored. For every skill the conclusion is the same: it owns a deep specialist domain and does **not** own the cross-domain acceptance and handoff layer that assembles evidence into a launch or operational decision. | Skill | What it owns | What the bundle does NOT duplicate | |---|---|---| | [site-reliability-engineering](../../site-reliability-engineering/SKILL.md) | SLO definition, error budgets, incident response, operational recovery, capacity planning, toil reduction | Incident command, on-call procedures, SLO math, error-budget policy, toil automation | | [release-engineering](../../release-engineering/SKILL.md) | Release pipelines, versioning, promotion, rollout, rollback mechanics, deployment strategies | CI/CD pipeline design, artifact promotion, canary/blue-green mechanics, release-please configuration | | [platform-engineering](../../platform-engineering/SKILL.md) | Internal developer platforms, paved roads, service catalogs, infrastructure APIs, Golden Paths | Platform architecture, IDP design, service catalog implementation, infrastructure-as-code | | [secure-software-engineering](../../secure-software-engineering/SKILL.md) | Threat modeling, secure design, security review, vulnerability assessment, trust boundaries | STRIDE/OWASP methodology, security-review procedure, threat-model facilitation | | [data-engineering](../../data-engineering/SKILL.md) | Database operations, ETL/ELT pipelines, data quality, schema migration, storage infrastructure | Pipeline design, dbt patterns, SQL analytical patterns, storage architecture | | [qa-methodology](../../qa-methodology/SKILL.md) | Test strategy, regression coverage, CI quality gates, verification planning, test-level taxonomy | Test-case design, regression-suite management, test-automation framework design | | [verification-methodology](../../verification-methodology/SKILL.md) | Verification verdicts, boundary labeling, evidence standards, gap declaration | Verification-protocol design, evidence-boundary classification | | [production-readiness](../../production-readiness/SKILL.md) | Risk-scaled evidence packet, go/no-go/defer/exception launch decisions with accountable owners | The 11-category evidence checklist, risk-class assignment, accountable-owner identification | | [migration-engineering](../../migration-engineering/SKILL.md) | Safe cross-system migrations — expand/contract, compatibility windows, dual-running, backfills, reconciliation, cutover, deprecation, recovery paths | Migration-strategy design, compatibility-window management, cutover sequencing | | [resilience-and-recovery](../../resilience-and-recovery/SKILL.md) | Failure modes, degradation choices, RTO/RPO, restore testing, DR, game days, failover, data integrity, recovery communication | Game-day design, DR-runbook authoring, failover-procedure definition | | [capacity-and-cost-engineering](../../capacity-and-cost-engineering/SKILL.md) | Demand/capacity/scaling/utilization models, unit-cost connection to SLO decisions, cost-constrained scenario analysis | Capacity-model construction, cost-attribution accounting, quota/rate-limit engineering | | [incident-learning](../../incident-learning/SKILL.md) | Observed facts, causal hypotheses, contributing conditions, follow-up work mapping, verified closure | Incident-analysis facilitation, causal-hypothesis testing, follow-up-ticket management | | [product-lifecycle-learning](../../product-lifecycle-learning/SKILL.md) | Expected-vs-observed outcome comparison, assumption/decision updates, continue/improve/harvest/pivot/pause/retire choices | Lifecycle-review facilitation, outcome-comparison analysis | ## Boundary statement The production-excellence bundle owns the **acceptance and handoff layer**: - Assembling cross-domain evidence (readiness, migration, recovery, capacity/cost, incident-learning) into a single production decision record. - Running the gate model: go, no-go, defer, exception, escalation — each with conditions, evidence, and accountable owners. - Producing the operational handoff record for the team that will own the service in production. - Routing post-launch outcomes into incident-learning and product-lifecycle-learning so that production evidence flows back into decisions. It does **not** own any specialist's runbook. It does not own incident command (SRE), release pipeline mechanics (release-engineering), platform architecture (platform-engineering), threat modeling (secure-software-engineering), data pipeline design (data-engineering), or test-strategy design (qa-methodology). It composes them — it never re-derives their methods. ## What existing bundles do NOT cover The four pre-existing bundles were also surveyed: - **neckbeard** owns the issue-to-PR delivery journey (9-phase SDLC). It does not own the production acceptance and handoff that happens after delivery. - **workflow-architect** owns workflow discovery and skill-bundle generation. It does not own production decision-making. - **tailscale** owns the Headscale/Tailscale VPN ecosystem. It is domain-specific networking, not production governance. - **research-and-vault** owns the research-to-notes sequence. It is a knowledge workflow, not a production workflow. None of them fill the gap this bundle fills: the cross-domain evidence assembly and launch/operational decision layer that sits between delivery (neckbeard's phase 9) and ongoing production operations. ## Decision: bundle owns the acceptance layer, not the specialists' runbooks The production-excellence bundle is the thin composition layer that: 1. Reads evidence from the five production-domain specialists (production-readiness, migration-engineering, resilience-and-recovery, capacity-and-cost-engineering, incident-learning). 2. Reads applicable evidence from the existing production specialists (SRE, release, platform, security, data, QA). 3. Assembles that evidence into a gate decision (go/no-go/defer/exception/escalation). 4. Produces an operational handoff record. 5. Routes post-launch learning back into incident-learning and product-lifecycle-learning. It is deliberately thin. It adds no new methodology beyond the acceptance and handoff contract. Every specialist skill remains the authoritative source for its domain. -
evidence-packet.md 5.6 KB
# Production Evidence Packet The production evidence packet assembles cross-domain evidence into a single decision-ready record. It is the shared input to the gate model ([gates.md](gates.md)) and feeds the operational handoff record ([handoff-record.md](handoff-record.md)). ## Applicability This packet is used for **both**: - **New services** — a service that has never been in production. Every evidence domain is assessed; domains that are not applicable are explicitly marked as such with a reason (not silently omitted). - **Changes to existing systems** — a feature, migration, or configuration change to a service already in production. Only the domains affected by the change are assessed; unaffected domains are marked "no change" with a reference to the existing evidence. ## Evidence domains ### 1. Readiness | Field | Requirement | |---|---| | **Risk class** | Low / Standard / High per [production-readiness](../../production-readiness/SKILL.md) | | **Evidence source** | Readiness record or explicit gap statement | | **Owner** | Named accountable owner for the readiness assessment | | **Decision** | Go / No-go / Defer / Exception from the readiness review | For a **change to an existing system**, cite the delta: what changed since the last readiness review. ### 2. Migration | Field | Requirement | |---|---| | **Migration type** | Schema / data / API / infrastructure / service (or "none") | | **Evidence source** | Migration plan per [migration-engineering](../../migration-engineering/SKILL.md) | | **Recovery path** | Rollback / roll-forward / restore / irreversible (explicit) | | **Verification** | How migration correctness was verified (reconciliation, checksum, smoke) | For a **new service**, migrations may not apply; state "no migration — new service." ### 3. Resilience and recovery | Field | Requirement | |---|---| | **Failure modes assessed** | Dependency outage, data corruption, zone/region loss, overload | | **Evidence source** | Recovery exercise results per [resilience-and-recovery](../../resilience-and-recovery/SKILL.md) | | **RTO/RPO** | Stated targets (context-dependent, not universal) | | **Degradation behavior** | What degrades and how (graceful degradation, not binary up/down) | | **Recovery verified** | Date of last restore test, game-day, or failover exercise | For a **change to an existing system**, state whether the change introduces new failure modes or alters existing ones. ### 4. Capacity and cost | Field | Requirement | |---|---| | **Demand model** | Expected load, peak, growth rate | | **Capacity model** | Scaling limits, quotas, rate limits | | **Cost model** | Unit cost, budget constraint, cost attribution | | **SLO interaction** | Any cost/SLO tradeoff decisions per [capacity-and-cost-engineering](../../capacity-and-cost-engineering/SKILL.md) | | **Assumptions** | Explicit: all demand/capacity/cost assumptions stated | ### 5. Incident learning | Field | Requirement | |---|---| | **Pre-existing incidents** | Any incidents from this service or its dependencies relevant to this change | | **Evidence source** | Incident records per [incident-learning](../../incident-learning/SKILL.md) | | **Follow-up status** | Verified closure of prior incident follow-up items relevant to this change | | **New risk register** | Risks identified during readiness that should feed incident-learning post-launch | For a **new service**, pre-existing incidents may not apply; state "no prior incidents — new service." The new-risk register is always populated. ## Cross-domain entry evidence Before a production decision can be made, the following must exist as **entry evidence** (the bundle does not gather it; it requires it): | Evidence | Owned by | Required for | |---|---|---| | Readiness record with risk class and accountable owner | [production-readiness](../../production-readiness/SKILL.md) | All launches | | Migration plan (when a migration is in scope) | [migration-engineering](../../migration-engineering/SKILL.md) | Migrations | | Recovery exercise evidence (game-day, restore test) | [resilience-and-recovery](../../resilience-and-recovery/SKILL.md) | High-risk launches | | Capacity and cost model with explicit assumptions | [capacity-and-cost-engineering](../../capacity-and-cost-engineering/SKILL.md) | SLO-bearing services | | Incident-learning record for relevant prior incidents | [incident-learning](../../incident-learning/SKILL.md) | Changes to services with incident history | | Security review evidence | [secure-software-engineering](../../secure-software-engineering/SKILL.md) | Trust-boundary changes | | Release plan | [release-engineering](../../release-engineering/SKILL.md) | All launches | | SLO / error-budget status | [site-reliability-engineering](../../site-reliability-engineering/SKILL.md) | SLO-bearing services | | Platform/service-catalog entry | [platform-engineering](../../platform-engineering/SKILL.md) | New services | | Data quality / pipeline evidence | [data-engineering](../../data-engineering/SKILL.md) | Data-path changes | | QA verification evidence | [qa-methodology](../../qa-methodology/SKILL.md) | All launches | ## Missing-evidence handling Any evidence domain without a named source is recorded as an **explicit gap**: - The gap is named (e.g., "no restore test performed"). - An owner is assigned. - A due date or condition is stated (e.g., "before next launch," "within 7 days post-launch"). - The gap feeds the gate model: missing evidence in a required domain may produce a no-go, defer, or exception outcome, depending on risk class and domain. A gap is never silently omitted. Every domain in the packet is either sourced or gapped. -
gates.md 7.6 KB
# Gate and Exception Model The production-excellence gate model defines five discrete outcomes for every production change. Each outcome requires specific conditions and evidence; no outcome is reachable on a bare checklist. ## Guiding principles - **Service ownership**: every gate decision names the service owner accountable for the outcome. - **Risk**: the risk class (Low / Standard / High per [production-readiness](../../production-readiness/SKILL.md)) determines which evidence domains are required and which gates are applicable. - **Evidence**: no gate passes without evidence from the production evidence packet ([evidence-packet.md](evidence-packet.md)). A missing-evidence gap is acceptable only when the risk class permits it and the gap is explicitly recorded with an owner and due date. - **Verification**: evidence must be verified at the declared boundary (component, integration, end-to-end, or production per [verification-methodology](../../verification-methodology/SKILL.md)). An unverified claim does not satisfy an evidence requirement. ## Outcomes ### Go **Meaning**: the change is authorized to proceed to production. **Conditions**: - All evidence domains required for the risk class are sourced (not gapped). - The readiness decision from [production-readiness](../../production-readiness/SKILL.md) is "Go." - Migration evidence (if applicable) confirms a verified recovery path. - Resilience evidence (if required by risk class) includes a recent exercise result. - Capacity and cost model (if required) shows the change is within budget and capacity constraints, with explicit assumptions. - Incident-learning review (if applicable) confirms no unclosed follow-up items relevant to this change. - Security review (if trust-boundary change) is complete. - Release plan is documented and approved. - QA verification evidence is present. **Evidence required**: the complete production evidence packet with all domains sourced or explicitly marked not-applicable. **Accountable owner**: the service owner, who signs off on the Go decision. ### No-go **Meaning**: the change is blocked and must not proceed. **Conditions** (any one is sufficient): - A required evidence domain has a blocking gap (e.g., no restore test for a High-risk launch, no security review for a trust-boundary change). - The readiness decision is "No-go." - A migration has no verified recovery path and the step is irreversible. - An incident-learning review reveals an unclosed follow-up item that would be exacerbated by this change. - A cost/SLO conflict cannot be resolved (the change would violate an SLO, and no budget increase or SLO relaxation is authorized). - A dependency outage assessment shows the change would create an unacceptable blast radius. **Evidence required**: the gap or condition that triggered the No-go, recorded with the specific domain, the missing evidence, and the accountable owner who can resolve it. **Accountable owner**: the service owner records the No-go; the owner of the blocking gap is named as the resolver. ### Defer **Meaning**: the change is postponed to a later date with explicit conditions for re-evaluation. **Conditions**: - The change is not blocked permanently (it is not a No-go), but: - A required evidence domain has a non-blocking gap with a committed due date. - A dependency (e.g., an upstream service's readiness, a platform capability) is not yet available but has a committed delivery date. - A cost/SLO conflict requires a budget or SLO decision that is in progress but not yet authorized. - The risk window (e.g., a holiday freeze, a peak-traffic period) makes the current timing unsuitable. **Evidence required**: the deferral reason, the condition for re-evaluation, the committed date or trigger event, and the owner responsible for meeting the condition. **Accountable owner**: the service owner records the Defer; the owner of the deferral condition is named with the committed resolution date. ### Exception **Meaning**: the change proceeds despite a gap, under an explicit waiver with named approval authority. **Conditions**: - A required evidence domain has a gap that would normally produce a No-go, but: - An explicit human authority (not the service owner, not the agent) approves the exception. - The exception is time-bounded (an expiration date or post-launch condition). - The exception is risk-bounded (what specifically is waived, and what is not). - The exception is recorded with the approving authority's name and the date of approval. - The exception does not waive security review for trust-boundary changes (a hard constraint — see Escalation). **Evidence required**: the exception record with the waived domain, the approving authority, the approval date, the expiration or post-launch condition, and the accountable service owner. **Accountable owner**: the approving authority (the human who granted the exception). The service owner records the exception and tracks the post-launch condition. ### Escalation **Meaning**: the decision cannot be made within the bundle's authority and must be escalated to a higher decision body. **Conditions** (any one is sufficient): - A security review for a trust-boundary change cannot be completed and no exception is authorized (security is a hard constraint — never waived without a security authority). - Two or more gate outcomes are in irreconcilable conflict (e.g., the readiness review says Go but the capacity model shows an SLO violation with no authorized budget increase). - The service owner and the readiness reviewer disagree on the outcome and neither has the authority to resolve the disagreement. - A cross-team dependency blocks the change and the dependency owner is not accountable to the service owner (organizational escalation). - The change crosses a regulatory or compliance boundary and the bundle lacks the domain expertise to assess it. **Evidence required**: the escalation record with the specific conflict or gap, the parties involved, the decision body being escalated to, and the accountable owner who initiated the escalation. **Accountable owner**: the initiator of the escalation (service owner or readiness reviewer). The escalation itself names the target decision body. ## Gate applicability by risk class | Outcome | Low risk | Standard risk | High risk | |---|---|---|---| | **Go** | Lightweight: readiness + release + QA evidence sufficient | All applicable domains sourced | All domains sourced; no gaps permitted | | **No-go** | Blocking gap in any required domain | Blocking gap; irreversible migration without recovery; unresolved incident | Any gap in any domain; no exceptions for High risk without escalation | | **Defer** | Non-blocking gap with due date | Dependency or timing constraint | Only timing constraints (e.g., freeze window); no evidence gaps deferrable | | **Exception** | Service owner may self-approve with recorded rationale | Explicit human authority required; time-bounded | Escalation required (High-risk exceptions are escalated, not granted locally) | | **Escalation** | Security hard-constraint, cross-team authority gap, regulatory boundary | Same as Low, plus irreconcilable gate conflict | Same as Standard; any High-risk exception is escalated | ## Post-gate: operational handoff After a gate outcome is reached, the operational handoff record ([handoff-record.md](handoff-record.md)) is populated. For Go and Exception outcomes, the handoff includes the launch evidence and the post-launch learning path. For No-go, Defer, and Escalation outcomes, the handoff records the blocking condition and the follow-up path. -
handoff-record.md 5.5 KB
# Operational Handoff Record The operational handoff record is the durable artifact that transfers a production change from the launch decision to the team that will own it in production. It is the final output of the production-excellence gate model ([gates.md](gates.md)) and the production evidence packet ([evidence-packet.md](evidence-packet.md)). ## Handoff fields ### Service and change identification | Field | Description | |---|---| | **Service name** | The service or system being launched or changed | | **Change identifier** | Issue, ticket, or change-request ID | | **Change description** | One-paragraph summary of what changed and why | | **Risk class** | Low / Standard / High | | **Service owner** | Named individual accountable for the service in production | | **Launch coordinator** | Named individual who ran the readiness review and gate model | ### Gate outcome | Field | Description | |---|---| | **Outcome** | Go / No-go / Defer / Exception / Escalation | | **Outcome date** | Date the gate decision was reached | | **Outcome authority** | Who approved the outcome (service owner, exception authority, escalation body) | | **Conditions** | Any conditions attached to the outcome (deferral triggers, exception expiration, post-launch requirements) | ### Evidence summary | Field | Description | |---|---| | **Readiness** | Risk class, accountable owner, decision summary — reference to readiness record | | **Migration** | Migration type, recovery path, verification — reference to migration plan (or "none") | | **Resilience** | Failure modes assessed, RTO/RPO, last exercise date — reference to recovery evidence | | **Capacity/cost** | Demand model summary, budget constraint, SLO interaction — reference to capacity model | | **Incident learning** | Relevant prior incidents, follow-up status — reference to incident records | | **Security** | Review status, trust-boundary assessment — reference to security review (or "not applicable") | | **Release** | Release plan summary — reference to release plan | | **Platform** | Service-catalog entry, paved-road status — reference to platform entry | | **Data** | Data-path assessment — reference to data-quality evidence | | **QA** | Verification summary, boundary exercised — reference to QA evidence | ### Gap register (for any missing evidence) | Field | Description | |---|---| | **Domain** | Which evidence domain has a gap | | **Gap description** | What evidence is missing | | **Owner** | Who is accountable for closing the gap | | **Due date** | When the gap must be closed | | **Risk of non-closure** | What happens if the gap is not closed by the due date | ### Post-launch learning path | Field | Description | |---|---| | **Incident-learning route** | Whether launch outcomes and any post-launch incidents should feed [incident-learning](../../incident-learning/SKILL.md) | | **Lifecycle-learning route** | Whether launch outcomes should feed [product-lifecycle-learning](../../product-lifecycle-learning/SKILL.md) for expected-vs-observed comparison | | **Review cadence** | When the service owner should revisit the handoff record (e.g., 7 days post-launch, 30 days post-launch) | | **Escalation path** | Who to contact if post-launch issues exceed the service owner's authority | ### Sign-off | Field | Description | |---|---| | **Service owner signature** | Name and date | | **Launch coordinator signature** | Name and date | | **Exception authority signature** | Name and date (only for Exception outcomes) | | **Escalation body acknowledgement** | Name and date (only for Escalation outcomes) | ## Post-launch learning: routing launch outcomes After launch, the handoff record feeds two learning paths: ### Incident-learning route Post-launch incidents (degraded SLOs, unexpected failures, dependency outages, capacity breaches) are routed to [incident-learning](../../incident-learning/SKILL.md) with a reference to this handoff record. The incident-learning skill's verified-closure requirement ensures that follow-up items traced to launch decisions are tracked to completion. For a **Go** outcome: incidents are unexpected and trigger the standard incident-learning flow. For an **Exception** outcome: incidents related to the waived domain are expected to be elevated; the exception's post-launch condition defines the threshold for re-escalation. ### Lifecycle-learning route The expected outcomes recorded in the handoff (SLO targets, capacity assumptions, cost projections, migration-success criteria) are routed to [product-lifecycle-learning](../../product-lifecycle-learning/SKILL.md) for expected-vs-observed comparison at the review cadence. The lifecycle-learning skill's continue/improve/harvest/pivot/pause/retire decisions are informed by the gap between what the handoff predicted and what production observed. ## Handoff for non-Go outcomes The handoff record is populated even when the outcome is not Go: - **No-go**: the handoff records the blocking gap and routes it to the gap owner. The record is retained as evidence of the decision and its rationale. - **Defer**: the handoff records the deferral condition and the re-evaluation trigger. At the trigger date, the service owner re-opens the gate model with updated evidence. - **Exception**: the handoff records the waiver and its post-launch condition. The exception authority is named; the condition is tracked. - **Escalation**: the handoff records the escalation target and the specific conflict. The escalation body's decision (when reached) is recorded in a follow-up handoff.
-
-
AGENTS.md 1.5 KB
# AGENTS.md — Production Excellence Bundle This bundle is a thin composition layer that assembles cross-domain production evidence into a launch or operational decision. It is the discoverable entry point; all routed skills are top-level catalog skills, not nested sub-skills. ## Loading behavior - The umbrella `SKILL.md` is the single discoverable entry point. Harnesses that respect Agent Skills progressive disclosure will discover this bundle through its frontmatter (`name: production-excellence`). - This bundle does not contain nested skills under a `skills/` directory. All specialist skills are referenced via relative markdown links (`../<skill>/SKILL.md`) and are resolved by the harness from the catalog. - When a production concern maps to a single specialist (e.g., a migration plan is needed), load that specialist directly. Use this bundle when cross-domain assembly and a gate decision are required. - The bundle's reference files (`references/`) are loaded on demand per the file map in `SKILL.md`. Do not load all references at activation time. ## Harness notes - Compatible harnesses are guaranteed to see this bundle's `SKILL.md`. Nested sub-skill auto-loading is not applicable (no nested skills exist). - The bundle's routing table in `SKILL.md` uses relative links from the bundle root (`production-excellence/`) to top-level skill directories (`../<skill>/SKILL.md`). Harnesses must resolve these relative to the repository root. -
manifest.yaml 7.5 KB
# Bundle manifest (bundle-manifest-v1) — see ../schemas/bundle-manifest-v1.schema.json # and docs/bundle-manifest-design.md. Paths are relative to this bundle dir. schema_version: 1 bundle_name: production-excellence purpose: >- Route cross-domain production evidence (readiness, migration, recovery, capacity/cost, incident-learning) into a launch or operational decision — go, no-go, defer, exception, or escalation — with an accountable owner and a post-launch learning path. audience: >- Service owners, SRE, release, platform, security, data, and QA teams coordinating a production change; agents assembling cross-domain production evidence into a defensible launch decision without re-deriving specialist runbooks. stages: - name: Cross-domain evidence assembly skills: - ../production-readiness/SKILL.md - ../migration-engineering/SKILL.md - ../resilience-and-recovery/SKILL.md - ../capacity-and-cost-engineering/SKILL.md - ../incident-learning/SKILL.md - name: Gate evaluation skills: - ../production-readiness/SKILL.md - ../site-reliability-engineering/SKILL.md - ../verification-methodology/SKILL.md - ../qa-methodology/SKILL.md - name: Operational handoff skills: - ../release-engineering/SKILL.md - ../platform-engineering/SKILL.md - ../secure-software-engineering/SKILL.md - ../data-engineering/SKILL.md - name: Post-launch learning skills: - ../incident-learning/SKILL.md included_skills: - ../production-readiness/SKILL.md - ../migration-engineering/SKILL.md - ../resilience-and-recovery/SKILL.md - ../capacity-and-cost-engineering/SKILL.md - ../incident-learning/SKILL.md - ../site-reliability-engineering/SKILL.md - ../release-engineering/SKILL.md - ../platform-engineering/SKILL.md - ../secure-software-engineering/SKILL.md - ../data-engineering/SKILL.md - ../qa-methodology/SKILL.md - ../verification-methodology/SKILL.md prerequisites: - artifact: Readiness review evidence packet (risk-scaled, 11 categories) skill: ../production-readiness/SKILL.md - artifact: Migration plan, compatibility windows, and reconciliation evidence skill: ../migration-engineering/SKILL.md - artifact: Resilience and recovery evidence (RTO/RPO, restore tests, game days) skill: ../resilience-and-recovery/SKILL.md - artifact: Capacity and cost model evidence (demand, scaling, unit cost) skill: ../capacity-and-cost-engineering/SKILL.md - artifact: Incident history, causal hypotheses, and verified-closure records skill: ../incident-learning/SKILL.md - artifact: SLO and error-budget status skill: ../site-reliability-engineering/SKILL.md - artifact: Release plan and rollback strategy skill: ../release-engineering/SKILL.md outputs: - gate-decision - operational-handoff-record - accountable-owner-record - evidence-gap-register handoffs: - to: incident-learning artifact: operational-handoff-record note: >- Post-launch incidents (SLO degradations, unexpected failures, capacity breaches) route back to incident-learning with launch context; verified closure is required for follow-up items. - to: product-lifecycle-learning artifact: operational-handoff-record note: >- Expected outcomes recorded in the handoff (SLO targets, capacity assumptions, cost projections) feed expected-vs-observed comparison at the handoff review cadence. - to: agent-production-operations artifact: gate-decision note: >- Readiness outcomes (go/no-go/defer/exception) gate agent authority expansion when the runtime control plane is in use. - to: service owner artifact: accountable-owner-record note: >- Every gate outcome names an accountable owner and records the evidence supporting it; no gate passes on a bare checklist. conflicts: - skill: ../production-readiness/SKILL.md with: product-lifecycle guidance: >- Both bundles include production-readiness. This bundle owns the launch gate decision; product-lifecycle routes phase 6 delivery handoff. Load the bundle matching the active decision context, never both at once. - skill: ../production-readiness/SKILL.md with: agent-production-operations guidance: >- agent-production-operations consumes readiness outcomes as authority- gating inputs. Readiness reviews and go/no-go/defer/exception outcomes are produced here and consumed there. - skill: ../release-engineering/SKILL.md with: product-lifecycle guidance: >- Release engineering is shared. Route by context: gate-entry release evidence (this bundle) versus lifecycle delivery handoff (product-lifecycle). - skill: ../release-engineering/SKILL.md with: agent-production-operations guidance: >- Release engineering is shared. Route by context: launch-gate release plans (this bundle) versus agent staged-rollout planning (agent-production-operations). - skill: ../site-reliability-engineering/SKILL.md with: product-lifecycle guidance: >- SRE is shared. This bundle routes to it for gate-entry SLO/error-budget evidence; product-lifecycle routes to it for delivery reliability. - skill: ../site-reliability-engineering/SKILL.md with: agent-production-operations guidance: >- SRE is shared. This bundle uses it for gate-entry reliability evidence; agent-production-operations uses it for runtime latency/cost budgets and incident handoff. Incident command stays with SRE in both cases. - skill: ../secure-software-engineering/SKILL.md with: product-lifecycle guidance: >- Security engineering is shared. Route by context: security evidence for launch gates (this bundle) versus trust-boundary work in lifecycle phases (product-lifecycle). - skill: ../secure-software-engineering/SKILL.md with: agent-production-operations guidance: >- Security engineering is shared. Route by context: launch-gate security evidence (this bundle) versus agent authority contracts and disablement security (agent-production-operations). - skill: ../platform-engineering/SKILL.md with: product-lifecycle guidance: >- Platform engineering is shared. Route by context: gate-entry platform evidence (this bundle) versus lifecycle delivery handoff (product-lifecycle). - skill: ../platform-engineering/SKILL.md with: agent-production-operations guidance: >- Platform engineering is shared. Route by context: launch-gate platform evidence (this bundle) versus agent sandboxing and tool-execution isolation (agent-production-operations). - skill: ../incident-learning/SKILL.md with: agent-production-operations guidance: >- Both bundles consume incident-learning records. This bundle uses incident history as gate-entry evidence; agent-production-operations consumes verified-closure records as escalation and disablement inputs. - skill: ../qa-methodology/SKILL.md with: product-lifecycle guidance: >- QA methodology is shared. Route by context: launch verification evidence (this bundle) versus lifecycle phase 6 quality gates (product-lifecycle). - skill: ../verification-methodology/SKILL.md with: product-lifecycle guidance: >- Verification methodology is shared. This bundle uses it for boundary labeling of launch evidence; product-lifecycle uses it at every phase gate. eval_suite: - evals/evals.json -
README.md 5 KB
# Production Excellence Assemble cross-domain production evidence into a defensible launch or operational decision — go, no-go, defer, exception, or escalation — with an accountable owner and a post-launch learning path. ## Why Install This Skill When a service or change is heading to production, evidence is scattered across multiple domains: a readiness review in one place, a migration plan in another, recovery-exercise results somewhere else, a capacity model in a spreadsheet, and incident history in yet another tool. Without a single acceptance layer, teams either launch with invisible gaps or drown in coordination overhead. Production Excellence gives your agent that layer — a thin, structured gate model that reads evidence from every specialist domain and produces one of five clear, defensible outcomes with an accountable owner attached. After installing, your agent can run a production gate review for any change — from a low-risk docs update to a high-risk customer-facing launch with migration, recovery, and cost/SLO tradeoffs. The bundle composes the specialist catalog (production-readiness, migration-engineering, resilience-and-recovery, capacity-and-cost-engineering, incident-learning, plus SRE, release, platform, security, data, and QA) without copying a single runbook. Post-launch, it routes outcomes into incident-learning and product-lifecycle-learning so production evidence flows back into decisions instead of being forgotten. ## What You Get | Path | What it provides | |---|---| | `SKILL.md` | Thin umbrella entry point: readiness routing table for 5 production-domain routes and 7 supporting specialists, cross-domain entry evidence requirements, gate/exception model (go/no-go/defer/exception/escalation), operational handoff, and post-launch learning paths | | `AGENTS.md` | Agent-specific loading notes: nested-skill behavior, harness compatibility, and progressive-disclosure guidance | | `README.md` | This human-facing overview | | `references/discovery-brief.md` | Bounded discovery brief comparing the bundle against 13 existing production and release skills (SRE, release, platform, security, data, QA, plus the 5 milestone production skills and verification/lifecycle-learning) | | `references/evidence-packet.md` | Production evidence packet specification: entry-evidence requirements for readiness, migration, recovery, capacity/cost, and incident-learning domains — usable for both new services and changes to existing systems | | `references/gates.md` | Full gate and exception model: go, no-go, defer, exception, and escalation outcomes, each with conditions, evidence requirements, risk-class applicability, and post-gate handoff rules | | `references/handoff-record.md` | Operational handoff record template: service identification, gate outcome, evidence summary, gap register, post-launch learning paths (incident-learning and product-lifecycle-learning), and sign-off fields | | `evals/evals.json` | Five integrated evaluation cases covering normal release, untested rollback, data migration, dependency outage, and cost/SLO conflict | | `manifest.yaml` | Machine-readable bundle manifest (schema v1): purpose, audience, stages, included skills, prerequisites, outputs, handoffs, conflicts, and eval suite | ## Quick Start 1. Identify the service or change and its risk class (Low / Standard / High per production-readiness). 2. Gather entry evidence from each applicable domain using the evidence packet (`references/evidence-packet.md`). Every domain needs a named source or an explicit gap with an owner and due date. 3. Run the gate model (`references/gates.md`): evaluate the evidence against the five outcomes. Record the outcome with the accountable owner. 4. Populate the operational handoff record (`references/handoff-record.md`) — even for non-Go outcomes. 5. Route post-launch observations to incident-learning and product-lifecycle-learning per the handoff record's learning path. ## Triggers - "Is this ready for production?" - "Run a production gate review" - "Assemble the production evidence packet" - "We need a go/no-go decision for this launch" - "Coordinate the production readiness review across teams" - "What evidence is missing before we can launch?" - "We have a migration, a recovery exercise, and a capacity model — are we clear to go?" - "Route this launch outcome into our incident-learning process" - A cross-team launch needs a single acceptance contract before proceeding - A cost/SLO conflict needs a structured decision with accountable owners ## Requirements - No runtime dependencies, API keys, or external services. - The bundle routes to 12 specialist skills for detailed domain work; those skills must be present in the catalog for full routing capability (production-readiness, migration-engineering, resilience-and-recovery, capacity-and-cost-engineering, incident-learning, site-reliability-engineering, release-engineering, platform-engineering, secure-software-engineering, data-engineering, qa-methodology, verification-methodology — all currently exist in the repository). -
SKILL.md 10.4 KB
--- name: production-excellence description: >- Build cross-domain production evidence from readiness, migration, recovery, capacity/cost, and incident learning into launch or operational decisions. Do not use this skill for a single specialist's risk packet and launch gate; use `production-readiness` for that readiness review. license: MIT compatibility: Platform-agnostic methodology. No runtime dependencies, API keys, or external services required. metadata: tags: production-excellence, launch-decision, gate-model, evidence-packet, operational-handoff, readiness-review, cross-domain, production-acceptance, go-no-go, exception-escalation, post-launch-learning --- # Production Excellence A thin composition bundle that assembles cross-domain production evidence into a defensible launch or operational decision. It owns the **acceptance and handoff layer** — the gate model that reads evidence from specialist skills and produces go / no-go / defer / exception / escalation outcomes with accountable owners. It does not own any specialist's runbook. ## When to load this Load when: - A service or change is approaching a launch decision and evidence from multiple production domains must be assembled. - You need a structured gate model (go/no-go/defer/exception/escalation) with conditions, evidence, and accountable owners. - Cross-domain evidence (readiness, migration, recovery, capacity/cost, incident history) must be combined into one operational handoff record. - A launch or change needs a post-launch learning path routed to incident-learning and product-lifecycle-learning. - You are coordinating a production change across SRE, release, platform, security, data, and QA specialists and need a single acceptance contract. ## When not to use Do **not** load this bundle for: - **Incident command or SLO operations** — those are owned by [site-reliability-engineering](../site-reliability-engineering/SKILL.md). - **Release-pipeline mechanics, versioning, or deployment strategies** — those are owned by [release-engineering](../release-engineering/SKILL.md). - **Platform architecture or internal-developer-platform design** — those are owned by [platform-engineering](../platform-engineering/SKILL.md). - **Threat modeling, security review procedure, or vulnerability assessment** — those are owned by [secure-software-engineering](../secure-software-engineering/SKILL.md). - **Data-pipeline design, ETL, or storage architecture** — those are owned by [data-engineering](../data-engineering/SKILL.md). - **Test-strategy design, regression-suite management, or test-automation framework design** — those are owned by [qa-methodology](../qa-methodology/SKILL.md). - **A generic checklist detached from service ownership, risk, evidence, and verification** — every gate in this bundle requires a named service owner, assessed risk, verified evidence, and a declaration of the verification boundary. A bare checklist is never a valid outcome. This bundle composes specialists. It never replaces them and never re-derives their methods. If the task is wholly within one specialist's domain, load that specialist directly. ## Readiness routing table The bundle routes each production concern to the specialist that owns it. The bundle itself owns only the acceptance and handoff layer — the cross-domain assembly and the gate decision. ### Primary production-domain routes | Domain | Specialist skill | What the specialist owns | What the bundle adds | |---|---|---|---| | **Production readiness** | [production-readiness](../production-readiness/SKILL.md) | Risk-scaled evidence packet (11 categories), go/no-go/defer/exception launch decisions, accountable owners | Cross-domain assembly with migration, recovery, capacity/cost, and incident evidence; gate integration | | **Migration** | [migration-engineering](../migration-engineering/SKILL.md) | Expand/contract, compatibility windows, dual-running, backfills, reconciliation, cutover, recovery paths | Migration evidence as input to the gate model; handoff of migration verification to the operational record | | **Resilience and recovery** | [resilience-and-recovery](../resilience-and-recovery/SKILL.md) | Failure modes, degradation choices, RTO/RPO, restore testing, DR, game days, failover, data integrity | Recovery evidence as a gate condition; exercise results feed the handoff record | | **Capacity and cost** | [capacity-and-cost-engineering](../capacity-and-cost-engineering/SKILL.md) | Demand/capacity/scaling/utilization models, unit-cost connection to SLO decisions, cost-constrained scenarios | Capacity/cost evidence as a gate condition; SLO/cost tradeoff decisions feed the gate model | | **Incident learning** | [incident-learning](../incident-learning/SKILL.md) | Observed facts, causal hypotheses, contributing conditions, follow-up work mapping, verified closure | Pre-existing incident evidence as a gate condition; post-launch incidents routed back to incident-learning | ### Supporting specialist routes | Domain | Specialist skill | When routed | |---|---|---| | **Reliability / SLOs** | [site-reliability-engineering](../site-reliability-engineering/SKILL.md) | SLO/error-budget status required for gate entry; incident response for post-launch issues | | **Release mechanics** | [release-engineering](../release-engineering/SKILL.md) | Release plan, rollout/rollback strategy required for gate entry | | **Platform** | [platform-engineering](../platform-engineering/SKILL.md) | Service-catalog entry, paved-road status for new services | | **Security** | [secure-software-engineering](../secure-software-engineering/SKILL.md) | Security review evidence for trust-boundary changes | | **Data** | [data-engineering](../data-engineering/SKILL.md) | Data-quality and pipeline evidence for data-path changes | | **QA** | [qa-methodology](../qa-methodology/SKILL.md) | Verification evidence for all launches | | **Verification** | [verification-methodology](../verification-methodology/SKILL.md) | Boundary labeling and gap declaration for evidence assessment | ## Cross-domain entry evidence Before the gate model runs, entry evidence must exist from every applicable domain. The bundle does not gather this evidence — it requires it. The complete evidence packet specification is in [references/evidence-packet.md](references/evidence-packet.md). Summary: - Every evidence domain (readiness, migration, recovery, capacity/cost, incident-learning) has a named source or an explicit gap with an owner and due date. - The packet is usable for **both new services and changes to existing systems** — domains irrelevant to the change are explicitly marked "not applicable" with a reason. - Missing evidence is never silently omitted. Every gap is recorded. ## Gate and exception model The gate model produces exactly one of five outcomes for every production change. Full definitions, conditions, and evidence requirements are in [references/gates.md](references/gates.md). | Outcome | Meaning | Key condition | |---|---|---| | **Go** | Authorized to proceed to production | All required evidence domains are sourced; no blocking gaps | | **No-go** | Blocked; must not proceed | A required domain has a blocking gap, or an irreversible step has no verified recovery path | | **Defer** | Postponed with explicit conditions | A non-blocking gap or dependency has a committed resolution date; re-evaluation is scheduled | | **Exception** | Proceeds under an explicit waiver | A human authority (not the agent, not the service owner alone) approves a time-bounded, risk-bounded exception | | **Escalation** | Decision escalated to a higher body | Irreconcilable gate conflict, trust-boundary security gap, cross-team authority gap, or regulatory boundary | Every outcome is anchored to **service ownership**, **risk**, **evidence**, and **verification**. No gate passes on a bare checklist. Each outcome names the accountable owner and records the evidence that supports it. ## Operational handoff and post-launch learning After a gate outcome is reached, the operational handoff record ([references/handoff-record.md](references/handoff-record.md)) is populated. ### Post-launch learning paths Launch outcomes and post-launch observations feed two learning routes: 1. **Incident learning** — post-launch incidents (SLO degradations, unexpected failures, capacity breaches) are routed to [incident-learning](../incident-learning/SKILL.md). The handoff record provides the launch context; the incident-learning skill's verified-closure requirement ensures follow-up items are tracked to completion. 2. **Lifecycle learning** — expected outcomes recorded in the handoff (SLO targets, capacity assumptions, cost projections) are routed to [product-lifecycle-learning](../product-lifecycle-learning/SKILL.md) for expected-vs-observed comparison at the handoff's review cadence. The lifecycle-learning skill's continue/improve/harvest/pivot/pause/retire decisions are informed by the gap between predicted and observed production behavior. The handoff record is populated for every outcome — not only Go. No-go, Defer, Exception, and Escalation each produce a handoff record with the blocking condition, the follow-up path, and the accountable owner. ## Loading and nested-skill behavior This bundle is the discoverable entry point. It does not contain nested sub-skills under a `skills/` directory. All routed skills are top-level catalog skills referenced via relative markdown links. Harnesses that support progressive disclosure will discover this bundle through its `SKILL.md` frontmatter and load the referenced specialists on trigger. See [AGENTS.md](AGENTS.md) for agent-specific loading notes. ## File map | Path | Loaded when | |---|---| | [references/discovery-brief.md](references/discovery-brief.md) | Understanding the bundle's boundary against existing production and release skills | | [references/evidence-packet.md](references/evidence-packet.md) | Assembling cross-domain evidence for a production decision | | [references/gates.md](references/gates.md) | Running the gate model — go/no-go/defer/exception/escalation | | [references/handoff-record.md](references/handoff-record.md) | Producing the operational handoff record and post-launch learning path | | [manifest.yaml](manifest.yaml) | Machine-readable composition contract (schema v1): purpose, audience, stages, included skills, prerequisites, outputs, handoffs, conflicts, and eval suite; consumed by the lifecycle capability matrix |
Comments (0)
Sign in to join the conversation.
Reviews (0)
No reviews yet.
No comments yet.