Claude Skill

mutation-testing-analysis

Use this skill when you need to interpret mutation operators, killed and survived mutants, and evidence limits; triggers include 变异测试分析 and mutation testing analysis.

LLM Mart · 0 points · 0 views 0 listing impressions 0 install-command copies
Virus-scanned Reviewed automatically before listing.

Full trust report

Download naodeng-awesome-qa-skills-skills_en_testing-types_mutation-testing-analysis-c44b892.zip · 6 KB
Part of naodeng/awesome-qa-skills — 97 skills

Install

skills CLI npx skills add https://github.com/naodeng/awesome-qa-skills/tree/main/skills/en/testing-types/mutation-testing-analysis
Claude Code claude plugin marketplace add https://llmmart.ai/marketplace.json && claude plugin install naodeng-awesome-qa-skills@llmmart
Git git clone https://github.com/naodeng/awesome-qa-skills.git

The skills CLI installs just this skill, for any of its supported agents. Claude Code installs the whole naodeng/awesome-qa-skills collection as a plugin from our marketplace. Git is the plain clone.

Skill manifest

Mutation Testing Analysis

analyze test sensitivity from mutation operators, surviving results, equivalent mutants, and test mappings without inventing a quality score. Produce MTA-## findings. This Skill organizes traceable test-effectiveness evidence candidates only; it does not execute tests or turn a design inventory into coverage, pass, or release evidence.

When to Use

  • When you need mutation testing analysis candidates from mutation reports, operator configuration, killed and surviving results, equivalent-mutant notes, test mappings, coverage, and run logs.
  • When you need selection rationale, applicability constraints, evidence gaps, and the smallest validation action.
  • When inputs are incomplete but a bounded first pass can preserve blocked or unassessed boundaries.

Do not use it to execute tests, invent behavior conclusions, replace a complete strategy, or accept risk for a Human.

Output Format Options

  • Use Markdown by default; use tables, JSON, or CSV only when explicitly requested or required by the delivery format.
  • Separate static analysis, unexecuted work, evidence states, and Human decisions; keep items unassessed, blocked, or NOT_RUN when runtime evidence is absent.

How to Use

  1. Read prompts/mutation-testing-analysis.md and provide the objective, scope, material, environment, and evidence.
  2. Complete the known, missing, conflicting, stale, out_of_scope, and assumptions input audit before findings.
  3. Record MTA-## with the subject, preconditions, concern, source evidence, and validation, plus impact/priority, owner role, close condition, and evidence state.
  4. Preserve conflicts, unknown constraints, and open questions when evidence is incomplete.

Core Constraints

  • Do not execute tests, assume missing rules, versions, thresholds, data, or outcomes, or treat candidate counts as coverage proof.
  • File presence, names, design declarations, and Eval configuration are not runtime evidence.
  • Mark unknowns unassessed, blocked, or pending clarification instead of filling them with convention.
  • Do not edit requirements, code, test assets, or target systems.

Pre-delivery Check

  • Recorded the known, missing, conflicting, stale, out_of_scope, and assumptions input audit.
  • Every MTA-## has source, evidence state, impact/priority, owner role, close condition, and validation.
  • Facts, inferences, recommendations, unexecuted work, and Human decisions remain separate.
  • Findings are not execution results, coverage proof, or release claims.

Reference Files

  • Read evals/eval.yaml and matching cases for regression; configuration does not prove project results.
  • Use evals/trigger-prompts.csv and evals/local-rules.json for trigger checks; missing skill.selection evidence is BLOCKED.

Common Pitfalls

  • Do not turn a method name, file presence, or candidate count into test execution, coverage, pass, or release evidence when scope or evidence is incomplete.
  • Do not fill in missing rules, thresholds, data, environments, or results from convention; preserve unassessed, blocked, and pending items.
  • Do not expand this specialist design or review into a complete strategy, full test cases, runtime execution, or a release decision.

Best Practices

  • Complete the six-part input audit before selecting the smallest traceable and verifiable finding scope.
  • Keep the source, evidence state, impact/priority, owner role, close condition, validation method, and residual risk for every finding.
  • Write validation suggestions as next actions; do not upgrade package structure, candidate counts, or local Eval configuration into real quality conclusions.
Files (awesome-qa-skills)
  • agents
    • openai.yaml 361 B
      version: 1
      metadata:
        key: "mutation-testing-analysis"
      interface:
        display_name: "Mutation Testing Analysis"
        short_description: "Review evidence-backed quality candidates without claiming execution."
        default_prompt: "Use the mutation-testing-analysis skill to produce MTA-## findings without claiming execution."
      policy:
        allow_implicit_invocation: true
      
  • evals
    • cases
      • basic-success.yaml 885 B
        id: basic-success
        title: "Mutation Testing Analysis: basic-success"
        description: |
          This case checks the mutation-testing-analysis evidence and boundary contract.
        
        input:
          prompt: |
            Use mutation-testing-analysis for this material: a mutation report shows surviving mutants, but equivalent-mutant classification, timeouts, and test-to-mutant mapping are incomplete. Start with known, missing, conflicting, stale, out_of_scope, and assumptions, then produce MTA-## with source, evidence state, priority, close condition, and validation. Do not claim tests ran.
        
        expect:
          must_contain:
            - "MTA-"
            - "known"
            - "evidence"
            - "validation"
            - "mutation"
          must_not_contain:
            - "TODO"
            - "I cannot"
        
        judge:
          type: rule_based
          success:
            - output_contains:
                all:
                  - "known"
                  - "evidence"
                  - "validation"
                  - "mutation"
        
      • edge-incomplete-input.yaml 643 B
        id: edge-incomplete-input
        title: "Mutation Testing Analysis: edge-incomplete-input"
        description: |
          This case checks that missing inputs remain explicit and bounded.
        
        input:
          prompt: |
            Use mutation-testing-analysis with only a target name and one sentence. List missing evidence and open questions, then produce bounded MTA-## candidates without inventing behavior or execution results.
        
        expect:
          must_contain:
            - "MTA-"
            - "missing"
            - "open question"
          must_not_contain:
            - "TODO"
            - "I cannot"
        
        judge:
          type: rule_based
          success:
            - output_contains:
                all:
                  - "missing"
                  - "open question"
        
      • edge-scope-boundary.yaml 719 B
        id: edge-scope-boundary
        title: "Mutation Testing Analysis: edge-scope-boundary"
        description: |
          This case checks that execution and out-of-scope requests remain explicit.
        
        input:
          prompt: |
            Use mutation-testing-analysis for review only. The user asks to execute every check and guarantee release. State scope, unexecuted work, and Human decisions before producing MTA-##.
        
        expect:
          must_contain:
            - "MTA-"
            - "scope"
            - "unexecuted"
          must_not_contain:
            - "TODO"
            - "I cannot"
            - "tests were executed"
            - "all tests passed"
            - "release approved"
        
        judge:
          type: rule_based
          success:
            - output_contains:
                all:
                  - "scope"
                  - "unexecuted"
                  - "mutation"
        
    • eval.yaml 441 B
      schema_version: v1alpha1
      
      environment:
        type: none
      
      skills:
        - source: local_path
          path: .
      
      engine:
        name: claude_code
      
      cases:
        files:
          - evals/cases/basic-success.yaml
          - evals/cases/edge-incomplete-input.yaml
          - evals/cases/edge-scope-boundary.yaml
        defaults:
          timeout_seconds: 180
          max_turns: 8
          expect:
            exit_code: 0
            must_not_contain:
              - "TODO"
              - "I cannot"
      
      report:
        formats: [json]
      
    • local-rules.json 144 B
      {
        "skill": "mutation-testing-analysis",
        "max_commands": 20,
        "max_total_tokens": 100000,
        "permissions": {
          "max_escalations": 0
        }
      }
      
    • trigger-prompts.csv 610 B · in bundle
  • prompts
    • mutation-testing-analysis.md 3.4 KB
      # Mutation Testing Analysis Prompt
      
      Act as an evidence-driven QA specialist. Based only on supplied material, analyze test sensitivity from mutation operators, surviving results, equivalent mutants, and test mappings without inventing a quality score. Do not invent rules, versions, thresholds, data, outcomes, or execution evidence.
      
      ## Input
      
      Start with:
      - known: sourced facts about mutation reports, operator configuration, killed and surviving results, equivalent-mutant notes, test mappings, coverage, and run logs;
      - missing: absent stable IDs, scope, version, unit, threshold, constraint, data, environment, or raw execution result;
      - conflicting: contradictory behavior, applicability, expected outcomes, or evidence;
      - stale: version, rule, test, or report material whose current applicability is unclear;
      - out_of_scope: systems, platforms, stages, combinations, or execution actions excluded from this pass;
      - assumptions: minimum assumptions used for a bounded first pass and their impact.
      
      ## What to do
      
      Prefer mutation reports, operator configuration, killed and surviving results, equivalent-mutant notes, test mappings, coverage, and run logs, requirements, acceptance criteria, designs, changes, defects, existing tests, and raw reports.
      1. Restate the subject, scope, and success criteria.
      2. Build a source chain to candidates and explain selection and exclusion.
      3. Select the smallest high-risk, verifiable set.
      4. Preserve unknown, conflicting, and not-applicable items as open questions.
      5. Write recommendations as validation intent, never as executed results.
      
      ## Execution Rules
      
      ### MTA-## Finding Contract
      
      Each finding contains the subject, preconditions, concern, source evidence, and validation, plus evidence state, impact/priority, owner role, and close condition.
      
      - Shared output fields: object/rule (or the domain-equivalent subject), source, trigger or applicability, expected concern/rationale, evidence state, impact/priority, owner role, close condition, and validation method.
      
      ## Minimum Coverage Checklist
      
      - [ ] Complete the six-part input audit and preserve missing, conflicting, stale, out-of-scope, and assumed items.
      - [ ] Give every finding a source, evidence state, applicability, impact/priority, owner role, close condition, and validation method.
      - [ ] Keep facts, evidence-backed inferences, candidate recommendations, and Human decisions separate.
      
      ## Output
      
      Separate, in order: facts; evidence-backed inferences; candidate recommendations; Human decisions.
      
      Objective and boundaries; six-part input audit; applicable dimensions and selection rules; MTA-## finding table; unknown, conflicting, blocked/unassessed items and residual risk; validation suggestions, Human decisions, and self-check.
      
      ## Quality Bar
      
      - Do not execute tests, assume missing rules, versions, thresholds, data, or outcomes, or treat candidate counts as coverage proof.
      - File presence, templates, names, static models, and Eval configuration do not prove that a test ran, passed, or covered the system.
      - Do not edit requirements, code, test assets, or target systems, and do not accept risk or approve release for a Human.
      - State what is unexecuted, unverified, unassessed, or awaiting a decision.
      
      ## Pre-delivery Self-check
      
      Did you record the six-part input audit? Does every MTA-## have source, evidence, impact/priority, owner role, close condition, and validation? Are facts, inferences, recommendations, and Human decisions separate?
      
  • SKILL.md 3.8 KB
    ---
    name: mutation-testing-analysis
    description: Use this skill when you need to interpret mutation operators, killed and survived mutants, and evidence limits; triggers include 变异测试分析 and mutation testing analysis.
    ---
    
    # Mutation Testing Analysis
    
    analyze test sensitivity from mutation operators, surviving results, equivalent mutants, and test mappings without inventing a quality score. Produce MTA-## findings. This Skill organizes traceable test-effectiveness evidence candidates only; it does not execute tests or turn a design inventory into coverage, pass, or release evidence.
    
    ## When to Use
    
    - When you need mutation testing analysis candidates from mutation reports, operator configuration, killed and surviving results, equivalent-mutant notes, test mappings, coverage, and run logs.
    - When you need selection rationale, applicability constraints, evidence gaps, and the smallest validation action.
    - When inputs are incomplete but a bounded first pass can preserve blocked or unassessed boundaries.
    
    Do not use it to execute tests, invent behavior conclusions, replace a complete strategy, or accept risk for a Human.
    
    ## Output Format Options
    
    - Use Markdown by default; use tables, JSON, or CSV only when explicitly requested or required by the delivery format.
    - Separate static analysis, unexecuted work, evidence states, and Human decisions; keep items unassessed, blocked, or NOT_RUN when runtime evidence is absent.
    
    ## How to Use
    
    1. Read prompts/mutation-testing-analysis.md and provide the objective, scope, material, environment, and evidence.
    2. Complete the known, missing, conflicting, stale, out_of_scope, and assumptions input audit before findings.
    3. Record MTA-## with the subject, preconditions, concern, source evidence, and validation, plus impact/priority, owner role, close condition, and evidence state.
    4. Preserve conflicts, unknown constraints, and open questions when evidence is incomplete.
    
    ## Core Constraints
    
    - Do not execute tests, assume missing rules, versions, thresholds, data, or outcomes, or treat candidate counts as coverage proof.
    - File presence, names, design declarations, and Eval configuration are not runtime evidence.
    - Mark unknowns unassessed, blocked, or pending clarification instead of filling them with convention.
    - Do not edit requirements, code, test assets, or target systems.
    
    ## Pre-delivery Check
    
    - [ ] Recorded the known, missing, conflicting, stale, out_of_scope, and assumptions input audit.
    - [ ] Every MTA-## has source, evidence state, impact/priority, owner role, close condition, and validation.
    - [ ] Facts, inferences, recommendations, unexecuted work, and Human decisions remain separate.
    - [ ] Findings are not execution results, coverage proof, or release claims.
    
    ## Reference Files
    
    - Read evals/eval.yaml and matching cases for regression; configuration does not prove project results.
    - Use evals/trigger-prompts.csv and evals/local-rules.json for trigger checks; missing skill.selection evidence is BLOCKED.
    
    ## Common Pitfalls
    
    - Do not turn a method name, file presence, or candidate count into test execution, coverage, pass, or release evidence when scope or evidence is incomplete.
    - Do not fill in missing rules, thresholds, data, environments, or results from convention; preserve unassessed, blocked, and pending items.
    - Do not expand this specialist design or review into a complete strategy, full test cases, runtime execution, or a release decision.
    
    ## Best Practices
    
    - Complete the six-part input audit before selecting the smallest traceable and verifiable finding scope.
    - Keep the source, evidence state, impact/priority, owner role, close condition, validation method, and residual risk for every finding.
    - Write validation suggestions as next actions; do not upgrade package structure, candidate counts, or local Eval configuration into real quality conclusions.
    

Comments (0)

Sign in to join the conversation.

No comments yet.

Reviews (0)

No reviews yet.

Related