red-handed-audit
Check whether the tests the agent said passed actually ran. Reads the Claude Code session transcript and git state locally, then reports each gap with a timestamp and the quoted line. No model calls, nothing leaves the machine.
Install
npx skills add https://github.com/davepoon/buildwithclaude/tree/main/plugins/all-skills/skills/red-handed-audit
claude plugin marketplace add https://llmmart.ai/marketplace.json && claude plugin install davepoon-buildwithclaude@llmmart
git clone https://github.com/davepoon/buildwithclaude.git
The skills CLI installs just this skill, for any of its supported agents. Claude Code installs the whole davepoon/buildwithclaude collection as a plugin from our marketplace. Git is the plain clone.
Skill manifest
Red-handed Audit
Audit the current session's claims against its own record. If the agent said the tests pass, this checks that a test run actually happened, that it did not fail, and that no expected value was quietly rewritten to match a bug.
When to Use This Skill
- The agent reported passing tests and you want to confirm a run actually happened
- A test suite got smaller and you want to know when and why
- You are reviewing a finished session before trusting its summary
What This Skill Does
- Runs
npx --yes @jinhyuk9714/red-handed@latest auditin the project directory - The CLI reads the local Claude Code transcript and the git working tree
- Nine deterministic checks compare what was said with what was done
- Each finding comes with a timestamp and the quoted line it came from
No model is called. The same session gives the same verdict every time.
How to Use
Basic Usage
Audit this session. Did the tests I was told about actually run?
The skill runs:
npx --yes @jinhyuk9714/red-handed@latest audit
Useful variations:
npx --yes @jinhyuk9714/red-handed@latest audit --all # every session for this project
npx --yes @jinhyuk9714/red-handed@latest stats # counts across the whole machine
npx --yes @jinhyuk9714/red-handed@latest audit --lang ko # report in Korean
Example
User: "Before I merge this, check whether the tests really ran."
Output:
CAUGHT claim-vs-fail
14:02:31 "All 33 tests pass."
14:01:58 npx vitest run … exit 1, 2 failed
The last run before the claim failed. Nothing ran after it.
A clean session prints nothing to accuse. That is the common case.
Tips
CAUGHTneeds two things at once: the session shows it happening and the code still shows it nowSUSPICIOUSmeans the pattern is there but the motive is not established- Verification the tool cannot read counts as verification it did not see, so browser tests and custom scripts only ever reach
SUSPICIOUS - Exit code 1 means findings at the CAUGHT tier. That is the tool working, not an error
Files (buildwithclaude)
-
SKILL.md 2.4 KB
--- name: red-handed-audit description: "Check whether the tests the agent said passed actually ran. Reads the Claude Code session transcript and git state locally, then reports each gap with a timestamp and the quoted line. No model calls, nothing leaves the machine." category: development-code --- # Red-handed Audit Audit the current session's claims against its own record. If the agent said the tests pass, this checks that a test run actually happened, that it did not fail, and that no expected value was quietly rewritten to match a bug. ## When to Use This Skill - The agent reported passing tests and you want to confirm a run actually happened - A test suite got smaller and you want to know when and why - You are reviewing a finished session before trusting its summary ## What This Skill Does 1. Runs `npx --yes @jinhyuk9714/red-handed@latest audit` in the project directory 2. The CLI reads the local Claude Code transcript and the git working tree 3. Nine deterministic checks compare what was said with what was done 4. Each finding comes with a timestamp and the quoted line it came from No model is called. The same session gives the same verdict every time. ## How to Use ### Basic Usage ``` Audit this session. Did the tests I was told about actually run? ``` The skill runs: ```bash npx --yes @jinhyuk9714/red-handed@latest audit ``` Useful variations: ```bash npx --yes @jinhyuk9714/red-handed@latest audit --all # every session for this project npx --yes @jinhyuk9714/red-handed@latest stats # counts across the whole machine npx --yes @jinhyuk9714/red-handed@latest audit --lang ko # report in Korean ``` ## Example **User**: "Before I merge this, check whether the tests really ran." **Output**: ``` CAUGHT claim-vs-fail 14:02:31 "All 33 tests pass." 14:01:58 npx vitest run … exit 1, 2 failed The last run before the claim failed. Nothing ran after it. ``` A clean session prints nothing to accuse. That is the common case. ## Tips - `CAUGHT` needs two things at once: the session shows it happening and the code still shows it now - `SUSPICIOUS` means the pattern is there but the motive is not established - Verification the tool cannot read counts as verification it did not see, so browser tests and custom scripts only ever reach `SUSPICIOUS` - Exit code 1 means findings at the CAUGHT tier. That is the tool working, not an error
Comments (0)
Sign in to join the conversation.
Reviews (0)
No reviews yet.
No comments yet.