#evals
1 skills & prompts · 2 tools · 6 MCP servers · 1 articles
Skills & prompts
agent-eval
Use when measuring whether an LLM or agent system actually got better and gating merges on it: golden sets, fixing an inflated LLM-as-judge, scoring RAG (faithfulness, contextual recall) or agent trajectories (tool correctness, completion), or picking an eval framework. NOT build
Tools
Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows.
Joy — a local-first personal assistant. Rust core (loop / memory / tools / graph / evals), TypeScript gateways + dashboard, Python thin SDK.
MCP servers
Evidence-gated verification, selection, and measurement MCP for coding agents.
Testing and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.
Live road conditions in 37 US states: incidents, closures, chain controls, cameras, wildfires.
Read-only research on tokens, Hyperliquid perps, Polymarket markets and your Ask Gina account.
Real cost per AI result, LLM prices, switch costs, shutdown dates, A/B test sizes and judge checks.
Open-source, local-first observability and evals for AI agents: see what Claude Code, Codex, Cursor and others did and what it cost.
Articles
Prompt testing: build a lightweight eval set
A prompt that works once isn't a quality system. Five cases, an observable rubric, and a regression set will tell you whether a change helped.