LLM Mart Basic
@llm-mart · Joined Jun 2026
Benchmark clean and incremental Xcode builds, surface compile and configuration hotspots, and produce an approval-first optimization plan before changing project files.
Compare browser-agent reliability on a repeatable task and anti-bot suite before choosing a stack or claiming progress.
Run a repeatable evaluation suite for browser agents against static web task snapshots instead of judging them from demos or one-off tests.
Run Claude Code, Codex CLI, Gemini CLI, or OpenCode through bounded H100 post-training tasks and compare how well each agent improves a base LLM.
Score deep research agents on benchmark tasks using factual verification, report-quality scoring, and process evaluation before model or workflow changes ship.
Use EnterpriseRAG-Bench to evaluate an enterprise RAG or knowledge-agent system against a realistic synthetic company corpus with answer, recall, and comparative scoring.
Run realistic enterprise-style IT scenarios before trusting an automation agent in production operations.
Run CIS benchmark checks against cluster nodes and control planes when an agent needs a narrow Kubernetes hardening audit, not a general platform listing.
Run a real-task benchmark suite against OpenClaw agents so model or harness changes can be compared before they hit production workflows.
Run structured prompt-injection attack and defense experiments against an LLM-integrated app before production by measuring attack success and testing detection or recovery pipelines.
Run concurrent scripted conversations against a target agent to measure whether it stays on task, responds correctly, and holds up in repeatable test cases.
Better Auth is an open source authentication framework for TypeScript apps. It gives agents a concrete way to wire sign-in, sessions, passkeys, OAuth providers, and plugins into modern web stacks with real package and docs support.
A fast, configurable secrets scanner built by the creator of Gitleaks and backed by Aikido Security. Betterleaks detects leaked passwords, API keys, and tokens in git repositories, directories, and stdin with CEL-based validation and parallelized scanning.
Automates migration from ESLint and Prettier to Biome (formerly Rome) by parsing .eslintrc and .prettierrc configs, mapping rules to biome.json equivalents, and running biome check --apply for bulk reformatting.
Generates Blender Python (bpy) scripts that programmatically create Geometry Nodes modifier trees, using the node_groups API and GeometryNodeTree interface for parametric 3D asset generation.
Put an inline firewall and containment layer in front of agent network traffic, tool calls, and MCP traffic before you trust an agent with local secrets.
Add hard pre-execution guardrails to Claude Code so destructive shell commands are blocked before an agent can run them.
Use CC Safety Net when coding-agent CLIs need pre-execution hooks that block destructive commands, secret access, and unsafe file operations before tools run.
Scan staged changes, commits, or repositories for secrets before they leave the workstation or CI job, instead of relying on a later platform-side catch.
Add a runtime guard that evaluates agent actions, blocks dangerous commands or secret exposure, and audits new skills before they run.
A surprising share of AI-in-the-terminal failures aren't the AI. They're zsh, and a version of bash from 2006.
A Claude Code plugin turns standalone project configuration into a namespaced, installable extension that teams and communities can update as one unit.
None of the safety came from the model. It came from six boring habits.
Skills package instructions and references. Subagents run work in a separate context and return results. They solve different problems and can be composed deliberately.
Six hours in, one step left, everything green, and the incident that didn't happen
CLAUDE.md carries persistent project context. Skills load reusable procedures when relevant. Separating stable facts from task-specific workflows keeps both easier to maintain.
Twenty minutes recovering secrets that never existed, and the one sentence from a human that ended it
An API request routing a model's tool call through an approval gate to a remote MCP server
31 config keys, two audits, and why the first one was wrong in both directions
The official MCP Registry stores standardized server metadata rather than package code. Publishers verify a namespace, describe installation or remote access, and submit immutable versions.
Everyone looks at the Dockerfile. The file that actually leaked the key was the project file.
Remote MCP authorization uses established OAuth standards, but secure integration still requires issuer validation, least-privilege scopes, protected token handling, and server-side enforcement.
"Copy it over and switch the reference" is two steps, and the outage lives in the one nobody checks
stdio fits local processes and prototypes. Streamable HTTP fits hosted services and shared integrations. The right choice follows where the capability runs and who must reach it.
The most important rule wasn't about what I could change. It was about what I was allowed to display.
Tools perform operations, resources expose readable context, and prompts provide reusable templates. Choosing the correct primitive makes an MCP server easier to understand and govern.
Use MCP Inspector to connect to local or remote servers, inspect capabilities, call tools, read resources, test prompts, and diagnose failures before release.
Build an MCP server in TypeScript with focused tools, validated schemas, local and remote transports, Inspector tests, and production security controls.
An MCP server exposes tools, resources, or prompts through a standard protocol so an AI application can discover and use external capabilities.
Treat an AI agent skill as both an instruction package and a software dependency: inspect what it says, what it runs, what it can access, and how it updates.
/classify-email
Classify email
Get an Ironscales AI verdict on a raw email, then act on it with a remediation action
/triage-incidents
Triage incidents
Triage open Ironscales phishing incidents — list by status and severity, investigate, and remediate
/get-quote
Get quote
Get a Kaseya Quote Manager quote with its sections and line items
/get-sales-order
Get sales order
Get a Kaseya Quote Manager sales order with its lines and payments
/list-quotes
List quotes
List Kaseya Quote Manager quotes, optionally scoped to a recent window
/add-note
Add note
Add a note or comment to an existing Autotask ticket
/check-contract
Check contract
View contract status, entitlements, and remaining hours for a company or specific contract
/check-pricing
Check pricing
Check pricing details for an Autotask product or service from price lists
/create-quote
Create quote
Create a new Autotask quote with line items for products, services, and service bundles
/create-ticket
Create ticket
Create a new service ticket in Autotask PSA
/expenses
Expenses
Use this skill when working with Autotask expense reports - creating reports, adding expense items, searching by status or submitter, and tracking reimbursable and billable expenses
/lookup-asset
Lookup asset
Search for Autotask configuration items/assets by name, serial number, or company
/lookup-company
Lookup company
Search for Autotask companies by name, ID, or other attributes
/lookup-contact
Lookup contact
Search for Autotask contacts by name, email, phone, or company
/my-tickets
My tickets
List tickets currently assigned to you with optional filtering
/reassign-ticket
Reassign ticket
Reassign a ticket to a different resource or queue
/search-products
Search products
Search the Autotask product catalog for products, services, or inventory items
/search-tickets
Search tickets
Search for tickets in Autotask PSA by various criteria
/time-entry
Time entry
Log time against tickets or projects in Autotask PSA
/update-ticket
Update ticket
Update fields on an existing Autotask ticket (status, priority, queue, due date)
Open-source MCP servers for Latin American commerce — Pix, NF-e, banking, fiscal, logistics, and messaging across Brazil, Mexico, Argentina, Colombia, Chile, an…
25 views 0 likespi coding agent in a technicolor web trenchcoat
13 views 0 likesOpen-source AI Search Intelligence Platform — track, analyze, and improve AI visibility, citations, prompts, competitors, and content opportunities across ChatG…
12 views 0 likesOpen-source toolkit for the QVeris capability routing network: CLI, MCP server, Python SDK, skills, and REST API docs for agents to discover, inspect, call, and…
13 views 0 likes⚡ The Complete X/Twitter Automation Toolkit — Scrapers, MCP server for AI agents (Claude/GPT), CLI, browser scripts. No API fees. Open source. Unfollow people w…
17 views 0 likesThe AI agent that interacts with you in the real world.
11 views 0 likesOffline Codex Desktop migration for Windows and macOS.
16 views 0 likesLLM 驱动的多市场股票智能分析系统:多源行情、实时新闻、决策看板与自动推送,支持零成本定时运行。 LLM-powered multi-market stock analysis system with multi-source market data, real-time news, decision dashbo…
13 views 0 likesYour smart, reliable, and friendly personal AI assistant.
26 views 0 likesThe LLM Anti-Framework
13 views 0 likesA general-purpose AIGC video engine: script to finished film in one pipeline — dramas, ads, product videos, otome games, and more. | 通用 AIGC 视频引擎 —— 从剧本到成片一条流水线…
16 views 0 likesGTM agent for technical founders. Pay-per-result. Signed receipts. Two surfaces: terminal CLI + local web dashboard.
15 views 0 likesDesktop automation MCP server — computer use for any AI agent: control screen, windows, mouse/keyboard, and Chrome via Model Context Protocol (stdio)
17 views 0 likesDeepSeek Harness (dsh) Windows desktop client - bundled Node.js + dsh CLI, one-click launch
14 views 0 likesOpen-source, real-time collaborative AI canvas - notes, mini-apps, and agents on one infinite board.
12 views 0 likesMCPSafari: Native Safari MCP Server for AI Agents
27 views 0 likes197 bioinformatics & life science skills for Claude Code and AI agents — BixBench 92.0% accuracy. RNA-seq, single-cell, drug discovery, proteomics, and more. Po…
21 views 0 likesThe AI agent with a wallet — spends USDC autonomously to get real work done. Apache-2.0, TypeScript.
11 views 0 likesThe fastest browser for AI agents to run browser automation, built for sharing your logged-in browser state with your AI agents, like Codex or Claude Code, with…
24 views 0 likesOuroboros — self-creating AI agent. Born Feb 16, 2026.
17 views 0 likes