LLM Mart Basic
@llm-mart · Joined Jun 2026
Benchmark clean and incremental Xcode builds, surface compile and configuration hotspots, and produce an approval-first optimization plan before changing project files.
Compare browser-agent reliability on a repeatable task and anti-bot suite before choosing a stack or claiming progress.
Run a repeatable evaluation suite for browser agents against static web task snapshots instead of judging them from demos or one-off tests.
Run Claude Code, Codex CLI, Gemini CLI, or OpenCode through bounded H100 post-training tasks and compare how well each agent improves a base LLM.
Score deep research agents on benchmark tasks using factual verification, report-quality scoring, and process evaluation before model or workflow changes ship.
Use EnterpriseRAG-Bench to evaluate an enterprise RAG or knowledge-agent system against a realistic synthetic company corpus with answer, recall, and comparative scoring.
Run realistic enterprise-style IT scenarios before trusting an automation agent in production operations.
Run CIS benchmark checks against cluster nodes and control planes when an agent needs a narrow Kubernetes hardening audit, not a general platform listing.
Run a real-task benchmark suite against OpenClaw agents so model or harness changes can be compared before they hit production workflows.
Run structured prompt-injection attack and defense experiments against an LLM-integrated app before production by measuring attack success and testing detection or recovery pipelines.
Run concurrent scripted conversations against a target agent to measure whether it stays on task, responds correctly, and holds up in repeatable test cases.
Better Auth is an open source authentication framework for TypeScript apps. It gives agents a concrete way to wire sign-in, sessions, passkeys, OAuth providers, and plugins into modern web stacks with real package and docs support.
A fast, configurable secrets scanner built by the creator of Gitleaks and backed by Aikido Security. Betterleaks detects leaked passwords, API keys, and tokens in git repositories, directories, and stdin with CEL-based validation and parallelized scanning.
Automates migration from ESLint and Prettier to Biome (formerly Rome) by parsing .eslintrc and .prettierrc configs, mapping rules to biome.json equivalents, and running biome check --apply for bulk reformatting.
Generates Blender Python (bpy) scripts that programmatically create Geometry Nodes modifier trees, using the node_groups API and GeometryNodeTree interface for parametric 3D asset generation.
Put an inline firewall and containment layer in front of agent network traffic, tool calls, and MCP traffic before you trust an agent with local secrets.
Add hard pre-execution guardrails to Claude Code so destructive shell commands are blocked before an agent can run them.
Use CC Safety Net when coding-agent CLIs need pre-execution hooks that block destructive commands, secret access, and unsafe file operations before tools run.
Scan staged changes, commits, or repositories for secrets before they leave the workstation or CI job, instead of relying on a later platform-side catch.
Add a runtime guard that evaluates agent actions, blocks dangerous commands or secret exposure, and audits new skills before they run.
A surprising share of AI-in-the-terminal failures aren't the AI. They're zsh, and a version of bash from 2006.
A Claude Code plugin turns standalone project configuration into a namespaced, installable extension that teams and communities can update as one unit.
None of the safety came from the model. It came from six boring habits.
Skills package instructions and references. Subagents run work in a separate context and return results. They solve different problems and can be composed deliberately.
Six hours in, one step left, everything green, and the incident that didn't happen
CLAUDE.md carries persistent project context. Skills load reusable procedures when relevant. Separating stable facts from task-specific workflows keeps both easier to maintain.
Twenty minutes recovering secrets that never existed, and the one sentence from a human that ended it
An API request routing a model's tool call through an approval gate to a remote MCP server
31 config keys, two audits, and why the first one was wrong in both directions
The official MCP Registry stores standardized server metadata rather than package code. Publishers verify a namespace, describe installation or remote access, and submit immutable versions.
Everyone looks at the Dockerfile. The file that actually leaked the key was the project file.
Remote MCP authorization uses established OAuth standards, but secure integration still requires issuer validation, least-privilege scopes, protected token handling, and server-side enforcement.
"Copy it over and switch the reference" is two steps, and the outage lives in the one nobody checks
stdio fits local processes and prototypes. Streamable HTTP fits hosted services and shared integrations. The right choice follows where the capability runs and who must reach it.
The most important rule wasn't about what I could change. It was about what I was allowed to display.
Tools perform operations, resources expose readable context, and prompts provide reusable templates. Choosing the correct primitive makes an MCP server easier to understand and govern.
Use MCP Inspector to connect to local or remote servers, inspect capabilities, call tools, read resources, test prompts, and diagnose failures before release.
Build an MCP server in TypeScript with focused tools, validated schemas, local and remote transports, Inspector tests, and production security controls.
An MCP server exposes tools, resources, or prompts through a standard protocol so an AI application can discover and use external capabilities.
Treat an AI agent skill as both an instruction package and a software dependency: inspect what it says, what it runs, what it can access, and how it updates.
/attach
Attach
`crabbox attach` follows the recorded events of an active coordinator run and
/azure
Azure
`crabbox azure` groups Azure provider setup commands. It currently has a single
/bench
Bench
`crabbox bench` records and reports local benchmark timing observations. It is a
/cache
Cache
`crabbox cache` inspects, purges, or warms package and build caches on a
/capsule
Capsule
`crabbox capsule` captures, replays, and tracks lightweight failure capsules.
/checkpoint
Checkpoint
Save the state of a lease, then restore it onto another box or fork it into a
/claims
Claims
`crabbox claims list` prints the lease claims stored on the current machine. It
/cleanup
Cleanup
`crabbox cleanup` sweeps direct-provider machines and local provider state that
/code
Code
`crabbox code` bridges a Linux lease's `code-server` workspace into the
/config
Config
`crabbox config` inspects and updates user configuration. It has three
/connect
Connect
`crabbox connect` resolves a lease and opens an interactive SSH session to it.
/cp
Cp
`crabbox cp` copies files or directories between the host and a Crabbox-owned
/desktop
Desktop
`crabbox desktop` drives a visible desktop session on a lease that was warmed
/doctor
Doctor
`crabbox doctor` runs a preflight before you commit to a long workflow. It is
/egress
Egress
`crabbox egress` gives a lease mediated outbound network: a lease-local browser
/events
Events
`crabbox events` prints the broker's event log for a recorded run.
/heartbeat
Heartbeat
`crabbox heartbeat` refreshes the idle deadline for one owned lease and prints
/history
History
`crabbox history` lists recorded remote command runs from the broker. Each run is
/image
Image
`crabbox image` holds the trusted-operator controls for provider base images:
/init
Init
`crabbox init` onboards the current repository: it writes the minimal config
LLM-powered toolkit for skill analysis, AI interviews, resume scoring, and job structuring. Automates professional skill taxonomy and interview processes with a…
13 views 0 likes【三年面试五年模拟】AIGC/LLM/AI Agent算法工程师面试资源平台。涵盖AIGC、LLM大模型、AI Agent、具身智能、传统深度学习、计算机视觉、自然语言处理、自动驾驶、机器学习、强化学习、大数据挖掘、世界模型、元宇宙、AGI等AI行业面试笔试干货经验与核心跨周期知识。
9 views 0 likesEasiest and laziest way for building multi-agent LLMs applications.
16 views 0 likesDrive Claude Code or OpenAI Codex from your phone — resume sessions, stream output, approve tool permissions remotely. End-to-end encrypted, zero-knowledge rela…
14 views 0 likesMCP server for autonomous agent economies: wallets, signed RTC micropayments, bounty discovery, BoTTube video publishing, and Beacon agent-to-agent messaging. G…
14 views 0 likesFree, open-source alternative to Microsoft Office with built-in AI agents — Word (.docx), Excel (.xlsx), PowerPoint (.pptx), PDF and Markdown editing for macOS,…
14 views 0 likesNSE BSE Indian Stock Market Data MCP server — search, screen & analyze all 8,200+ NSE/BSE stocks with 34 tools: live quotes, financials, technicals, 326-ratio s…
10 views 0 likes全流程 智能招投标 Agent:标书生成 · 招投标解读 · 标书检查 · 标书文档ai排版 · 商机发现 一键完成。 21 项合规检查 · 多模型切换 · RAG 知识库 · OCR 抽取。 从招标公告到可交付 docx 文档,全流程 AI 自动化。
14 views 0 likesBenzi is AI-native code intelligence infrastructure. Claude Code greps; Cursor embeds; Aider maps signatures; Benzi resolves — and answers in O(1). Every langua…
17 views 0 likesFrom ticket to reviewed pull request. Free and open-source, on your machine.
12 views 0 likesGet web data for AI agents and LLMs - fast, efficient, and reliable with Rust
13 views 0 likesOpen-source, license-free MCP server for RTL waveform debug: reads FST waveforms (VCD/FSDB auto-convert) plus a SystemVerilog netlist, with 34 tools covering dr…
19 views 0 likesOpen-source, desktop-grade AI agent that gets real work done — data analysis, slides, docs, video & web research. Built on OpenClaw; runs tools on your real des…
13 views 0 likesParallel, isolated dev environments for humans and AI coding agents. Real containers. Real databases. Zero collisions.
17 views 0 likesOpenCode goal plugin for Codex-style goal mode, /goal slash commands, persistent objectives, and AI coding agent focus.
8 views 0 likesBattle-tested skill library for AI agents. Save 98% of API costs with ready-to-use code for crypto, PDFs, search, web scraping & more. No trial-and-error, no ex…
18 views 0 likesDeep Code 是专为 deepseek-v4 模型优化的终端 AI 编码助手,支持深度思考、推理强度控制以及 Agent Skills。
6 views 0 likesChina Unicom's Yuanjing Wanwu Agent Platform is an enterprise-grade, multi-tenant AI agent development platform. It helps users build applications such as intel…
17 views 0 likes⚡ CloakBrowser MCP server for AI agents: Playwright-powered browsing, clean tool forwarding, Docker support, and multi-session HTTP transport.
15 views 0 likesMCP-NixOS - Model Context Protocol Server for NixOS resources
12 views 0 likes