data-processing
Process JSON with jq and YAML/TOML with yq. Filter, transform, query structured data efficiently. Triggers on: parse JSON, extract from YAML, query config, Docker Compose, K8s manifests, GitHub Actions workflows, package.json, filter data.
Install
npx skills add https://github.com/0xDarkMatter/claude-mods/tree/main/skills/data-processing
claude plugin marketplace add https://llmmart.ai/marketplace.json && claude plugin install 0xdarkmatter-claude-mods@llmmart
git clone https://github.com/0xDarkMatter/claude-mods.git
The skills CLI installs just this skill, for any of its supported agents. Claude Code installs the whole 0xdarkmatter/claude-mods collection as a plugin from our marketplace. Git is the plain clone.
Skill manifest
Data Processing
Query, filter, and transform structured data (JSON, YAML, TOML) efficiently from the command line.
Tools
| Tool | Command | Use For |
|---|---|---|
| jq | jq '.key' file.json |
JSON processing |
| yq | yq '.key' file.yaml |
YAML/TOML processing |
jq Essentials
# Extract single field
jq '.name' package.json
# Extract nested field
jq '.scripts.build' package.json
# Extract from array
jq '.dependencies[0]' package.json
# Extract multiple fields
jq '{name, version}' package.json
# Navigate deeply nested
jq '.data.users[0].profile.email' response.json
# Filter by condition
jq '.users[] | select(.active == true)' data.json
# Transform each element
jq '.users | map({id, name})' data.json
# Count elements
jq '.users | length' data.json
# Raw string output
jq -r '.name' package.json
yq Essentials
# Extract field
yq '.name' config.yaml
# Extract nested
yq '.services.web.image' docker-compose.yml
# List all keys
yq 'keys' config.yaml
# List all service names (Docker Compose)
yq '.services | keys' docker-compose.yml
# Get container images (K8s)
yq '.spec.template.spec.containers[].image' deployment.yaml
# Update value (in-place)
yq -i '.version = "2.0.0"' config.yaml
# TOML to JSON
yq -p toml -o json '.' config.toml
Quick Reference
| Task | jq | yq |
|---|---|---|
| Get field | jq '.key' |
yq '.key' |
| Array element | jq '.[0]' |
yq '.[0]' |
| Filter array | jq '.[] \| select(.x)' |
yq '.[] \| select(.x)' |
| Transform | jq 'map(.x)' |
yq 'map(.x)' |
| Count | jq 'length' |
yq 'length' |
| Keys | jq 'keys' |
yq 'keys' |
| Pretty print | jq '.' |
yq '.' |
| Compact | jq -c |
yq -o json -I0 |
| Raw output | jq -r |
yq -r |
| In-place edit | - | yq -i |
When to Use
- Reading package.json dependencies
- Parsing Docker Compose configurations
- Analyzing Kubernetes manifests
- Processing GitHub Actions workflows
- Extracting data from API responses
- Filtering large JSON datasets
- Config file manipulation
- Data format conversion
Additional Resources
For complete pattern libraries, load:
./references/jq-patterns.md- Arrays, filtering, transformation, aggregation, output formatting./references/yq-patterns.md- Docker Compose, K8s, GitHub Actions, TOML, YAML modification./references/config-files.md- package.json, tsconfig, eslint/prettier patterns
Files (claude-mods)
-
assets
-
.gitkeep 0 B · in bundle
-
-
references
-
config-files.md 794 B
Loading… -
jq-patterns.md 3.2 KB
Loading… -
yq-patterns.md 1.9 KB
Loading…
-
-
scripts
-
.gitkeep 0 B · in bundle
-
-
SKILL.md 2.8 KB
--- name: data-processing description: "Process JSON with jq and YAML/TOML with yq. Filter, transform, query. Triggers on: parse JSON, extract from YAML, query config, Docker Compose, K8s manifests, GitHub Actions workflows, package.json, filter data." license: MIT compatibility: "Requires jq and yq CLI tools. Install: brew install jq yq (macOS)." allowed-tools: "Bash Read" metadata: author: claude-mods --- # Data Processing Query, filter, and transform structured data (JSON, YAML, TOML) efficiently from the command line. ## Tools | Tool | Command | Use For | |------|---------|---------| | jq | `jq '.key' file.json` | JSON processing | | yq | `yq '.key' file.yaml` | YAML/TOML processing | ## jq Essentials ```bash # Extract single field jq '.name' package.json # Extract nested field jq '.scripts.build' package.json # Extract from array jq '.dependencies[0]' package.json # Extract multiple fields jq '{name, version}' package.json # Navigate deeply nested jq '.data.users[0].profile.email' response.json # Filter by condition jq '.users[] | select(.active == true)' data.json # Transform each element jq '.users | map({id, name})' data.json # Count elements jq '.users | length' data.json # Raw string output jq -r '.name' package.json ``` ## yq Essentials ```bash # Extract field yq '.name' config.yaml # Extract nested yq '.services.web.image' docker-compose.yml # List all keys yq 'keys' config.yaml # List all service names (Docker Compose) yq '.services | keys' docker-compose.yml # Get container images (K8s) yq '.spec.template.spec.containers[].image' deployment.yaml # Update value (in-place) yq -i '.version = "2.0.0"' config.yaml # TOML to JSON yq -p toml -o json '.' config.toml ``` ## Quick Reference | Task | jq | yq | |------|----|----| | Get field | `jq '.key'` | `yq '.key'` | | Array element | `jq '.[0]'` | `yq '.[0]'` | | Filter array | `jq '.[] \| select(.x)'` | `yq '.[] \| select(.x)'` | | Transform | `jq 'map(.x)'` | `yq 'map(.x)'` | | Count | `jq 'length'` | `yq 'length'` | | Keys | `jq 'keys'` | `yq 'keys'` | | Pretty print | `jq '.'` | `yq '.'` | | Compact | `jq -c` | `yq -o json -I0` | | Raw output | `jq -r` | `yq -r` | | In-place edit | - | `yq -i` | ## When to Use - Reading package.json dependencies - Parsing Docker Compose configurations - Analyzing Kubernetes manifests - Processing GitHub Actions workflows - Extracting data from API responses - Filtering large JSON datasets - Config file manipulation - Data format conversion ## Additional Resources For complete pattern libraries, load: - `./references/jq-patterns.md` - Arrays, filtering, transformation, aggregation, output formatting - `./references/yq-patterns.md` - Docker Compose, K8s, GitHub Actions, TOML, YAML modification - `./references/config-files.md` - package.json, tsconfig, eslint/prettier patterns
Comments (0)
Sign in to join the conversation.
Reviews (0)
No reviews yet.
No comments yet.