GitHub Copilot ChatGPT Claude Codex CLI Cursor opencode Skill Text

azure-aigateway

Configure Azure API Management as an AI Gateway for AI models, MCP tools, and agents. WHEN: semantic caching, token limit, content safety, load balancing, AI model governance, MCP rate limiting, jailbreak detection, add Azure OpenAI backend, add AI Foundry model, test AI gateway,

Ciza · 0 points · 26 views 1 listing impressions 0 install-command copies
Download microsoft-skills-.github_plugins_azure-skills_skills_azure-aigateway-e58528d.zip · 15 KB

Install

skills CLI npx skills add https://github.com/microsoft/skills/tree/main/.github/plugins/azure-skills/skills/azure-aigateway
Claude Code claude plugin marketplace add https://llmmart.ai/marketplace.json && claude plugin install microsoft-skills@llmmart
Git git clone https://github.com/microsoft/skills.git

The skills CLI installs just this skill, for any of its supported agents. Claude Code installs the whole microsoft/skills collection as a plugin from our marketplace. Git is the plain clone.

Skill manifest

Azure AI Gateway

Configure Azure API Management (APIM) as an AI Gateway for governing AI models, MCP tools, and agents.

To deploy APIM, use the azure-prepare skill. See APIM deployment guide.

When to Use This Skill

Category Triggers
Model Governance "semantic caching", "token limits", "load balance AI", "track token usage"
Tool Governance "rate limit MCP", "protect my tools", "configure my tool", "convert API to MCP"
Agent Governance "content safety", "jailbreak detection", "filter harmful content"
Configuration "add Azure OpenAI backend", "configure my model", "add AI Foundry model"
Testing "test AI gateway", "call OpenAI through gateway"

Quick Reference

Policy Purpose Details
azure-openai-token-limit Cost control Model Policies
azure-openai-semantic-cache-lookup/store 60-80% cost savings Model Policies
azure-openai-emit-token-metric Observability Model Policies
llm-content-safety Safety & compliance Agent Policies
rate-limit-by-key MCP/tool protection Tool Policies

Get Gateway Details

# Get gateway URL
az apim show --name <apim-name> --resource-group <rg> --query "gatewayUrl" -o tsv

# List backends (AI models)
az apim backend list --service-name <apim-name> --resource-group <rg> \
  --query "[].{id:name, url:url}" -o table

# Get subscription key
az apim subscription keys list \
  --service-name <apim-name> --resource-group <rg> --subscription-id <sub-id>

Test AI Endpoint

GATEWAY_URL=$(az apim show --name <apim-name> --resource-group <rg> --query "gatewayUrl" -o tsv)

curl -X POST "${GATEWAY_URL}/openai/deployments/<deployment>/chat/completions?api-version=2024-02-01" \
  -H "Content-Type: application/json" \
  -H "Ocp-Apim-Subscription-Key: <key>" \
  -d '{"messages": [{"role": "user", "content": "Hello"}], "max_tokens": 100}'

Common Tasks

Add AI Backend

See references/patterns.md for full steps.

# Discover AI resources
az cognitiveservices account list --query "[?kind=='OpenAI']" -o table

# Create backend
az apim backend create --service-name <apim> --resource-group <rg> \
  --backend-id openai-backend --protocol http --url "https://<aoai>.openai.azure.com/openai"

# Grant access (managed identity)
az role assignment create --assignee <apim-principal-id> \
  --role "Cognitive Services User" --scope <aoai-resource-id>

Apply AI Governance Policy

Recommended policy order in <inbound>:

  1. Authentication - Managed identity to backend
  2. Semantic Cache Lookup - Check cache before calling AI
  3. Token Limits - Cost control
  4. Content Safety - Filter harmful content
  5. Backend Selection - Load balancing
  6. Metrics - Token usage tracking

See references/policies.md for complete example.


Troubleshooting

Issue Solution
Token limit 429 Increase tokens-per-minute or add load balancing
No cache hits Lower score-threshold to 0.7
Content false positives Increase category thresholds (5-6)
Backend auth 401 Grant APIM "Cognitive Services User" role

See references/troubleshooting.md for details.


References

SDK Quick References

Files (skills)
  • references
    • sdk
      • azure-ai-contentsafety-py.md 1.3 KB
        Loading…
      • azure-ai-contentsafety-ts.md 1.4 KB
        Loading…
      • azure-mgmt-apimanagement-dotnet.md 1.3 KB
        Loading…
      • azure-mgmt-apimanagement-py.md 1 KB
        Loading…
    • auth-best-practices.md 6.1 KB
      Loading…
    • patterns.md 6.6 KB
      Loading…
    • policies.md 9.2 KB
      Loading…
    • troubleshooting.md 7.7 KB
      Loading…
  • SKILL.md 4.9 KB
    ---
    name: azure-aigateway
    description: "Configure Azure API Management as an AI Gateway for AI models, MCP tools, and agents. WHEN: semantic caching, token limit, content safety, load balancing, AI model governance, MCP rate limiting, jailbreak detection, add Azure OpenAI backend, add AI Foundry model, test AI gateway, LLM policies, configure AI backend, token metrics, AI cost control, convert API to MCP, import OpenAPI to gateway."
    license: MIT
    metadata:
      author: Microsoft
      version: "3.2.1"
    compatibility: Requires Azure CLI (az) for configuration and testing
    ---
    
    # Azure AI Gateway
    
    Configure Azure API Management (APIM) as an AI Gateway for governing AI models, MCP tools, and agents.
    
    > **To deploy APIM**, use the **azure-prepare** skill. See [APIM deployment guide](https://learn.microsoft.com/azure/api-management/get-started-create-service-instance).
    
    ## When to Use This Skill
    
    | Category | Triggers |
    |----------|----------|
    | **Model Governance** | "semantic caching", "token limits", "load balance AI", "track token usage" |
    | **Tool Governance** | "rate limit MCP", "protect my tools", "configure my tool", "convert API to MCP" |
    | **Agent Governance** | "content safety", "jailbreak detection", "filter harmful content" |
    | **Configuration** | "add Azure OpenAI backend", "configure my model", "add AI Foundry model" |
    | **Testing** | "test AI gateway", "call OpenAI through gateway" |
    
    ---
    
    ## Quick Reference
    
    | Policy | Purpose | Details |
    |--------|---------|---------|
    | `azure-openai-token-limit` | Cost control | [Model Policies](references/policies.md#token-rate-limiting) |
    | `azure-openai-semantic-cache-lookup/store` | 60-80% cost savings | [Model Policies](references/policies.md#semantic-caching) |
    | `azure-openai-emit-token-metric` | Observability | [Model Policies](references/policies.md#token-metrics) |
    | `llm-content-safety` | Safety & compliance | [Agent Policies](references/policies.md#content-safety) |
    | `rate-limit-by-key` | MCP/tool protection | [Tool Policies](references/policies.md#request-rate-limiting) |
    
    ---
    
    ## Get Gateway Details
    
    ```bash
    # Get gateway URL
    az apim show --name <apim-name> --resource-group <rg> --query "gatewayUrl" -o tsv
    
    # List backends (AI models)
    az apim backend list --service-name <apim-name> --resource-group <rg> \
      --query "[].{id:name, url:url}" -o table
    
    # Get subscription key
    az apim subscription keys list \
      --service-name <apim-name> --resource-group <rg> --subscription-id <sub-id>
    ```
    
    ---
    
    ## Test AI Endpoint
    
    ```bash
    GATEWAY_URL=$(az apim show --name <apim-name> --resource-group <rg> --query "gatewayUrl" -o tsv)
    
    curl -X POST "${GATEWAY_URL}/openai/deployments/<deployment>/chat/completions?api-version=2024-02-01" \
      -H "Content-Type: application/json" \
      -H "Ocp-Apim-Subscription-Key: <key>" \
      -d '{"messages": [{"role": "user", "content": "Hello"}], "max_tokens": 100}'
    ```
    
    ---
    
    ## Common Tasks
    
    ### Add AI Backend
    
    See [references/patterns.md](references/patterns.md#pattern-1-add-ai-model-backend) for full steps.
    
    ```bash
    # Discover AI resources
    az cognitiveservices account list --query "[?kind=='OpenAI']" -o table
    
    # Create backend
    az apim backend create --service-name <apim> --resource-group <rg> \
      --backend-id openai-backend --protocol http --url "https://<aoai>.openai.azure.com/openai"
    
    # Grant access (managed identity)
    az role assignment create --assignee <apim-principal-id> \
      --role "Cognitive Services User" --scope <aoai-resource-id>
    ```
    
    ### Apply AI Governance Policy
    
    Recommended policy order in `<inbound>`:
    
    1. **Authentication** - Managed identity to backend
    2. **Semantic Cache Lookup** - Check cache before calling AI
    3. **Token Limits** - Cost control
    4. **Content Safety** - Filter harmful content
    5. **Backend Selection** - Load balancing
    6. **Metrics** - Token usage tracking
    
    See [references/policies.md](references/policies.md#combining-policies) for complete example.
    
    ---
    
    ## Troubleshooting
    
    | Issue | Solution |
    |-------|----------|
    | Token limit 429 | Increase `tokens-per-minute` or add load balancing |
    | No cache hits | Lower `score-threshold` to 0.7 |
    | Content false positives | Increase category thresholds (5-6) |
    | Backend auth 401 | Grant APIM "Cognitive Services User" role |
    
    See [references/troubleshooting.md](references/troubleshooting.md) for details.
    
    ---
    
    ## References
    
    - [**Detailed Policies**](references/policies.md) - Full policy examples
    - [**Configuration Patterns**](references/patterns.md) - Step-by-step patterns
    - [**Troubleshooting**](references/troubleshooting.md) - Common issues
    - [AI-Gateway Samples](https://github.com/Azure-Samples/AI-Gateway)
    - [GenAI Gateway Docs](https://learn.microsoft.com/azure/api-management/genai-gateway-capabilities)
    
    ## SDK Quick References
    
    - **Content Safety**: [Python](references/sdk/azure-ai-contentsafety-py.md) | [TypeScript](references/sdk/azure-ai-contentsafety-ts.md)
    - **API Management**: [Python](references/sdk/azure-mgmt-apimanagement-py.md) | [.NET](references/sdk/azure-mgmt-apimanagement-dotnet.md)
    

Comments (0)

Sign in to join the conversation.

No comments yet.

Reviews (0)

No reviews yet.