Skip to main content

​
Providers

Providers are the LLM services that power evaluations and optimizations in MutagenT. Configure them through the dashboard at app.mutagent.io/settings/providers and use the CLI to list, inspect, and test provider connections.

​
Supported Providers

ProviderModelsStatus
OpenAIGPT-5.4, GPT-5.3, GPT-5.2, o3, o3-mini, o4-miniSupported
AnthropicClaude Opus 4.6, Claude Sonnet 4.6, Claude Opus 4.5, Claude Sonnet 4.5, Claude Haiku 4.5Supported
Google AIGemini 3.1 Pro Preview, Gemini 3 Flash, Gemini 3.1 Flash LiteSupported
Azure OpenAIGPT-5.4, GPT-5.3, GPT-5.2 (hosted)Supported
AWS BedrockClaude (via AWS)Supported
X.AI (Grok)Grok modelsSupported
GroqLLaMA 4 Scout, Qwen 3, GPT-OSSSupported
MoonshotKimi K2.5Supported
Zhipu AI (GLM)GLM-5.1Supported
CustomAny OpenAI-compatible endpointSupported
Provider availability in the dashboard UI may differ from core platform support. Providers listed here are supported at the platform level.

​
Why Configure Providers?

MutagenT uses LLM providers for:
  • Evaluations - Judge models for G-Eval metrics and custom criteria
  • Optimization - Generating prompt variations during the mutation step
  • Embeddings - Semantic similarity calculations using embedding models

​
Provider Selection

Different operations may use different providers. Configure multiple providers for flexibility:
OperationTypical ProviderTypical Model
Evaluation (judge)AnthropicClaude Sonnet 4.6
Optimization (mutation)AnthropicClaude Sonnet 4.6
EmbeddingsOpenAItext-embedding-3-large

​
CLI Access

Use the CLI to list, inspect, and test providers. Configuration and credential management is done through the dashboard. 
# List all configured providers
mutagent providers list

# Get provider details (API key is masked)
mutagent providers get <provider-id>

# Test provider connection
mutagent providers test <provider-id>
Provider configuration is managed through the dashboard at Settings > Providers.

​
Provider Pre-flight Check

When starting an optimization via CLI, MutagenT automatically verifies that at least one configured provider is available before beginning the job. If no provider is configured, the CLI will display an error with instructions to configure one in the dashboard. 
# This checks for providers before starting
mutagent prompts optimize start 123 --dataset 456 --max-iterations 5

# If no provider is configured, you'll see:
# Error: No LLM provider configured.
# Configure a provider at: app.mutagent.io/settings/providers

​
Next Steps

Provider Setup

Step-by-step provider configuration guide