Skip to main content

​
Provider Setup

Configure LLM providers to enable evaluations and optimization. Providers are managed through the dashboard. Use the CLI to verify and test your provider connections.

​
Dashboard Configuration

All provider configuration is done through the MutagenT dashboard:
1

Navigate to Settings

Go to app.mutagent.io/settings/providers
2

Add Provider

Click Add Provider and select your provider type
3

Enter Credentials

Provide your API key and any required configuration
4

Test Connection

Click Test Connection to verify the provider works
5

Save

Click Save to store the encrypted configuration

​
OpenAI

​
Dashboard Setup

  1. Go to Settings > Providers
  2. Click Add Provider > OpenAI
  3. Enter your OpenAI API key (sk-...)
  4. Select default model (e.g., gpt-5)
  5. Optionally set organization ID
  6. Click Save

​
Required Fields

FieldDescriptionExample
API KeyYour OpenAI API keysk-proj-...
Default ModelDefault model for operationsgpt-5
OrganizationOpenAI organization ID (optional)org-...

​
Anthropic

​
Dashboard Setup

  1. Go to Settings > Providers
  2. Click Add Provider > Anthropic
  3. Enter your Anthropic API key (sk-ant-...)
  4. Select default model (e.g., claude-sonnet-4-6)
  5. Click Save

​
Required Fields

FieldDescriptionExample
API KeyYour Anthropic API keysk-ant-...
Default ModelDefault model for operationsclaude-sonnet-4-6

​
Google AI (Gemini)

​
Dashboard Setup

  1. Go to Settings > Providers
  2. Click Add Provider > Google AI
  3. Enter your Google AI API key (AIza...)
  4. Select default model (e.g., gemini-3-flash)
  5. Click Save

​
Required Fields

FieldDescriptionExample
API KeyYour Google AI API keyAIza...
Default ModelDefault model for operationsgemini-3-flash

​
Azure OpenAI

​
Dashboard Setup

  1. Go to Settings > Providers
  2. Click Add Provider > Azure OpenAI
  3. Enter your Azure OpenAI credentials
  4. Click Save

​
Required Fields

FieldDescriptionExample
API KeyYour Azure OpenAI API keyabc123...
EndpointAzure resource endpointhttps://your-resource.openai.azure.com/
Deployment NameModel deployment namegpt-5
API VersionAzure API version2024-12-01-preview

​
AWS Bedrock

​
Dashboard Setup

  1. Go to Settings > Providers
  2. Click Add Provider > AWS Bedrock
  3. Enter your AWS credentials
  4. Click Save

​
Required Fields

FieldDescriptionExample
Access Key IDAWS access keyAKIA...
Secret Access KeyAWS secret keywJalr...
RegionAWS regionus-east-1
Default ModelBedrock model IDanthropic.claude-sonnet-4-6-v1:0

​
X.AI (Grok)

​
Dashboard Setup

  1. Go to Settings > Providers
  2. Click Add Provider > X.AI
  3. Enter your X.AI API key
  4. Select default model (e.g., grok-3)
  5. Click Save

​
Required Fields

FieldDescriptionExample
API KeyYour X.AI API keyxai-...
Default ModelDefault model for operationsgrok-3

​
Moonshot (Kimi)

​
Dashboard Setup

  1. Go to Settings > Providers
  2. Click Add Provider > Moonshot
  3. Enter your Moonshot API key
  4. Select default model (e.g., kimi-k2)
  5. Click Save

​
Required Fields

FieldDescriptionExample
API KeyYour Moonshot API keysk-...
Default ModelDefault model for operationskimi-k2

​
Zhipu AI (GLM)

​
Dashboard Setup

  1. Go to Settings > Providers
  2. Click Add Provider > Zhipu AI
  3. Enter your Zhipu API key
  4. Select default model (e.g., glm-4)
  5. Click Save

​
Required Fields

FieldDescriptionExample
API KeyYour Zhipu AI API keyzhipu-...
Default ModelDefault model for operationsglm-4

​
Groq

​
Dashboard Setup

  1. Go to Settings > Providers
  2. Click Add Provider > Groq
  3. Enter your Groq API key
  4. Select default model (e.g., llama-3.3-70b-versatile)
  5. Click Save

​
Required Fields

FieldDescriptionExample
API KeyYour Groq API keygsk_...
Default ModelDefault model for operationsllama-3.3-70b-versatile

​
Custom Provider

Use a custom provider for any OpenAI-compatible endpoint (e.g., self-hosted models, vLLM, Ollama).

​
Dashboard Setup

  1. Go to Settings > Providers
  2. Click Add Provider > Custom
  3. Enter the base URL and API key
  4. Click Save

​
Required Fields

FieldDescriptionExample
API KeyAPI key for authenticationyour-api-key
Base URLOpenAI-compatible endpointhttps://your-server.com/v1
Default ModelModel identifieryour-model-name

​
Verifying Providers via CLI

After configuring providers in the dashboard, use the CLI to verify: 
# List all configured providers
mutagent providers list

# Example output:
# ID    Provider    Name                Status
# 1     openai      Production OpenAI   active
# 2     anthropic   Production Claude   active

# Get provider details (API key is masked)
mutagent providers get 1

# Test a provider connection
mutagent providers test 1
# Output: Connection: OK (model: gpt-5, latency: 342ms)

​
Setting Default Provider

The default provider is set through the dashboard when creating or editing a provider configuration. Toggle the “Default” option on the provider you want to use as the default for evaluations and optimization.
Provider availability in the dashboard UI may differ from core platform support. Providers listed here are supported at the platform level.

​
Security

Provider API keys are encrypted at rest and never exposed in API responses.
  • Keys are stored encrypted using AES-256
  • API responses always mask keys (e.g., sk-...xxxx)
  • Access is scoped to your workspace
  • Rotate keys regularly via the dashboard
  • Use least-privilege API keys when possible
  • Credential management is handled via the dashboard

​
Troubleshooting

Verify your API key is correct and has not expired. Check that the provider’s API is accessible from your network.
Make sure you are authenticated to the correct workspace. Run mutagent providers list to see all providers for your current workspace.
Check that the model specified in the optimization config is available on your configured provider. Run mutagent providers test <id> to verify connectivity.
Your provider may be throttling requests. Check your provider’s rate limits and consider upgrading your API plan or using a different provider.