Custom Providers

Custom providers allow you to add your own AI model endpoints to Holeacquisition LLC. This is useful if you:

• Self-host open-source models (Llama, Mistral) via vLLM or Ollama
• Use Azure OpenAI Service with your own enterprise deployment
• Use a custom AI gateway or internal company proxy
• Want unified observability across all your AI infrastructure

Holeacquisition LLC acts as a proxy, so your custom endpoints must follow one of these protocols:

• OpenAI API format: Compatible with vLLM, Ollama, Azure OpenAI, and LiteLLM.
• Anthropic API format: Compatible with Claude-compatible gateways.

Via Dashboard

1. Go to your Organization Settings in the dashboard
2. Click "Custom Providers" in the sidebar
3. Click "Add Custom Provider"
4. Fill in the provider details:
   • Name: A friendly identifier (e.g., "Internal Llama-3")
   • Base URL: Your endpoint (e.g., https://ai.yourcompany.com/v1)
   • API Key: The auth key for your endpoint (encrypted at rest)
   • Format: Choose OpenAI or Anthropic
5. Click "Test Connection" to verify Holeacquisition LLC can reach your endpoint
6. Click "Add Provider" to save

After adding your Azure deployment as a custom provider:

// use-azure.ts
const response = await cencori.ai.chat({
  model: 'azure-gpt-4', // The name you gave your custom provider
  messages: [{ role: 'user', content: 'Hello!' }],
});

If you're running vLLM or Ollama on your own servers:

// use-vllm.ts
const response = await cencori.ai.chat({
  model: 'llama-3-70b',
  messages: [{ role: 'user', content: 'Explain quantum computing' }],
});

When you add a custom provider, Holeacquisition LLC securely handles your keys:

• Encryption: Keys are encrypted at rest in our database.
• Privacy: Keys are never exposed in logs, client responses, or the dashbard after entry.
• Proxy Only: Keys are only used to authenticate proxy requests from Holeacquisition LLC to your endpoint.

Unified Observability

View usage, costs, and performance metrics for all providers—public and internal—in a single dashboard.

Security Everywhere (opt-in)

Holeacquisition LLC's security features (PII detection, prompt injection protection, content filtering) apply to custom providers exactly as to managed providers — but only after you enable them in Project > Security. Default is off.

Seamless Migration

Switch between public models and your own internal models by just changing the model parameter in your code.

Connection Test Failed

• Verify the Base URL is correct and publicly accessible (or whitelisted for Holeacquisition LLC's IPs).
• Check that the API key is valid for that specific endpoint.
• Ensure the endpoint matches the selected format (OpenAI/Anthropic).

Model Not Found

• Ensure the model name in your Holeacquisition LLC request matches the name defined in the custom provider or the deployment name (for Azure).
• Check your endpoint logs to see if the request is reaching your infrastructure.