LLM Gateway 2.0
One governed endpoint for every approved model
Centralize your organization's AI access with LLM Gateway 2.0. Provide notebooks, apps, and coding assistants with a unified routing layer across OpenAI, Anthropic, Azure, AWS Bedrock, Google Vertex AI, and Domino-hosted models. Provider credentials stay secure at the app level, hidden from end users while automatically tracking usage against existing Domino identities. The Gateway also gives you a central control surface to switch between remote and locally hosted models based on data sensitivity.
Why it matters:
- Unify model access: Reach any approved external vendor or internally hosted model through one standard API tied to existing Domino identities.
- Control AI spend: Track usage automatically and enforce per-team or per-model budgets, including for coding assistants.
- Enforce security: Route sensitive workflows to private models and actively screen prompts and responses with built-in guardrails.
