One endpoint in front of every LLM provider.
IAGA Gateway is a single OpenAI-compatible endpoint that sits in front of the major LLM providers and adds what the providers alone do not: reliability, cost control, security and safety, and compliance. It is self-hosted: you run it on your own infrastructure and point your base URL at it, and your application code does not change.
IAGA Gateway is not IAGA Sentinel. Sentinel is the EU AI Act conformity-evidence layer that produces signed, offline-verifiable proof of what autonomous agents do. The Gateway governs and optimizes live LLM traffic. Different product, different purpose. It is self-hosted: you run it on your own infrastructure and point your app at it.
Your app
any OpenAI SDK
IAGA Gateway
routing · cache · safety · policy · audit
- OpenAI
- Anthropic
- Groq
- Google Gemini
- OpenRouter
What it does
Four columns of value, on top of whichever provider answers.
Reliability
Stay up when a provider does not.
- Intelligent routing across providers with automatic cascading fallback.
- Self-heal prunes decommissioned models and repairs stale routing targets.
- A circuit breaker (three-failure threshold) and a five-minute health tracker isolate failing providers.
- Native passthrough when a model is served directly, plus cause-aware error classification, so no more opaque 424s.
Cost control
Pay for the tokens you actually need.
- Exact cache keyed on the full request context (tools, format, seed, multimodal), so a hit means an identical request.
- Semantic cache over similar queries via embeddings, skipped automatically for tool, vision, and JSON calls.
- Per-workspace budgets and token budgets, cost alerts, and usage metering.
- Tool Call Control trims needless tool calls and prices the saving against official 2026 rates.
Security and safety
Guardrails on the request and the response.
- A resilient critique chain (OpenRouter, then Groq, then OpenAI) scores each response, with optional fail-closed.
- PII redaction on the way in and the way out (opt-in).
- Tool-abuse guard: flags exfiltration and code-execution patterns before the call leaves.
- Per-workspace crypto envelope (data key plus master key, with rotation) for provider credentials.
- Account and infrastructure defenses: TOTP MFA (argon2id), HIBP breach checks, SSRF URL guard, CSRF, row-level security, IP allowlists, anomaly detection.
Governance and compliance
Bring your keys, keep the audit trail.
- BYOK multi-key: your own provider keys, several per provider per workspace, with rotation and expiry.
- Per-workspace policy, with every request and verdict written to the audit log.
- Observability through OpenTelemetry, Sentry, and metrics, with consistent _iaga.* telemetry even on blocked calls.
- Bilingual (EN/FR) legal and compliance page templates to adapt for your own deployment: Trust, Security, Subprocessors, Privacy, Terms.
- SAML and SCIM foundations for enterprise SSO.
How a request flows
Every call passes the same ordered pipeline, before and after it reaches a provider.
- 01Authentication, rate limiting, permissions, and replay-safe idempotency.
- 02Payload validation with Zod: streaming, tool calls, multimodal, JSON schema.
- 03Workspace policy: output-token caps, fail-closed mode, prompt enforcement.
- 04Tool Call Control: a heuristic gate, an LLM verifier, and anti-abuse, before the provider is called.
- 05Routing by scoring, capability, and health, with cascading fallback and native passthrough.
- 06Cache: exact first, then semantic.
- 07Critique and safety on the response, with PII redaction on the way out.
- 08Audit and telemetry (_iaga.*) on every request.
Connect in one line
It speaks the OpenAI Chat Completions API. Point your existing SDK at your gateway's base URL and keep the rest of your code.
# point any OpenAI SDK at your gateway's base URL
base_url = "https://your-gateway.example.com/api/v1/gateway"
# nothing else changes
POST /api/v1/gateway/chat-completions- API
- POST /api/v1/gateway/chat-completions, a drop-in OpenAI-compatible endpoint.
- Dashboard
- A single-page console: API keys, providers and BYOK, routing, policy, prompts, budgets, billing, batch, webhooks, requests, and a playground.
- SDKs
- Node and Python packages.
Providers
OpenAI · Anthropic · Groq · Google Gemini · OpenRouter
Stack
Next.js 14 (App Router) · TypeScript · Prisma + Postgres (Neon) · Upstash Redis · BullMQ workers · Stripe billing · Resend email · Sentry + OpenTelemetry.
Self-hosted and OpenAI-compatible. Every subsystem on this page is implemented and running in our own deployment.
Get access.
Tell us where to reach you and we'll help you get the self-hosted Gateway running on your own infrastructure. No sales pitch, unsubscribe anytime.
Prefer email? info@iaga.tech