Bifrost
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS…
Bifrost is an enterprise AI gateway built for enterprise-grade reliability, governance, and scale. It claims 50x faster performance than LiteLLM (P99 latency). It supports over 1000 AI models from multiple providers.
It offers built-in observability via OpenTelemetry. It is open source under the Apache 2.0 License.
Summary drafted from the project's own website. Every sentence is backed by text on that page and was reviewed before publishing.