opensourcestartups

// AI & ML

Bifrost

Bifrost

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

Bifrost is an open source ai project written in Go, with 4,709 stars and 557 forks on GitHub. It is licensed under Apache-2.0 and falls in the AI & ML category. A self-hostable open source alternative to Cloudflare AI Gateway, Eden AI, Kong AI Gateway. Key topics: ai-gateway, gateway, gateway-services, generative-ai, guardrails.

// FACTS

Stars
4.7k
Forks
557
Open issues
391
Language
Go
License
Apache-2.0
Category
AI & ML
Added
5mo ago
Updated
6d ago

// TOPICS

AI-GATEWAYGATEWAYGATEWAY-SERVICESGENERATIVE-AIGUARDRAILSLLMLLM-COSTLLM-GATEWAYLLM-OBSERVABILITYLLMOPSLOAD-BALANCINGMCP-CLIENTMCP-GATEWAYMCP-SERVERMODEL-ROUTERTOKEN-MANAGEMENT

// REVIEWS [000]

No reviews yet — be the first.

$ WRITE A REVIEW

RATING

// COMMENTS [000]

No comments yet.

$ ADD A COMMENT