Show HN: GoModel – an open-source AI gateway in Go; 44x lighter than LiteLLM
Source: Hacker News
Overview
Hi, I’m Jakub, a solo founder based in Warsaw. I’ve been building GoModel since December with a couple of contributors. It’s an open-source AI gateway that sits between your app and model providers like OpenAI, Anthropic or others.
Use Cases
I built it for my startup to solve a few problems:
- Track AI usage and cost per client or team
- Switch models without changing app code
- Debug request flows more easily
- Reduce AI spendings with exact and semantic caching
Features
- ~17 MB Docker image (LiteLLM’s image is more than 44× bigger:
docker.litellm.ai/berriai/litellm:latest~ 746 MB on amd64) - Request workflow is visible and easy to inspect
- Config is environment-variable-first by default
Links
- Website:
- Comments:
Points: 7