Show HN: I stopped using an LLM gateway and put rate-limits/fallback in-processhttps://github.com/LakBud/vernLLM
Sup HN. I built VernLLM cuz every LLM gateaway I looked at, meant adding a network hop just to get rate limiting, multi provider fallback, circuit breaking and other features. Needing to take a whole seperate service just to deploy, monitor and trust with my API keys is just annoying since my whole tech stack was just TypeScript and Node. VernLLM does the same job within your LLM calls, but its in process instead. Its supports OpenAI-compatible APIs, Anthropic, Gemini and Bedrock providers. I would also argue that the features VernLLM provides is more developed then any other gateaway out the…