vreddy0082/freellmapi ? reverse-engineered prompt
Reverse engineered prompt
Build me a self hosted app that gives me one OpenAI compatible /v1 endpoint, but behind it can route requests across lots of free LLM providers and any custom OpenAI compatible endpoint I add.
I want a simple dashboard where I can paste in API keys, see my available models, check usage, and turn providers on or off. The app should automatically pick the best available model for each request, switch to another provider if one is rate limited or unavailable, and keep track of quotas so I do not burn through free tiers too fast. Please store keys encrypted.
It should support chat, embeddings, image, and audio requests, and work with normal OpenAI clients and coding tools by just changing the base URL. If it helps, add a clean desktop friendly interface and make it easy to run locally with Docker. If current docs or provider details are needed, look them up online and keep the setup as simple as possible.
Are you gonna build this?
make sure you review the code using coderabbit