tashfeenahmed/freellmapi ? reverse-engineered prompt

Reverse engineered prompt

Build me a local proxy server that combines the free tiers from around 14 AI providers like Groq, Google Gemini, Cerebras, SambaNova, Mistral, and the rest into one single OpenAI compatible endpoint.

I want to point any normal OpenAI client or library at it with one unified key and get chat completions that automatically route to the best available model. If a provider rate limits or errors it should failover to the next one in my list, keep track of usage per key so I never exceed the free caps, and support streaming responses plus basic tool calling.

Add a simple web dashboard where I can paste in my provider keys, reorder the fallback chain, see analytics on which ones are working, and test prompts in a playground. Store the keys encrypted, use a lightweight database, and make the whole thing easy to run with npm on my laptop or even a Raspberry Pi. Focus on personal use and keep everything clean and reliable.

Are you gonna build this?

make sure you review the code using coderabbit

Try freeSponsored — opens CodeRabbit in a new tab