All Projects
ToolOpen sourceIndependent

freelm

Free LLM API Gateway for Python & Node.js

freelm is an open-source Python and Node.js gateway that pools free-tier LLM providers behind one fault-tolerant, OpenAI-compatible call.

View source

About this project

freelm is an open-source gateway that pools six free-tier LLM providers—OpenRouter, Google AI Studio (Gemini), NVIDIA NIM, Groq, Cerebras, and Mistral—behind one fault-tolerant, OpenAI-compatible call. It handles automatic failover, circuit breaking, rate-limit awareness, and live free-model discovery. Available on PyPI and npm.

Highlights

  • Combine OpenRouter, Gemini, NIM, Groq, Cerebras, and Mistral
  • Automatic Failover across keys and providers
  • Drop-in OpenAI API shim (`freelm.compat.OpenAI`)
  • Available for Python (PyPI) and Node.js/TypeScript (npm)

Tech stack

Python
Node.js
TypeScript
LLMs

Built by

Shihab Shahriar Antor

More tools by Shihab Shahriar Antor

sudoku-web
Sudoku Generator + PDF Export
Latex_Templates
University & Publisher LaTeX Templates