Free Groq API
Groq's blazing-fast LPU inference — GPT-OSS, Llama, Qwen and Whisper on a free developer tier.
FreeLLMAPI is a free, open-source LLM API that routes across every provider with a real free tier. The Groq models below are on the free tier of Groq — reachable through one OpenAI-compatible key, with automatic failover when a provider hits its rate limit.
Free Groq models (7)
| Model | Context | Free limits | Capabilities |
|---|---|---|---|
| groq/compound | 131K | 30 rpm, 250 rpd | vision |
| openai/gpt-oss-120b | 131K | 30 rpm, 1000 rpd | tools |
| llama-3.3-70b-versatile | 131K | 30 rpm, 1000 rpd | tools |
| groq/compound-mini | 131K | 30 rpm, 250 rpd | — |
| openai/gpt-oss-20b | 131K | 30 rpm, 1000 rpd | tools |
| openai/gpt-oss-safeguard-20b | 131K | 30 rpm, 1000 rpd | tools |
| llama-3.1-8b-instant | 131K | 30 rpm, 14400 rpd | tools |
How to use Groq for free
- Install FreeLLMAPI — the open-source router (GitHub). It runs locally and keeps your keys on your machine.
- Add a free key for Groq on the Keys page — no credit card required.
- Point your OpenAI client at the local endpoint and pick a model:
from openai import OpenAI
# FreeLLMAPI runs locally; grab your unified key + endpoint on the Keys page.
client = OpenAI(base_url="http://localhost:3001/v1", api_key="freellmapi-...")
resp = client.chat.completions.create(
model="groq/compound",
messages=[{"role": "user", "content": "Hello!"}],
)
print(resp.choices[0].message.content)
FAQ
Is the Groq API really free?
Yes — these Groq models run on genuine provider free tiers (on the free tier of Groq). Inference costs nothing; you only add a free provider key.
Do I need a credit card?
No. The providers here offer free tiers that work without a card. You add the free key once and FreeLLMAPI routes to it.
How do I call Groq through FreeLLMAPI?
Install the open-source router, add the provider's free key on the Keys page, then point any OpenAI SDK at your local endpoint — see the code sample above.