Guide

Free API for SillyTavern

SillyTavern is a chat and roleplay interface that you run on your computer. It needs a model API. This guide connects SillyTavern to FreeLLMAPI through the Chat Completion source Custom (OpenAI-compatible). FreeLLMAPI pools 45 free provider tiers behind one key and moves to the next provider when a limit stops a request.

Before you start

You need two programs on the same computer: SillyTavern and FreeLLMAPI. FreeLLMAPI runs in Docker or as a desktop app. Install it with one command:

Install FreeLLMAPI (macOS or Linux)

curl -fsSL https://freellmapi.co/install.sh | bash
  1. Open the dashboard at http://localhost:3001.
  2. Add free keys from two or more providers on the Keys page. Google AI Studio, Groq and Mistral each give a free key.
  3. Copy the unified key from the Keys page. SillyTavern uses only this key.

The desktop app listens on http://127.0.0.1:31415. If you use the desktop app, use that address in place of http://localhost:3001 on this page.

Step 1: Connect SillyTavern

Open SillyTavern and click the API Connections icon (the plug) in the top bar. Then set these fields:

FieldValue
APIChat Completion
Chat Completion SourceCustom (OpenAI-compatible)
Custom Endpoint (Base URL)http://localhost:3001/v1
Custom API KeyYour unified key, <unified-key>
Enter a Model IDauto, or a model ID from the table below

Click Connect. SillyTavern reads /v1/models and fills the Available Models list. Do not add /chat/completions to the URL. SillyTavern adds the path itself.

Note: the Available Models list shows the full FreeLLMAPI catalog. It also shows models that you cannot call yet, because you did not add a key for their provider. Type auto in Enter a Model ID to let the router select a model that works now.

Click Test Message to send a short prompt. If you get an answer, the connection works.

Step 2: Choose models for long chats

A roleplay chat sends the character card, the world information and the chat history with each message. A long chat can send tens of thousands of tokens each time. Select models with a large context window.

You can use these model IDs in Enter a Model ID:

  • auto: follows your fallback chain on the dashboard.
  • auto:smart: ranks enabled models by intelligence. Use it for story quality.
  • auto:fast: ranks enabled models by measured speed. Use it for quick replies.
  • A fixed model ID: gives the same writing style every time, but stops when that model's free limit is used.
Free models with 128K+ context for long chats
ModelFree onContextFree limits (best offer)ToolsVision
GLM 5.3APINex, UnoRouter1M5 req/min
10M weighted tokens/day shared across APINex free routes; 4x token multiplier; 5 requests/minute/account
YesNo
GLM 5.3 FlashAPINex, BlazeAPI, NVIDIA NIM +1 more1M40 req/min
40 RPM
YesYes
Gemini 3.8 FlashAPINex, Google AI Studio1M5 req/min
10M weighted tokens/day shared across APINex free routes; 3x token multiplier; 5 requests/minute/account
YesYes
Qwen3.8 Flash NextAMD Radeon Cloud, BlazeAPI, ElectronHub262KRecurring daily account allowanceYesNo
Qwen3.8 FlashElectronHub1M$0.25/week shared recurring creditYesYes
Deepseek V4.1 FlashAPINex1M5 req/min
10M weighted tokens/day shared across APINex free routes; 3x token multiplier; 5 requests/minute/account
NoNo
Gemini 3.7 FlashGoogle AI Studio1M10 req/min
20 req/day
250,000 tokens/min
~3M
YesYes
GPT-5.6 LunaElectronHub1M$0.25/week shared recurring creditYesYes
Dots3 Note PreviewKilo Gateway, OpenRouter512K20 req/min
50 req/day
50 req/day account-wide (1,000 after a $10 purchase)
YesYes
DeepSeek V4 FlashAMD Radeon Cloud, BazaarLink, ElectronHub1M10 req/min
50 req/day
Shared rate limit
YesNo
DeepSeek V4 Flash 0731ElectronHub, Router91M10,000 credits/month (~$1), shared; account-anniversary resetNoNo
Qwen3.8 27BBlazeAPI, ElectronHub, Gizmo +3 more262K30 req/min
250 req/day
70,000 tokens/min
~6M
YesYes

Showing 12 of 184 matching free models. See all models.

Live data from the FreeLLMAPI catalog (version 2026.11.19, checked 19 November 2026). Free limits change often. The catalog is checked every day.

FreeLLMAPI keeps a conversation on one model for 30 minutes. This keeps the character voice the same across messages. If a limit forces a change of model, the next model continues from the same chat history.

Step 3: Set the generation settings

Open the AI Response Configuration panel (the sliders icon). Three settings have the largest effect on free tiers:

SettingRecommended valueWhy
Context Size (tokens)16,000 to 32,000A smaller context sends fewer tokens per message. Free tiers often limit tokens per minute.
Max Response Length (tokens)400 to 800Long replies use the output quota fast. Some reasoning models also use part of this budget for hidden thinking.
StreamingOnYou see the text as it arrives. FreeLLMAPI streams on every provider that it can reach.

SillyTavern also has a Prompt Post-Processing option for the Custom source. Some providers reject two system messages in a row. If you get errors about message roles, select a Semi-strict or Strict option. These options merge messages of the same role. The options marked "no tools" also remove tool calls. The options marked "with tools" keep them.

Rate limits in long roleplay

Each free tier has its own limits. For example, a free Gemini Flash key allows few requests per day, and a Groq key allows more requests with lower token limits. One evening of roleplay can send several hundred requests. One free key does not last that long.

  • Add more providers. Each key adds requests per day. FreeLLMAPI counts the quota of each key and moves to the next key or provider when one is used.
  • Reduce the context. Summarize old messages with the SillyTavern Summarize extension. A shorter prompt uses fewer tokens per minute.
  • Avoid swipes in a loop. Each swipe or regenerate is a new request.
  • Watch the reset. When all keys are at their limit, the gateway returns error 429 with a Retry-After header. Many daily limits reset at midnight UTC.

The table shows the free limits per provider in today's catalog.

ProviderFree modelsMax req/minMax req/dayMax tokens/minTokens/month (one model)Strongest free model
ElectronHub84---$0.25/week shared recurring creditQwen3.8 Flash (ElectronHub)
qwen3.8-flash
Cloudflare Workers AI39---~5-10MQwen 3.8 27B (Cloudflare Workers AI)
@cf/qwen/qwen3.8-27b
Inferbase38---5,000 requests/month; 100 requests and $0.50 usage/day sharedDeepSeek V4 Flash (fp8) (Inferbase)
deepseek-v4-flash:fp8
AI Horde31---Ongoing volunteer queue; availability variesGemma 4 31B Heretic (AI Horde)
koboldcpp/gemma-4-31B-it-heretic
ACLIDE29---€20/month shared internal usage credits · no cardQwen3.8 Max (ACLIDE)
qwen/qwen3.8-max:free
Google AI Studio21151,000250,000~3MGemini 3.8 Flash
gemini-3.8-flash
Api.Airforce2011,000-free · 1,000 req/day · 1 req/mingpt-oss-20b (Api.Airforce)
gpt-oss-20b
NVIDIA NIM1940--free · 40 RPMGLM 5.3 Flash (NV)
z-ai/glm-5.3-flash
Cohere172033-~1-2MCommand A+ (05-2026)
command-a-plus-05-2026
DreamPrompting141005,000-free · 500K tokens/day · 5,000 req/dayGemini 3.1 Flash-Lite
google/gemini-3.1-flash-lite
Mistral122-500,000~50-100MMistral Code
mistral-code-latest
ModelScope11-200-Daily login: 200 credits + 50 for linked Alibaba Cloud; 24h expiry; shared; noncommercial experienceGLM-5.2 (ModelScope)
ZhipuAI/GLM-5.2

Live data from the FreeLLMAPI catalog (version 2026.11.19, checked 19 November 2026). Free limits change often. The catalog is checked every day.

Content policy: every provider applies its own usage policy to free requests. A provider can refuse some content. FreeLLMAPI does not change what a provider allows.

Troubleshooting

ProblemCauseFix
Connect fails or the status stays redWrong URL or FreeLLMAPI is not runningOpen http://localhost:3001 in the browser. Make sure that the URL ends in /v1.
Error 401The key is wrongPaste the unified key again in Custom API Key
A selected model always failsNo key for that model's providerAdd the provider key, or type auto
Error 429 after a long sessionAll keys are at their limitAdd keys from more providers, or wait for the reset
Errors about message order or rolesThe provider has strict role rulesSet Prompt Post-Processing to Semi-strict or Strict
Replies stop in the middleMax Response Length is too small for a reasoning modelIncrease the value, or select a model without reasoning
Character voice changes during the chatA limit forced a change of modelPin one model that is free on several providers
Use every one of these through one key. FreeLLMAPI is an open-source, self-hosted router that puts all these free tiers behind a single OpenAI-compatible endpoint and fails over when one is rate-limited. Browse the catalog or go live.

Frequently asked questions

Is there a free API for SillyTavern?

Yes. SillyTavern accepts any OpenAI-compatible API through the Custom (OpenAI-compatible) source. FreeLLMAPI gives one endpoint for many free provider tiers. Each tier has its own limits.

What is the base URL for SillyTavern Custom (OpenAI-compatible)?

Use http://localhost:3001/v1 for a FreeLLMAPI server install, or http://127.0.0.1:31415/v1 for the desktop app. Do not add /chat/completions.

Which free model is best for SillyTavern roleplay?

Use a model with a context window of 128K tokens or more. Start with auto:smart for quality or auto:fast for speed. The table on this page shows the strongest free models today.

Why do I get error 429 in SillyTavern?

A free tier reached its limit. FreeLLMAPI moves to the next key or provider. If every key is at its limit, you get 429. Add more provider keys or reduce the context size.

Does SillyTavern streaming work with free APIs?

Yes. Turn on Streaming in the AI Response Configuration panel. FreeLLMAPI streams the reply from each provider in the OpenAI format.

Sources

All guides · Browse all free models

Keep reading

All posts →
Guide

Best free LLM APIs 2026

Ten genuinely free LLM APIs worth using — ranked, with real limits.

Guide

Unlimited free AI tokens?

No free AI API is unlimited. The closest real thing: 10.1 billion free tokens a month behind one key.

Guide

How to get a free LLM API key

Get a working key in minutes — no credit card required.