Compact open Llama model for lightweight chat, drafting, and self-hostingLlama-3.1-8B-Instruct by meta is offered by 22 providers on this page. Public prices are shown for 21 of them. No official API price is listed for it; the prices below come from third-party channels. The lowest paid channel is Helicone at $0.02 / $0.03 per 1M. That channel is a third-party gateway, so confirm its availability and rate limits before depending on it. Prices vary about 11× across the providers that host it. It also has 1 free ($0) channel; free tiers usually carry rate limits, and subscription-covered access bills $0 per token only after the subscription fee.
The context window is 131,072 tokens at the reference host, but hosts report different limits, from 8,192 to 131,072, so the usable window depends on the provider you pick. It supports tool use and structured output. The weights are open, so it can also be self-hosted or served through a gateway of your choice. Providers report the capability flags inconsistently, so verify a specific feature against the host you plan to use. Its training knowledge cuts off at 2023-12.
| Provider | Tier | Input | Output | Cache read | Cache write | Context | Output limit | Status |
|---|---|---|---|---|---|---|---|---|
| Atomic Chat Meta-Llama-3_1-8B-Instruct-GGUF | Gateway | Free | — | — | 131,072 | 4,096 | ||
| Helicone llama-3.1-8b-instruct-turbo | Gateway | $0.02 | $0.03 | — | — | 128,000 ⚠ | 128,000 | |
| NanoGPT | Gateway | $0.02 | $0.04 | $0.01 | — | 131,072 | 16,384 | |
| OpenRouter | Gateway | $0.02 | $0.04 | — | — | 131,072 | 16,384 | |
| Kilo Gateway | Gateway | $0.02 | $0.04 | — | — | 131,072 | 16,384 | |
| Inference | Gateway | $0.025 | $0.025 | — | — | 16,000 ⚠ | 4,096 | deprecated |
| Novita AI | Gateway | $0.02 | $0.05 | — | — | 16,384 ⚠ | 16,384 | |
| Helicone | Gateway | $0.02 | $0.05 | — | — | 16,384 ⚠ | 16,384 | |
| Abacus meta-llama/Meta-Llama-3.1-8B-Instruct | Gateway | $0.02 | $0.05 | — | — | 128,000 ⚠ | 4,096 | deprecated |
| Kitani | Gateway | $0.049 | $0.077 | $0.024 | — | 8,192 ⚠ | 4,096 |
Sorted by blended price (input×0.75 + output×0.25) asc. The official channel always shows regardless of rank. Whether a gateway's low price is actually usable can't be verified.
1 more channels offer $0 (Atomic Chat); free tiers usually have rate limits and no SLA, excluded from ranking.