llama3.1-8b
cerebras · chat model
llama3.1-8b is listed here as a chat model from cerebras. This page shows simple API pricing, token limits, and capability flags so you can compare it with similar options.
Input
$0.1000 / 1M tokens
Output
$0.1000 / 1M tokens
Cached input
N/A
Context
128.0K
Quick read
Best for
Use this page when you need a fast view of cost, context size, and supported features before testing the model in your own workload.
Things to verify
Always check the provider page for discounts, cache pricing, region rules, and any model limits that may not appear in public metadata.
Pricing
| Item | Price |
|---|---|
| Input | $0.1000 / 1M tokens |
| Output | $0.1000 / 1M tokens |
| Embedding | $0.1000 / 1M tokens |
Token limits
Context window
128.0K
Max input tokens
128.0K
Max output tokens
128.0K
Max tokens
128.0K
Capabilities
| Capability | Supported |
|---|---|
| Vision | — |
| Function calling | ✅ |
| Parallel function calling | — |
| Tool choice | ✅ |
| Prompt caching | — |
| Reasoning | — |
| Response schema | — |
| System messages | — |
| Audio input | — |
| Audio output | — |
| Web search | — |
| PDF input | — |
| Video input | — |
Benchmarks
Most benchmark rows are attached to the base model family rather than this provider route. Open benchmark explorer
| Benchmark | Score | Metric | Scope | Checked | Source |
|---|---|---|---|---|---|
| MMLU (CoT) | 88.6 | macro_avg/acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU-Pro (CoT) | 73.3 | macro_avg/acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| GPQA Diamond | 49.0 | acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| HumanEval | 89.0 | pass@1 | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MATH (CoT) | 73.8 | sympy_intersection_score | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU | 85.2 | macro_avg/acc_char | Base model: Llama 3.1 (Llama 3.1 405B) | 2026-05-31 | Link |
| MMLU-Pro (CoT) | 61.6 | macro_avg/acc_char | Base model: Llama 3.1 (Llama 3.1 405B) | 2026-05-31 | Link |
| AGIEval English | 71.6 | average/acc_char | Base model: Llama 3.1 (Llama 3.1 405B) | 2026-05-31 | Link |
| MMLU | 87.3 | macro_avg/acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU (CoT) | 88.6 | macro_avg/acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU-Pro (CoT) | 73.3 | micro_avg/acc_char | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| IFEval | 88.6 | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link | |
| ARC-Challenge | 96.9 | acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| GPQA | 50.7 | em | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU | 69.4% | macro_avg/acc | Base model: Llama 3.1 (Llama-3.1-8B-Instruct) | 2026-05-31 | Link |
| MMLU | 83.6% | macro_avg/acc | Base model: Llama 3.1 (Llama-3.1-70B-Instruct) | 2026-05-31 | Link |
| HumanEval | 72.6% | pass@1 | Base model: Llama 3.1 (Llama-3.1-8B-Instruct) | 2026-05-31 | Link |
| HumanEval | 80.5% | pass@1 | Base model: Llama 3.1 (Llama-3.1-70B-Instruct) | 2026-05-31 | Link |
| GSM8K (CoT) | 84.5% | em_maj1@1 | Base model: Llama 3.1 (Llama-3.1-8B-Instruct) | 2026-05-31 | Link |
| GSM8K (CoT) | 95.1% | em_maj1@1 | Base model: Llama 3.1 (Llama-3.1-70B-Instruct) | 2026-05-31 | Link |
| BFCL | 76.1% | acc | Base model: Llama 3.1 (Llama-3.1-8B-Instruct) | 2026-05-31 | Link |
| BFCL | 84.8% | acc | Base model: Llama 3.1 (Llama-3.1-70B-Instruct) | 2026-05-31 | Link |
| Artificial Analysis Intelligence Index | 12.2 | score | Base model: llama-3.1 (meta-llama/llama-3.1-70b-instruct) | 2026-05-31 | Link |
| Artificial Analysis Coding Index | 10.9 | score | Base model: llama-3.1 (meta-llama/llama-3.1-70b-instruct) | 2026-05-31 | Link |
| Artificial Analysis Agentic Index | 5.1 | score | Base model: llama-3.1 (meta-llama/llama-3.1-70b-instruct) | 2026-05-31 | Link |
Sources
| Source links | |
| Pricing data | LiteLLM model cost map |
| Synced at | 2026-05-28 |
Similar models
This list is ranked by overall similarity. Use filters to emphasize the lens that matters most for the replacement you are making.
Comparing from
| Model | Cost | Input shape | Features | Context | Why it is close |
|---|---|---|---|---|---|
| llama3.1-8b cerebras | In $0.1000 / 1M tokens Out $0.1000 / 1M tokens |
Output: unknown | Function callingTool choice | 128.0K | Current model Reference row |
| Model | Cost | Input shape | Features | Context | Why it is close |
|---|---|---|---|---|---|
| gemma-3-12b-it deepinfra | In $0.0500 / 1M tokens Out $0.1000 / 1M tokens | imagetext
Output: text | Function callingTool choice | 131.1K | Partial I/O overlap Overall 55% |
| gemma-3-27b-it deepinfra | In $0.0900 / 1M tokens Out $0.1600 / 1M tokens | imagetext
Output: text | Function callingTool choice | 131.1K | Partial I/O overlap Overall 55% |
| mistral-nemo@latest vertex_ai-mistral_models | In $0.1500 / 1M tokens Out $0.1500 / 1M tokens |
Output: unknown | Function callingTool choice | 128.0K | Partial I/O overlap Overall 53% |
| Meta-Llama-3.1-70B-Instruct-Turbo deepinfra | In $0.1000 / 1M tokens Out $0.2800 / 1M tokens | text
Output: text | Function callingTool choice | 131.1K | Partial I/O overlap Overall 53% |
| Mistral-Small-3.2-24B-Instruct-2506 deepinfra | In $0.0750 / 1M tokens Out $0.2000 / 1M tokens | imagetext
Output: text | Function callingTool choice | 128.0K | Partial I/O overlap Overall 52% |
| gemma-3-4b-it deepinfra | In $0.0400 / 1M tokens Out $0.0800 / 1M tokens | imagetext
Output: text | Function callingTool choice | 131.1K | Partial I/O overlap Overall 52% |
| qwen3-235b-a22b-2507 OpenRouter | In $0.0710 / 1M tokens Out $0.1000 / 1M tokens | text
Output: text | Function callingTool choice | 262.1K | Partial I/O overlap Overall 50% |
| glm-4-32b-0414-128k zai | In $0.1000 / 1M tokens Out $0.1000 / 1M tokens |
Output: unknown | Function callingTool choice | N/A | Partial I/O overlap Overall 45% |
| gemma-3-12b-it crusoe | In $0.1000 / 1M tokens Out $0.1000 / 1M tokens |
Output: unknown | Function callingTool choice | 131.1K | Partial I/O overlap Overall 45% |
| llama3.1-70b cerebras | In $0.6000 / 1M tokens Out $0.6000 / 1M tokens |
Output: unknown | Function callingTool choice | 128.0K | Same provider Overall 43% |
| MythoMax-L2-13b deepinfra | In $0.0800 / 1M tokens Out $0.0900 / 1M tokens | text
Output: text | Function callingTool choice | 4.1K | Partial I/O overlap Overall 43% |
| llama-3.3-70b cerebras | In $0.8500 / 1M tokens Out $1.2000 / 1M tokens |
Output: unknown | Function callingTool choice | 128.0K | Same provider Overall 42% |
| phi-4 deepinfra | In $0.0700 / 1M tokens Out $0.1400 / 1M tokens | text
Output: text | Function callingTool choice | 16.4K | Partial I/O overlap Overall 41% |
| qwen-3-32b cerebras | In $0.4000 / 1M tokens Out $0.8000 / 1M tokens |
Output: unknown | Function callingTool choice | 128.0K | Same provider Overall 35% |
| meta.llama3-2-1b-instruct-v1:0 Bedrock | In $0.1000 / 1M tokens Out $0.1000 / 1M tokens | text
Output: text | Function calling | 4.1K | Partial I/O overlap Overall 33% |
| zai-glm-4.6 cerebras | In $2.2500 / 1M tokens Out $2.7500 / 1M tokens |
Output: unknown | Function callingTool choice | 128.0K | Same provider Overall 32% |
| zai-glm-4.7 cerebras | In $2.2500 / 1M tokens Out $2.7500 / 1M tokens |
Output: unknown | Function callingTool choice | 128.0K | Same provider Overall 32% |
| meta-llama-3.1-8b-instruct friendliai | In $0.1000 / 1M tokens Out $0.1000 / 1M tokens |
Output: unknown | Function callingTool choice | 8.2K | Partial I/O overlap Overall 31% |
| Llama-3.3-70B-Instruct azure_ai | In $0.7100 / 1M tokens Out $0.7100 / 1M tokens | text
Output: text | Function callingTool choice | 2.0K | Partial I/O overlap Overall 28% |
| gpt-3.5-turbo Azure | In $0.5000 / 1M tokens Out $1.5000 / 1M tokens | text
Output: text | Function callingTool choice | 4.1K | Partial I/O overlap Overall 28% |
| gpt-35-turbo Azure | In $0.5000 / 1M tokens Out $1.5000 / 1M tokens | text
Output: text | Function callingTool choice | 4.1K | Partial I/O overlap Overall 28% |
| gpt-35-turbo-16k-0613 Azure | In $3.0000 / 1M tokens Out $4.0000 / 1M tokens | text
Output: text | Function callingTool choice | 4.1K | Partial I/O overlap Overall 26% |
| gpt-4 Azure | In $30.0000 / 1M tokens Out $60.0000 / 1M tokens | imagetext
Output: text | Function callingTool choice | 4.1K | Partial I/O overlap Overall 26% |
| gpt-4-0613 Azure | In $30.0000 / 1M tokens Out $60.0000 / 1M tokens | text
Output: text | Function callingTool choice | 4.1K | Partial I/O overlap Overall 26% |
| llama-v3p1-8b-instruct fireworks_ai | In $0.1000 / 1M tokens Out $0.1000 / 1M tokens | text
Output: text | Low overlap | 16.4K | Partial I/O overlap Overall 22% |
| llama-v3p2-1b-instruct fireworks_ai | In $0.1000 / 1M tokens Out $0.1000 / 1M tokens | text
Output: text | Low overlap | 16.4K | Partial I/O overlap Overall 22% |
| llama-v3p2-3b-instruct fireworks_ai | In $0.1000 / 1M tokens Out $0.1000 / 1M tokens | text
Output: text | Low overlap | 16.4K | Partial I/O overlap Overall 22% |
| gpt-oss-120b cerebras | In $0.3500 / 1M tokens Out $0.7500 / 1M tokens |
Output: unknown | Function callingTool choice | 32.8K | Same provider Overall 18% |
No models match this filter.