llama3.1-8b-instruct
lambda_ai · chat model
llama3.1-8b-instruct is listed here as a chat model from lambda_ai. This page shows simple API pricing, token limits, and capability flags so you can compare it with similar options.
Quick read
Best for
Use this page when you need a fast view of cost, context size, and supported features before testing the model in your own workload.
Things to verify
Always check the provider page for discounts, cache pricing, region rules, and any model limits that may not appear in public metadata.
Pricing
| Item | Price |
|---|---|
| Input | $0.0250 / 1M tokens |
| Output | $0.0400 / 1M tokens |
| Embedding | $0.0250 / 1M tokens |
Token limits
Capabilities
| Capability | Supported |
|---|---|
| Vision | — |
| Function calling | ✅ |
| Parallel function calling | ✅ |
| Tool choice | ✅ |
| Prompt caching | — |
| Reasoning | — |
| Response schema | — |
| System messages | ✅ |
| Audio input | — |
| Audio output | — |
| Web search | — |
| PDF input | — |
| Video input | — |
Benchmarks
Most benchmark rows are attached to the base model family rather than this provider route. Open benchmark explorer
| Benchmark | Score | Metric | Scope | Checked | Source |
|---|---|---|---|---|---|
| MMLU (CoT) | 88.6 | macro_avg/acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU-Pro (CoT) | 73.3 | macro_avg/acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| GPQA Diamond | 49.0 | acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| HumanEval | 89.0 | pass@1 | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MATH (CoT) | 73.8 | sympy_intersection_score | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU | 85.2 | macro_avg/acc_char | Base model: Llama 3.1 (Llama 3.1 405B) | 2026-05-31 | Link |
| MMLU-Pro (CoT) | 61.6 | macro_avg/acc_char | Base model: Llama 3.1 (Llama 3.1 405B) | 2026-05-31 | Link |
| AGIEval English | 71.6 | average/acc_char | Base model: Llama 3.1 (Llama 3.1 405B) | 2026-05-31 | Link |
| MMLU | 87.3 | macro_avg/acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU (CoT) | 88.6 | macro_avg/acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU-Pro (CoT) | 73.3 | micro_avg/acc_char | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| IFEval | 88.6 | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link | |
| ARC-Challenge | 96.9 | acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| GPQA | 50.7 | em | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU | 69.4% | macro_avg/acc | Base model: Llama 3.1 (Llama-3.1-8B-Instruct) | 2026-05-31 | Link |
| MMLU | 83.6% | macro_avg/acc | Base model: Llama 3.1 (Llama-3.1-70B-Instruct) | 2026-05-31 | Link |
| HumanEval | 72.6% | pass@1 | Base model: Llama 3.1 (Llama-3.1-8B-Instruct) | 2026-05-31 | Link |
| HumanEval | 80.5% | pass@1 | Base model: Llama 3.1 (Llama-3.1-70B-Instruct) | 2026-05-31 | Link |
| GSM8K (CoT) | 84.5% | em_maj1@1 | Base model: Llama 3.1 (Llama-3.1-8B-Instruct) | 2026-05-31 | Link |
| GSM8K (CoT) | 95.1% | em_maj1@1 | Base model: Llama 3.1 (Llama-3.1-70B-Instruct) | 2026-05-31 | Link |
| BFCL | 76.1% | acc | Base model: Llama 3.1 (Llama-3.1-8B-Instruct) | 2026-05-31 | Link |
| BFCL | 84.8% | acc | Base model: Llama 3.1 (Llama-3.1-70B-Instruct) | 2026-05-31 | Link |
| Artificial Analysis Intelligence Index | 12.2 | score | Base model: llama-3.1 (meta-llama/llama-3.1-70b-instruct) | 2026-05-31 | Link |
| Artificial Analysis Coding Index | 10.9 | score | Base model: llama-3.1 (meta-llama/llama-3.1-70b-instruct) | 2026-05-31 | Link |
| Artificial Analysis Agentic Index | 5.1 | score | Base model: llama-3.1 (meta-llama/llama-3.1-70b-instruct) | 2026-05-31 | Link |
Sources
| Source links | |
| Pricing data | LiteLLM model cost map |
| Synced at | 2026-05-28 |
Similar models
This list is ranked by overall similarity. Use filters to emphasize the lens that matters most for the replacement you are making.
| Model | Cost | Input shape | Features | Context | Why it is close |
|---|---|---|---|---|---|
| llama3.1-8b-instruct lambda_ai | In $0.0250 / 1M tokens Out $0.0400 / 1M tokens |
Output: unknown | Function callingParallel function callingTool choiceSystem messages | 131.1K | Current model Reference row |
| Model | Cost | Input shape | Features | Context | Why it is close |
|---|---|---|---|---|---|
| hermes3-8b lambda_ai | In $0.0250 / 1M tokens Out $0.0400 / 1M tokens |
Output: unknown | Function callingParallel function callingTool choiceSystem messages | 131.1K | Same provider Overall 60% |
| lfm-7b lambda_ai | In $0.0250 / 1M tokens Out $0.0400 / 1M tokens |
Output: unknown | Function callingParallel function callingTool choiceSystem messages | 131.1K | Same provider Overall 60% |
| llama3.2-3b-instruct lambda_ai | In $0.0150 / 1M tokens Out $0.0250 / 1M tokens |
Output: unknown | Function callingParallel function callingTool choiceSystem messages | 131.1K | Same provider Overall 52% |
| qwen25-coder-32b-instruct lambda_ai | In $0.0500 / 1M tokens Out $0.1000 / 1M tokens |
Output: unknown | Function callingParallel function callingTool choiceSystem messages | 131.1K | Same provider Overall 49% |
| llama3.2-11b-vision-instruct lambda_ai | In $0.0150 / 1M tokens Out $0.0250 / 1M tokens |
Output: unknown | Function callingParallel function callingTool choiceSystem messages | 131.1K | Same provider Overall 47% |
| Mistral-Nemo-Instruct-2407 deepinfra | In $0.0200 / 1M tokens Out $0.0400 / 1M tokens | text
Output: text | Function callingTool choice | 131.1K | Partial I/O overlap Overall 46% |
| llama-3.2-3b-instruct novita | In $0.0300 / 1M tokens Out $0.0500 / 1M tokens | text
Output: text | Function callingParallel function callingTool choiceSystem messages | 32.0K | Partial I/O overlap Overall 45% |
| lfm-40b lambda_ai | In $0.1000 / 1M tokens Out $0.2000 / 1M tokens |
Output: unknown | Function callingParallel function callingTool choiceSystem messages | 131.1K | Same provider Overall 44% |
| Meta-Llama-3.1-8B-Instruct deepinfra | In $0.0300 / 1M tokens Out $0.0500 / 1M tokens | text
Output: text | Function callingTool choice | 131.1K | Partial I/O overlap Overall 44% |
| L3-8B-Stheno-v3.2 novita | In $0.0500 / 1M tokens Out $0.0500 / 1M tokens | text
Output: text | Function callingParallel function callingTool choiceSystem messages | 32.0K | Partial I/O overlap Overall 42% |
| llama-4-maverick-17b-128e-instruct-fp8 lambda_ai | In $0.0500 / 1M tokens Out $0.1000 / 1M tokens |
Output: unknown | Function callingParallel function callingTool choiceSystem messages | 8.2K | Same provider Overall 35% |
| Hermes-3-Llama-3.1-70B hyperbolic | In $0.1200 / 1M tokens Out $0.3000 / 1M tokens |
Output: unknown | Function callingParallel function callingTool choiceSystem messages | 32.8K | Partial I/O overlap Overall 32% |
| gpt-audio-mini-2025-10-06 Azure | In $0.6000 / 1M tokens Out $2.4000 / 1M tokens |
Output: audio, text | Function callingParallel function callingTool choiceSystem messages | 16.4K | Partial I/O overlap Overall 27% |
| gpt-audio-2025-08-28 Azure | In $2.5000 / 1M tokens Out $10.0000 / 1M tokens |
Output: audio, text | Function callingParallel function callingTool choiceSystem messages | 16.4K | Partial I/O overlap Overall 27% |
| gpt-audio-1.5-2026-02-23 Azure | In $2.5000 / 1M tokens Out $10.0000 / 1M tokens |
Output: audio, text | Function callingParallel function callingTool choiceSystem messages | 16.4K | Partial I/O overlap Overall 27% |
| gpt-4o-audio-preview-2024-12-17 Azure | In $2.5000 / 1M tokens Out $10.0000 / 1M tokens |
Output: audio, text | Function callingParallel function callingTool choiceSystem messages | 16.4K | Partial I/O overlap Overall 27% |
| gpt-4o-mini-audio-preview-2024-12-17 Azure | In $2.5000 / 1M tokens Out $10.0000 / 1M tokens |
Output: audio, text | Function callingParallel function callingTool choiceSystem messages | 16.4K | Partial I/O overlap Overall 27% |
| llama-3.1-8b-instruct novita | In $0.0200 / 1M tokens Out $0.0500 / 1M tokens | text
Output: text | System messages | 16.4K | Partial I/O overlap Overall 24% |
No models match this filter.