Meta-Llama-3.1-70B-Instruct-Turbo
deepinfra · chat model
Meta-Llama-3.1-70B-Instruct-Turbo is listed here as a chat model from deepinfra. This page shows simple API pricing, token limits, and capability flags so you can compare it with similar options.
Quick read
Best for
Use this page when you need a fast view of cost, context size, and supported features before testing the model in your own workload.
Things to verify
Always check the provider page for discounts, cache pricing, region rules, and any model limits that may not appear in public metadata.
Pricing
| Item | Price |
|---|---|
| Input | $0.1000 / 1M tokens |
| Output | $0.2800 / 1M tokens |
| Embedding | $0.1000 / 1M tokens |
Token limits
Capabilities
| Capability | Supported |
|---|---|
| Vision | — |
| Function calling | ✅ |
| Parallel function calling | — |
| Tool choice | ✅ |
| Prompt caching | — |
| Reasoning | — |
| Response schema | — |
| System messages | — |
| Audio input | — |
| Audio output | — |
| Web search | — |
| PDF input | — |
| Video input | — |
Benchmarks
Most benchmark rows are attached to the base model family rather than this provider route. Open benchmark explorer
| Benchmark | Score | Metric | Scope | Checked | Source |
|---|---|---|---|---|---|
| MMLU (CoT) | 88.6 | macro_avg/acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU-Pro (CoT) | 73.3 | macro_avg/acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| GPQA Diamond | 49.0 | acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| HumanEval | 89.0 | pass@1 | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MATH (CoT) | 73.8 | sympy_intersection_score | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU | 85.2 | macro_avg/acc_char | Base model: Llama 3.1 (Llama 3.1 405B) | 2026-05-31 | Link |
| MMLU-Pro (CoT) | 61.6 | macro_avg/acc_char | Base model: Llama 3.1 (Llama 3.1 405B) | 2026-05-31 | Link |
| AGIEval English | 71.6 | average/acc_char | Base model: Llama 3.1 (Llama 3.1 405B) | 2026-05-31 | Link |
| MMLU | 87.3 | macro_avg/acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU (CoT) | 88.6 | macro_avg/acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU-Pro (CoT) | 73.3 | micro_avg/acc_char | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| IFEval | 88.6 | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link | |
| ARC-Challenge | 96.9 | acc | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| GPQA | 50.7 | em | Base model: Llama 3.1 (Llama 3.1 405B Instruct) | 2026-05-31 | Link |
| MMLU | 69.4% | macro_avg/acc | Base model: Llama 3.1 (Llama-3.1-8B-Instruct) | 2026-05-31 | Link |
| MMLU | 83.6% | macro_avg/acc | Base model: Llama 3.1 (Llama-3.1-70B-Instruct) | 2026-05-31 | Link |
| HumanEval | 72.6% | pass@1 | Base model: Llama 3.1 (Llama-3.1-8B-Instruct) | 2026-05-31 | Link |
| HumanEval | 80.5% | pass@1 | Base model: Llama 3.1 (Llama-3.1-70B-Instruct) | 2026-05-31 | Link |
| GSM8K (CoT) | 84.5% | em_maj1@1 | Base model: Llama 3.1 (Llama-3.1-8B-Instruct) | 2026-05-31 | Link |
| GSM8K (CoT) | 95.1% | em_maj1@1 | Base model: Llama 3.1 (Llama-3.1-70B-Instruct) | 2026-05-31 | Link |
| BFCL | 76.1% | acc | Base model: Llama 3.1 (Llama-3.1-8B-Instruct) | 2026-05-31 | Link |
| BFCL | 84.8% | acc | Base model: Llama 3.1 (Llama-3.1-70B-Instruct) | 2026-05-31 | Link |
| Artificial Analysis Intelligence Index | 12.2 | score | Base model: llama-3.1 (meta-llama/llama-3.1-70b-instruct) | 2026-05-31 | Link |
| Artificial Analysis Coding Index | 10.9 | score | Base model: llama-3.1 (meta-llama/llama-3.1-70b-instruct) | 2026-05-31 | Link |
| Artificial Analysis Agentic Index | 5.1 | score | Base model: llama-3.1 (meta-llama/llama-3.1-70b-instruct) | 2026-05-31 | Link |
Sources
| Source links | |
| Pricing data | LiteLLM model cost map |
| Synced at | 2026-05-28 |
Docs
| Official docs |
Similar models
This list is ranked by overall similarity. Use filters to emphasize the lens that matters most for the replacement you are making.
| Model | Cost | Input shape | Features | Context | Why it is close |
|---|---|---|---|---|---|
| Meta-Llama-3.1-70B-Instruct-Turbo deepinfra | In $0.1000 / 1M tokens Out $0.2800 / 1M tokens | text
Output: text | Function callingTool choice | 131.1K | Current model Reference row |
| Model | Cost | Input shape | Features | Context | Why it is close |
|---|---|---|---|---|---|
| Llama-3.3-Nemotron-Super-49B-v1.5 deepinfra | In $0.1000 / 1M tokens Out $0.4000 / 1M tokens | text
Output: text | Function callingTool choice | 131.1K | Same provider Overall 97% |
| Llama-3.3-70B-Instruct-Turbo deepinfra | In $0.1300 / 1M tokens Out $0.3900 / 1M tokens | text
Output: text | Function callingTool choice | 131.1K | Same provider Overall 95% |
| DeepSeek-R1-Distill-Qwen-32B deepinfra | In $0.2700 / 1M tokens Out $0.2700 / 1M tokens | text
Output: text | Function callingTool choice | 131.1K | Same provider Overall 94% |
| QwQ-32B deepinfra | In $0.1500 / 1M tokens Out $0.4000 / 1M tokens | text
Output: text | Function callingTool choice | 131.1K | Same provider Overall 94% |
| Llama-3.3-70B-Instruct deepinfra | In $0.2300 / 1M tokens Out $0.4000 / 1M tokens | text
Output: text | Function callingTool choice | 131.1K | Same provider Overall 92% |
| gpt-oss-120b deepinfra | In $0.0500 / 1M tokens Out $0.4500 / 1M tokens | text
Output: text | Function callingTool choice | 131.1K | Same provider Overall 91% |
| Qwen3-32B deepinfra | In $0.1000 / 1M tokens Out $0.2800 / 1M tokens | text
Output: text | Function callingTool choice | 41.0K | Same provider Overall 90% |
| Qwen3-30B-A3B deepinfra | In $0.0800 / 1M tokens Out $0.2900 / 1M tokens | text
Output: text | Function callingTool choice | 41.0K | Same provider Overall 88% |
| qwen-3-32b vercel_ai_gateway | In $0.1000 / 1M tokens Out $0.3000 / 1M tokens | text
Output: text | Function callingTool choice | 16.4K | Text covered Overall 86% |
| Phi-4 azure_ai | In $0.1250 / 1M tokens Out $0.5000 / 1M tokens | text
Output: text | Function callingTool choice | 16.4K | Text covered Overall 80% |
| mistral-small-2503 azure_ai | In $0.1000 / 1M tokens Out $0.3000 / 1M tokens | text image
Output: text | Function callingTool choice | 128.0K | Text covered Overall 79% |
| Llama-4-Scout-17B-16E-Instruct deepinfra | In $0.0800 / 1M tokens Out $0.3000 / 1M tokens | text image
Output: text | Function callingTool choice | 327.7K | Same provider Overall 76% |
| Llama-3.3-70B-Instruct azure_ai | In $0.7100 / 1M tokens Out $0.7100 / 1M tokens | text
Output: text | Function callingTool choice | 2.0K | Text covered Overall 71% |
| gpt-3.5-turbo Azure | In $0.5000 / 1M tokens Out $1.5000 / 1M tokens | text
Output: text | Function callingTool choice | 4.1K | Text covered Overall 69% |
| gpt-35-turbo Azure | In $0.5000 / 1M tokens Out $1.5000 / 1M tokens | text
Output: text | Function callingTool choice | 4.1K | Text covered Overall 69% |
| gpt-35-turbo-16k-0613 Azure | In $3.0000 / 1M tokens Out $4.0000 / 1M tokens | text
Output: text | Function callingTool choice | 4.1K | Text covered Overall 67% |
| gpt-4-0613 Azure | In $30.0000 / 1M tokens Out $60.0000 / 1M tokens | text
Output: text | Function callingTool choice | 4.1K | Text covered Overall 66% |
| gemini-2.0-flash-001 deepinfra | In $0.1000 / 1M tokens Out $0.4000 / 1M tokens | text audiocode
Output: text | Function callingTool choice | 1.0M | Same provider Overall 64% |
| mistral.voxtral-small-24b-2507 bedrock_converse | In $0.1000 / 1M tokens Out $0.3000 / 1M tokens | text audio
Output: text | Low overlap | 8.2K | Text covered Overall 48% |
| Mistral-Small-3.2-24B-Instruct-2506 ovhcloud | In $0.0900 / 1M tokens Out $0.2800 / 1M tokens | text
Output: unknown | Function callingTool choice | 128.0K | Partial I/O overlap Overall 46% Missing text |
| google.gemma-3-12b-it bedrock_converse | In $0.0900 / 1M tokens Out $0.2900 / 1M tokens | text image
Output: image, text | Low overlap | 8.2K | Text covered Overall 40% |
| Llama-4-Scout-17B-16E-Instruct nscale | In $0.0900 / 1M tokens Out $0.2900 / 1M tokens | text
Output: unknown | Low overlap | N/A | Partial I/O overlap Overall 19% Missing text |
No models match this filter.