← All models

Llama-3.1-8B-Instruct

nscale · chat model

Llama-3.1-8B-Instruct is listed here as a chat model from nscale. This page shows simple API pricing, token limits, and capability flags so you can compare it with similar options.

Input
$0.0300 / 1M tokens
Output
$0.0300 / 1M tokens
Cached input
N/A
Context
N/A

Quick read

Best for

Use this page when you need a fast view of cost, context size, and supported features before testing the model in your own workload.

Things to verify

Always check the provider page for discounts, cache pricing, region rules, and any model limits that may not appear in public metadata.

Pricing

Item Price
Input
$0.0300 / 1M tokens
Output
$0.0300 / 1M tokens
Embedding
$0.0300 / 1M tokens

Token limits

Capabilities

Capability Supported
Vision
Function calling
Parallel function calling
Tool choice
Prompt caching
Reasoning
Response schema
System messages
Audio input
Audio output
Web search
PDF input
Video input

Benchmarks

Most benchmark rows are attached to the base model family rather than this provider route. Open benchmark explorer

Benchmark Score Metric Scope Checked Source
MMLU (CoT) 88.6 macro_avg/acc Base model: Llama 3.1 (Llama 3.1 405B Instruct) 2026-05-31 Link
MMLU-Pro (CoT) 73.3 macro_avg/acc Base model: Llama 3.1 (Llama 3.1 405B Instruct) 2026-05-31 Link
GPQA Diamond 49.0 acc Base model: Llama 3.1 (Llama 3.1 405B Instruct) 2026-05-31 Link
HumanEval 89.0 pass@1 Base model: Llama 3.1 (Llama 3.1 405B Instruct) 2026-05-31 Link
MATH (CoT) 73.8 sympy_intersection_score Base model: Llama 3.1 (Llama 3.1 405B Instruct) 2026-05-31 Link
MMLU 85.2 macro_avg/acc_char Base model: Llama 3.1 (Llama 3.1 405B) 2026-05-31 Link
MMLU-Pro (CoT) 61.6 macro_avg/acc_char Base model: Llama 3.1 (Llama 3.1 405B) 2026-05-31 Link
AGIEval English 71.6 average/acc_char Base model: Llama 3.1 (Llama 3.1 405B) 2026-05-31 Link
MMLU 87.3 macro_avg/acc Base model: Llama 3.1 (Llama 3.1 405B Instruct) 2026-05-31 Link
MMLU (CoT) 88.6 macro_avg/acc Base model: Llama 3.1 (Llama 3.1 405B Instruct) 2026-05-31 Link
MMLU-Pro (CoT) 73.3 micro_avg/acc_char Base model: Llama 3.1 (Llama 3.1 405B Instruct) 2026-05-31 Link
IFEval 88.6 Base model: Llama 3.1 (Llama 3.1 405B Instruct) 2026-05-31 Link
ARC-Challenge 96.9 acc Base model: Llama 3.1 (Llama 3.1 405B Instruct) 2026-05-31 Link
GPQA 50.7 em Base model: Llama 3.1 (Llama 3.1 405B Instruct) 2026-05-31 Link
MMLU 69.4% macro_avg/acc Base model: Llama 3.1 (Llama-3.1-8B-Instruct) 2026-05-31 Link
MMLU 83.6% macro_avg/acc Base model: Llama 3.1 (Llama-3.1-70B-Instruct) 2026-05-31 Link
HumanEval 72.6% pass@1 Base model: Llama 3.1 (Llama-3.1-8B-Instruct) 2026-05-31 Link
HumanEval 80.5% pass@1 Base model: Llama 3.1 (Llama-3.1-70B-Instruct) 2026-05-31 Link
GSM8K (CoT) 84.5% em_maj1@1 Base model: Llama 3.1 (Llama-3.1-8B-Instruct) 2026-05-31 Link
GSM8K (CoT) 95.1% em_maj1@1 Base model: Llama 3.1 (Llama-3.1-70B-Instruct) 2026-05-31 Link
BFCL 76.1% acc Base model: Llama 3.1 (Llama-3.1-8B-Instruct) 2026-05-31 Link
BFCL 84.8% acc Base model: Llama 3.1 (Llama-3.1-70B-Instruct) 2026-05-31 Link
Artificial Analysis Intelligence Index 12.2 score Base model: llama-3.1 (meta-llama/llama-3.1-70b-instruct) 2026-05-31 Link
Artificial Analysis Coding Index 10.9 score Base model: llama-3.1 (meta-llama/llama-3.1-70b-instruct) 2026-05-31 Link
Artificial Analysis Agentic Index 5.1 score Base model: llama-3.1 (meta-llama/llama-3.1-70b-instruct) 2026-05-31 Link

Sources

Source links
Pricing data LiteLLM model cost map
Synced at 2026-05-28

Docs

Official docs

Similar models

This list is ranked by overall similarity. Use filters to emphasize the lens that matters most for the replacement you are making.

Comparing from
Model Cost Input shape Features Context Why it is close
Llama-3.1-8B-Instruct
nscale
In $0.0300 / 1M tokens
Out $0.0300 / 1M tokens
Output: unknown
No public capabilities
N/A
Current model
Reference row

Overall blends cost, modality overlap, capabilities, and context.

Model Cost Input shape Features Context Why it is close
deepseek-ocr
novita
In $0.0300 / 1M tokens
Out $0.0300 / 1M tokens
imagetext
Output: text
Low overlap
8.2K
Partial I/O overlap
Overall 20%
qwen3-4b-fp8
novita
In $0.0300 / 1M tokens
Out $0.0300 / 1M tokens
text
Output: text
Low overlap
20.0K
Partial I/O overlap
Overall 20%
Meta-Llama-3.1-8B-Instruct-Turbo
deepinfra
In $0.0200 / 1M tokens
Out $0.0300 / 1M tokens
text
Output: text
Low overlap
131.1K
Partial I/O overlap
Overall 17%
DeepSeek-R1-Distill-Llama-8B
nscale
In $0.0250 / 1M tokens
Out $0.0250 / 1M tokens
Output: unknown
Low overlap
N/A
Same provider
Overall 17%
hermes3-8b
lambda_ai
In $0.0250 / 1M tokens
Out $0.0400 / 1M tokens
Output: unknown
Low overlap
131.1K
Partial I/O overlap
Overall 16%
lfm-7b
lambda_ai
In $0.0250 / 1M tokens
Out $0.0400 / 1M tokens
Output: unknown
Low overlap
131.1K
Partial I/O overlap
Overall 16%
Qwen2.5-Coder-3B-Instruct
nscale
In $0.0100 / 1M tokens
Out $0.0300 / 1M tokens
Output: unknown
Low overlap
N/A
Same provider
Overall 14%
Qwen2.5-Coder-7B-Instruct
nscale
In $0.0100 / 1M tokens
Out $0.0300 / 1M tokens
Output: unknown
Low overlap
N/A
Same provider
Overall 14%
DeepSeek-R1-Distill-Qwen-14B
nscale
In $0.0700 / 1M tokens
Out $0.0700 / 1M tokens
Output: unknown
Low overlap
N/A
Same provider
Overall 9%
DeepSeek-R1-Distill-Qwen-1.5B
nscale
In $0.0900 / 1M tokens
Out $0.0900 / 1M tokens
Output: unknown
Low overlap
N/A
Same provider
Overall 7%
Qwen2.5-Coder-32B-Instruct
nscale
In $0.0600 / 1M tokens
Out $0.2000 / 1M tokens
Output: unknown
Low overlap
N/A
Same provider
Overall 6%
ai21.jamba-1-5-mini-v1:0
Bedrock
In $0.2000 / 1M tokens
Out $0.4000 / 1M tokens
text
Output: text
Low overlap
256.0K
Partial I/O overlap
Overall 2%
ai21.jamba-instruct-v1:0
Bedrock
In $0.5000 / 1M tokens
Out $0.7000 / 1M tokens
text
Output: text
Low overlap
4.1K
Partial I/O overlap
Overall 1%
ai21.jamba-1-5-large-v1:0
Bedrock
In $2.0000 / 1M tokens
Out $8.0000 / 1M tokens
text
Output: text
Low overlap
256.0K
Partial I/O overlap
Overall 0%
us.writer.palmyra-x4-v1:0
bedrock_converse
In $2.5000 / 1M tokens
Out $10.0000 / 1M tokens
pdftext
Output: text
Low overlap
8.2K
Partial I/O overlap
Overall 0%
ai21.j2-mid-v1
Bedrock
In $12.5000 / 1M tokens
Out $12.5000 / 1M tokens
text
Output: text
Low overlap
8.2K
Partial I/O overlap
Overall 0%
ai21.j2-ultra-v1
Bedrock
In $18.8000 / 1M tokens
Out $18.8000 / 1M tokens
text
Output: text
Low overlap
8.2K
Partial I/O overlap
Overall 0%