← All models

llama-3-70b

vercel_ai_gateway · chat model

llama-3-70b is listed here as a chat model from vercel_ai_gateway. This page shows simple API pricing, token limits, and capability flags so you can compare it with similar options.

Input
$0.5900 / 1M tokens
Output
$0.7900 / 1M tokens
Cached input
N/A
Context
8.2K

Quick read

Best for

Use this page when you need a fast view of cost, context size, and supported features before testing the model in your own workload.

Things to verify

Always check the provider page for discounts, cache pricing, region rules, and any model limits that may not appear in public metadata.

Pricing

Item Price
Input
$0.5900 / 1M tokens
Output
$0.7900 / 1M tokens
Embedding
$0.5900 / 1M tokens

Token limits

Context window
8.2K
Max input tokens
8.2K
Max output tokens
8.2K
Max tokens
8.2K

Capabilities

Capability Supported
Vision
Function calling
Parallel function calling
Tool choice
Prompt caching
Reasoning
Response schema
System messages
Audio input
Audio output
Web search
PDF input
Video input

Sources

Source links
Pricing data LiteLLM model cost map
Synced at 2026-05-28

Docs

Official docs

Similar models

This list is ranked by overall similarity. Use filters to emphasize the lens that matters most for the replacement you are making.

Comparing from
Model Cost Input shape Features Context Why it is close
llama-3-70b
vercel_ai_gateway
In $0.5900 / 1M tokens
Out $0.7900 / 1M tokens
text
Output: text
Tool choice
8.2K
Current model
Reference row

Overall blends cost, modality overlap, capabilities, and context.

Model Cost Input shape Features Context Why it is close
llama-3-70b-instruct
OpenRouter
In $0.5900 / 1M tokens
Out $0.7900 / 1M tokens
text
Output: text
Tool choice
8.0K
Text covered
Overall 100%
mistral.mixtral-8x7b-instruct-v0:1
Bedrock
In $0.5900 / 1M tokens
Out $0.9100 / 1M tokens
text
Output: text
Tool choice
8.2K
Text covered
Overall 99%
llama-3.1-70b
vercel_ai_gateway
In $0.7200 / 1M tokens
Out $0.7200 / 1M tokens
text
Output: text
Tool choice
8.2K
Same provider
Overall 97%
mistral.mixtral-8x7b-instruct-v0:1
Bedrock
In $0.4500 / 1M tokens
Out $0.7000 / 1M tokens
text
Output: text
Tool choice
8.2K
Text covered
Overall 97%
mistral.mixtral-8x7b-instruct-v0:1
Bedrock
In $0.4500 / 1M tokens
Out $0.7000 / 1M tokens
text
Output: text
Tool choice
8.2K
Text covered
Overall 97%
mistral.mixtral-8x7b-instruct-v0:1
Bedrock
In $0.4500 / 1M tokens
Out $0.7000 / 1M tokens
text
Output: text
Tool choice
8.2K
Text covered
Overall 97%
deepseek-v3
vercel_ai_gateway
In $0.9000 / 1M tokens
Out $0.9000 / 1M tokens
text
Output: text
Tool choice
8.2K
Same provider
Overall 96%
deepseek-r1
vercel_ai_gateway
In $0.5500 / 1M tokens
Out $2.1900 / 1M tokens
text
Output: text
Tool choice
8.2K
Same provider
Overall 92%
anthropic.claude-instant-v1
Bedrock
In $0.8000 / 1M tokens
Out $2.4000 / 1M tokens
text
Output: text
Tool choice
8.2K
Text covered
Overall 90%
jamba-instruct
azure_ai
In $0.5000 / 1M tokens
Out $0.7000 / 1M tokens
text
Output: text
Tool choice
4.1K
Text covered
Overall 90%
llama-3.3-70b
vercel_ai_gateway
In $0.7200 / 1M tokens
Out $0.7200 / 1M tokens
text
Output: text
Tool choice
8.2K
Same provider
Overall 85%
llama-3-8b
vercel_ai_gateway
In $0.0500 / 1M tokens
Out $0.0800 / 1M tokens
text
Output: text
Tool choice
8.2K
Same provider
Overall 82%
llama-3-70b-instruct
novita
In $0.5100 / 1M tokens
Out $0.7400 / 1M tokens
text
Output: text
Tool choice
8.0K
Text covered
Overall 81%
anthropic.claude-v2:1
Bedrock
In $8.0000 / 1M tokens
Out $24.0000 / 1M tokens
text
Output: text
Tool choice
8.2K
Text covered
Overall 81%
llama-4-maverick
vercel_ai_gateway
In $0.2000 / 1M tokens
Out $0.6000 / 1M tokens
text image
Output: text
Tool choice
8.2K
Same provider
Overall 79%
Meta-Llama-3-70B-Instruct
azure_ai
In $1.1000 / 1M tokens
Out $0.3700 / 1M tokens
text
Output: text
Tool choice
2.0K
Text covered
Overall 79%
gpt-35-turbo-16k
Azure
In $3.0000 / 1M tokens
Out $4.0000 / 1M tokens
text
Output: text
Tool choice
4.1K
Text covered
Overall 76%
gpt-4-32k
Azure
In $60.0000 / 1M tokens
Out $120.0000 / 1M tokens
text
Output: text
Tool choice
4.1K
Text covered
Overall 73%
gpt-4-32k-0613
Azure
In $60.0000 / 1M tokens
Out $120.0000 / 1M tokens
text
Output: text
Tool choice
4.1K
Text covered
Overall 73%
mixtral-8x22b-instruct
OpenRouter
In $0.6500 / 1M tokens
Out $0.6500 / 1M tokens
text file
Output: text
Tool choice
65.5K
Text covered
Overall 72%
L3.1-70B-Euryale-v2.2
deepinfra
In $0.6500 / 1M tokens
Out $0.7500 / 1M tokens
text
Output: text
Low overlap
131.1K
Text covered
Overall 60%
L3.3-70B-Euryale-v2.3
deepinfra
In $0.6500 / 1M tokens
Out $0.7500 / 1M tokens
text
Output: text
Low overlap
131.1K
Text covered
Overall 60%
llama-3.3-70b-versatile
Groq
In $0.5900 / 1M tokens
Out $0.7900 / 1M tokens
text
Output: unknown
Tool choice
32.8K
Partial I/O overlap
Overall 36%
Missing text