← All models

Meta-Llama-3-70B-Instruct

anyscale · chat model

Meta-Llama-3-70B-Instruct is listed here as a chat model from anyscale. This page shows simple API pricing, token limits, and capability flags so you can compare it with similar options.

Input
$1.0000 / 1M tokens
Output
$1.0000 / 1M tokens
Cached input
N/A
Context
8.2K

Quick read

Best for

Use this page when you need a fast view of cost, context size, and supported features before testing the model in your own workload.

Things to verify

Always check the provider page for discounts, cache pricing, region rules, and any model limits that may not appear in public metadata.

Pricing

Item Price
Input
$1.0000 / 1M tokens
Output
$1.0000 / 1M tokens
Embedding
$1.0000 / 1M tokens

Token limits

Context window
8.2K
Max input tokens
8.2K
Max output tokens
8.2K
Max tokens
8.2K

Capabilities

Capability Supported
Vision
Function calling
Parallel function calling
Tool choice
Prompt caching
Reasoning
Response schema
System messages
Audio input
Audio output
Web search
PDF input
Video input

Sources

Source links
Pricing data LiteLLM model cost map
Synced at 2026-05-28

Docs

Official docs

Similar models

This list is ranked by overall similarity. Use filters to emphasize the lens that matters most for the replacement you are making.

Comparing from
Model Cost Input shape Features Context Why it is close
Meta-Llama-3-70B-Instruct
anyscale
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
No public capabilities
8.2K
Current model
Reference row

Overall blends cost, modality overlap, capabilities, and context.

Model Cost Input shape Features Context Why it is close
databricks-mpt-30b-instruct
databricks
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
Low overlap
8.2K
Partial I/O overlap
Overall 35%
sonar
vercel_ai_gateway
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
Low overlap
8.0K
Partial I/O overlap
Overall 35%
deepseek-r1-distill-llama-70b
gradient_ai
In $0.9900 / 1M tokens
Out $0.9900 / 1M tokens
Output: unknown
Low overlap
8.0K
Partial I/O overlap
Overall 34%
deepseek-v3
fireworks_ai
In $0.9000 / 1M tokens
Out $0.9000 / 1M tokens
text
Output: text
Low overlap
8.2K
Partial I/O overlap
Overall 33%
firefunction-v2
fireworks_ai
In $0.9000 / 1M tokens
Out $0.9000 / 1M tokens
text
Output: text
Low overlap
8.2K
Partial I/O overlap
Overall 33%
deepseek-v3
vercel_ai_gateway
In $0.9000 / 1M tokens
Out $0.9000 / 1M tokens
text
Output: text
Low overlap
8.2K
Partial I/O overlap
Overall 33%
CodeLlama-34b-Instruct-hf
anyscale
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
Low overlap
4.1K
Same provider
Overall 28%
CodeLlama-70b-Instruct-hf
anyscale
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
Low overlap
4.1K
Same provider
Overall 28%
Llama-2-70b-chat-hf
anyscale
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
Low overlap
4.1K
Same provider
Overall 28%
sonar
perplexity
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
Low overlap
128.0K
Partial I/O overlap
Overall 21%
Hermes-3-Llama-3.1-405B
deepinfra
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
text
Output: text
Low overlap
131.1K
Partial I/O overlap
Overall 21%
llama-3.1-70b-instruct
perplexity
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
Low overlap
131.1K
Partial I/O overlap
Overall 21%
Mixtral-8x22B-Instruct-v0.1
anyscale
In $0.9000 / 1M tokens
Out $0.9000 / 1M tokens
Output: unknown
Low overlap
65.5K
Same provider
Overall 20%
ai21.jamba-instruct-v1:0
Bedrock
In $0.5000 / 1M tokens
Out $0.7000 / 1M tokens
text
Output: text
Low overlap
4.1K
Partial I/O overlap
Overall 20%
us.writer.palmyra-x4-v1:0
bedrock_converse
In $2.5000 / 1M tokens
Out $10.0000 / 1M tokens
pdftext
Output: text
Low overlap
8.2K
Partial I/O overlap
Overall 20%
gemma-7b-it
anyscale
In $0.1500 / 1M tokens
Out $0.1500 / 1M tokens
Output: unknown
Low overlap
8.2K
Same provider
Overall 18%
Meta-Llama-3-8B-Instruct
anyscale
In $0.1500 / 1M tokens
Out $0.1500 / 1M tokens
Output: unknown
Low overlap
8.2K
Same provider
Overall 18%
ai21.j2-mid-v1
Bedrock
In $12.5000 / 1M tokens
Out $12.5000 / 1M tokens
text
Output: text
Low overlap
8.2K
Partial I/O overlap
Overall 17%
ai21.j2-ultra-v1
Bedrock
In $18.8000 / 1M tokens
Out $18.8000 / 1M tokens
text
Output: text
Low overlap
8.2K
Partial I/O overlap
Overall 16%
ai21.jamba-1-5-mini-v1:0
Bedrock
In $0.2000 / 1M tokens
Out $0.4000 / 1M tokens
text
Output: text
Low overlap
256.0K
Partial I/O overlap
Overall 7%
ai21.jamba-1-5-large-v1:0
Bedrock
In $2.0000 / 1M tokens
Out $8.0000 / 1M tokens
text
Output: text
Low overlap
256.0K
Partial I/O overlap
Overall 6%