← All models

llama-2-70b-chat

replicate · chat model

llama-2-70b-chat is listed here as a chat model from replicate. This page shows simple API pricing, token limits, and capability flags so you can compare it with similar options.

Input
$0.6500 / 1M tokens
Output
$2.7500 / 1M tokens
Cached input
N/A
Context
4.1K

Quick read

Best for

Use this page when you need a fast view of cost, context size, and supported features before testing the model in your own workload.

Things to verify

Always check the provider page for discounts, cache pricing, region rules, and any model limits that may not appear in public metadata.

Pricing

Item Price
Input
$0.6500 / 1M tokens
Output
$2.7500 / 1M tokens
Embedding
$0.6500 / 1M tokens

Token limits

Context window
4.1K
Max input tokens
4.1K
Max output tokens
4.1K
Max tokens
4.1K

Capabilities

Capability Supported
Vision
Function calling
Parallel function calling
Tool choice
Prompt caching
Reasoning
Response schema
System messages
Audio input
Audio output
Web search
PDF input
Video input

Sources

Source links
Pricing data LiteLLM model cost map
Synced at 2026-05-28

Docs

Official docs

Similar models

This list is ranked by overall similarity. Use filters to emphasize the lens that matters most for the replacement you are making.

Comparing from
Model Cost Input shape Features Context Why it is close
llama-2-70b-chat
replicate
In $0.6500 / 1M tokens
Out $2.7500 / 1M tokens
text
Output: text
Tool choice
4.1K
Current model
Reference row

Overall blends cost, modality overlap, capabilities, and context.

Model Cost Input shape Features Context Why it is close
llama-2-70b
replicate
In $0.6500 / 1M tokens
Out $2.7500 / 1M tokens
text
Output: text
Tool choice
4.1K
Same provider
Overall 100%
cohere.command-r-v1:0
Bedrock
In $0.5000 / 1M tokens
Out $1.5000 / 1M tokens
text
Output: text
Tool choice
4.1K
Text covered
Overall 93%
llama-3-70b
replicate
In $0.6500 / 1M tokens
Out $2.7500 / 1M tokens
text
Output: text
Tool choice
8.2K
Same provider
Overall 93%
llama-3-70b-instruct
replicate
In $0.6500 / 1M tokens
Out $2.7500 / 1M tokens
text
Output: text
Tool choice
8.2K
Same provider
Overall 93%
cohere.command-text-v14
Bedrock
In $1.5000 / 1M tokens
Out $2.0000 / 1M tokens
text
Output: text
Tool choice
4.1K
Text covered
Overall 92%
gpt-3.5-turbo
OpenRouter
In $1.5000 / 1M tokens
Out $2.0000 / 1M tokens
text
Output: text
Tool choice
4.1K
Text covered
Overall 92%
gpt-35-turbo-16k
Azure
In $3.0000 / 1M tokens
Out $4.0000 / 1M tokens
text
Output: text
Tool choice
4.1K
Text covered
Overall 90%
anthropic.claude-instant-v1
Bedrock
In $0.8000 / 1M tokens
Out $2.4000 / 1M tokens
text
Output: text
Tool choice
8.2K
Text covered
Overall 89%
anthropic.claude-instant-v1
Bedrock
In $0.8000 / 1M tokens
Out $2.4000 / 1M tokens
text
Output: text
Tool choice
8.2K
Text covered
Overall 89%
anthropic.claude-instant-v1
Bedrock
In $0.8000 / 1M tokens
Out $2.4000 / 1M tokens
text
Output: text
Tool choice
8.2K
Text covered
Overall 89%
llama-2-13b
replicate
In $0.1000 / 1M tokens
Out $0.5000 / 1M tokens
text
Output: text
Tool choice
4.1K
Same provider
Overall 83%
llama-2-13b-chat
replicate
In $0.1000 / 1M tokens
Out $0.5000 / 1M tokens
text
Output: text
Tool choice
4.1K
Same provider
Overall 83%
llama-2-7b
replicate
In $0.0500 / 1M tokens
Out $0.2500 / 1M tokens
text
Output: text
Tool choice
4.1K
Same provider
Overall 82%
gpt-4-32k
Azure
In $60.0000 / 1M tokens
Out $120.0000 / 1M tokens
text
Output: text
Tool choice
4.1K
Text covered
Overall 80%
gpt-4-32k-0613
Azure
In $60.0000 / 1M tokens
Out $120.0000 / 1M tokens
text
Output: text
Tool choice
4.1K
Text covered
Overall 80%
Meta-Llama-3-70B-Instruct
azure_ai
In $1.1000 / 1M tokens
Out $0.3700 / 1M tokens
text
Output: text
Tool choice
2.0K
Text covered
Overall 79%
anthropic.claude-v2:1
Bedrock
In $8.0000 / 1M tokens
Out $24.0000 / 1M tokens
text
Output: text
Tool choice
8.2K
Text covered
Overall 74%
llama-2-70b-chat
perplexity
In $0.7000 / 1M tokens
Out $2.8000 / 1M tokens
text
Output: unknown
Low overlap
4.1K
Partial I/O overlap
Overall 34%
Missing text
pplx-70b-chat
perplexity
In $0.7000 / 1M tokens
Out $2.8000 / 1M tokens
text
Output: unknown
Low overlap
4.1K
Partial I/O overlap
Overall 34%
Missing text
codellama-70b-instruct
perplexity
In $0.7000 / 1M tokens
Out $2.8000 / 1M tokens
text
Output: unknown
Low overlap
16.4K
Partial I/O overlap
Overall 23%
Missing text