← All models

CodeLlama-34b-Instruct-hf

anyscale · chat model

CodeLlama-34b-Instruct-hf is listed here as a chat model from anyscale. This page shows simple API pricing, token limits, and capability flags so you can compare it with similar options.

Input
$1.0000 / 1M tokens
Output
$1.0000 / 1M tokens
Cached input
N/A
Context
4.1K

Quick read

Best for

Use this page when you need a fast view of cost, context size, and supported features before testing the model in your own workload.

Things to verify

Always check the provider page for discounts, cache pricing, region rules, and any model limits that may not appear in public metadata.

Pricing

Item Price
Input
$1.0000 / 1M tokens
Output
$1.0000 / 1M tokens
Embedding
$1.0000 / 1M tokens

Token limits

Context window
4.1K
Max input tokens
4.1K
Max output tokens
4.1K
Max tokens
4.1K

Capabilities

Capability Supported
Vision
Function calling
Parallel function calling
Tool choice
Prompt caching
Reasoning
Response schema
System messages
Audio input
Audio output
Web search
PDF input
Video input

Benchmarks

Most benchmark rows are attached to the base model family rather than this provider route. Open benchmark explorer

Benchmark Score Metric Scope Checked Source
HumanEval 53.7% pass@1 Base model: CodeLlama (Code Llama 34B) 2026-05-31 Link
MBPP 56.2% pass@1 Base model: CodeLlama (Code Llama 34B) 2026-05-31 Link

Sources

Source links
Pricing data LiteLLM model cost map
Synced at 2026-05-28

Similar models

This list is ranked by overall similarity. Use filters to emphasize the lens that matters most for the replacement you are making.

Comparing from
Model Cost Input shape Features Context Why it is close
CodeLlama-34b-Instruct-hf
anyscale
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
No public capabilities
4.1K
Current model
Reference row

Overall blends cost, modality overlap, capabilities, and context.

Model Cost Input shape Features Context Why it is close
CodeLlama-70b-Instruct-hf
anyscale
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
Low overlap
4.1K
Same provider
Overall 35%
Llama-2-70b-chat-hf
anyscale
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
Low overlap
4.1K
Same provider
Overall 35%
qwen2p5-coder-32b-instruct
fireworks_ai
In $0.9000 / 1M tokens
Out $0.9000 / 1M tokens
text
Output: text
Low overlap
4.1K
Partial I/O overlap
Overall 33%
code-llama-70b
fireworks_ai
In $0.9000 / 1M tokens
Out $0.9000 / 1M tokens
text
Output: text
Low overlap
4.1K
Partial I/O overlap
Overall 33%
code-llama-70b-instruct
fireworks_ai
In $0.9000 / 1M tokens
Out $0.9000 / 1M tokens
text
Output: text
Low overlap
4.1K
Partial I/O overlap
Overall 33%
code-llama-70b-python
fireworks_ai
In $0.9000 / 1M tokens
Out $0.9000 / 1M tokens
text
Output: text
Low overlap
4.1K
Partial I/O overlap
Overall 33%
Meta-Llama-3-70B-Instruct
anyscale
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
Low overlap
8.2K
Same provider
Overall 28%
ai21.jamba-instruct-v1:0
Bedrock
In $0.5000 / 1M tokens
Out $0.7000 / 1M tokens
text
Output: text
Low overlap
4.1K
Partial I/O overlap
Overall 27%
sonar
perplexity
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
Low overlap
128.0K
Partial I/O overlap
Overall 20%
Hermes-3-Llama-3.1-405B
deepinfra
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
text
Output: text
Low overlap
131.1K
Partial I/O overlap
Overall 20%
llama-3.1-70b-instruct
perplexity
In $1.0000 / 1M tokens
Out $1.0000 / 1M tokens
Output: unknown
Low overlap
131.1K
Partial I/O overlap
Overall 20%
Llama-2-13b-chat-hf
anyscale
In $0.2500 / 1M tokens
Out $0.2500 / 1M tokens
Output: unknown
Low overlap
4.1K
Same provider
Overall 20%
Mixtral-8x22B-Instruct-v0.1
anyscale
In $0.9000 / 1M tokens
Out $0.9000 / 1M tokens
Output: unknown
Low overlap
65.5K
Same provider
Overall 19%
Llama-2-7b-chat-hf
anyscale
In $0.1500 / 1M tokens
Out $0.1500 / 1M tokens
Output: unknown
Low overlap
4.1K
Same provider
Overall 18%
us.writer.palmyra-x4-v1:0
bedrock_converse
In $2.5000 / 1M tokens
Out $10.0000 / 1M tokens
pdftext
Output: text
Low overlap
8.2K
Partial I/O overlap
Overall 12%
ai21.j2-mid-v1
Bedrock
In $12.5000 / 1M tokens
Out $12.5000 / 1M tokens
text
Output: text
Low overlap
8.2K
Partial I/O overlap
Overall 9%
ai21.j2-ultra-v1
Bedrock
In $18.8000 / 1M tokens
Out $18.8000 / 1M tokens
text
Output: text
Low overlap
8.2K
Partial I/O overlap
Overall 9%
ai21.jamba-1-5-mini-v1:0
Bedrock
In $0.2000 / 1M tokens
Out $0.4000 / 1M tokens
text
Output: text
Low overlap
256.0K
Partial I/O overlap
Overall 6%
ai21.jamba-1-5-large-v1:0
Bedrock
In $2.0000 / 1M tokens
Out $8.0000 / 1M tokens
text
Output: text
Low overlap
256.0K
Partial I/O overlap
Overall 6%