← All models

llama3.3-70b-instruct-fp8

lambda_ai · chat model

llama3.3-70b-instruct-fp8 is listed here as a chat model from lambda_ai. This page shows simple API pricing, token limits, and capability flags so you can compare it with similar options.

Input
$0.1200 / 1M tokens
Output
$0.3000 / 1M tokens
Cached input
N/A
Context
131.1K

Quick read

Best for

Use this page when you need a fast view of cost, context size, and supported features before testing the model in your own workload.

Things to verify

Always check the provider page for discounts, cache pricing, region rules, and any model limits that may not appear in public metadata.

Pricing

Item Price
Input
$0.1200 / 1M tokens
Output
$0.3000 / 1M tokens
Embedding
$0.1200 / 1M tokens

Token limits

Context window
131.1K
Max input tokens
131.1K
Max output tokens
131.1K
Max tokens
131.1K

Capabilities

Capability Supported
Vision
Function calling
Parallel function calling
Tool choice
Prompt caching
Reasoning
Response schema
System messages
Audio input
Audio output
Web search
PDF input
Video input

Benchmarks

Most benchmark rows are attached to the base model family rather than this provider route. Open benchmark explorer

Benchmark Score Metric Scope Checked Source
MMLU (CoT) 86.0 macro_avg/acc Base model: Llama 3.3 (Llama-3.3 70B Instruct) 2026-05-31 Link
MMLU-Pro (CoT) 68.9 macro_avg/acc Base model: Llama 3.3 (Llama-3.3 70B Instruct) 2026-05-31 Link
GPQA Diamond 50.5 acc Base model: Llama 3.3 (Llama-3.3 70B Instruct) 2026-05-31 Link
HumanEval 88.4 pass@1 Base model: Llama 3.3 (Llama-3.3 70B Instruct) 2026-05-31 Link
MATH (CoT) 77.0 sympy_intersection_score Base model: Llama 3.3 (Llama-3.3 70B Instruct) 2026-05-31 Link
MMLU (CoT) 86.0 macro_avg/acc Base model: Llama 3.3 (Llama-3.3 70B Instruct) 2026-05-31 Link
MMLU-Pro (CoT) 68.9 macro_avg/acc Base model: Llama 3.3 (Llama-3.3 70B Instruct) 2026-05-31 Link
IFEval 92.1 Base model: Llama 3.3 (Llama-3.3 70B Instruct) 2026-05-31 Link
HumanEval 88.4 pass@1 Base model: Llama 3.3 (Llama-3.3 70B Instruct) 2026-05-31 Link

Sources

Source links
Pricing data LiteLLM model cost map
Synced at 2026-05-28

Similar models

This list is ranked by overall similarity. Use filters to emphasize the lens that matters most for the replacement you are making.

Comparing from
Model Cost Input shape Features Context Why it is close
llama3.3-70b-instruct-fp8
lambda_ai
In $0.1200 / 1M tokens
Out $0.3000 / 1M tokens
Output: unknown
Function callingParallel function callingTool choiceSystem messages
131.1K
Current model
Reference row

Overall blends cost, modality overlap, capabilities, and context.

Model Cost Input shape Features Context Why it is close
Qwen2.5-72B-Instruct
hyperbolic
In $0.1200 / 1M tokens
Out $0.3000 / 1M tokens
Output: unknown
Function callingParallel function callingTool choiceSystem messages
131.1K
Partial I/O overlap
Overall 60%
Llama-3.3-70B-Instruct
hyperbolic
In $0.1200 / 1M tokens
Out $0.3000 / 1M tokens
Output: unknown
Function callingParallel function callingTool choiceSystem messages
131.1K
Partial I/O overlap
Overall 60%
Meta-Llama-3-70B-Instruct
hyperbolic
In $0.1200 / 1M tokens
Out $0.3000 / 1M tokens
Output: unknown
Function callingParallel function callingTool choiceSystem messages
131.1K
Partial I/O overlap
Overall 60%
hermes3-70b
lambda_ai
In $0.1200 / 1M tokens
Out $0.3000 / 1M tokens
Output: unknown
Function callingParallel function callingTool choiceSystem messages
131.1K
Same provider
Overall 60%
llama3.1-70b-instruct-fp8
lambda_ai
In $0.1200 / 1M tokens
Out $0.3000 / 1M tokens
Output: unknown
Function callingParallel function callingTool choiceSystem messages
131.1K
Same provider
Overall 60%
llama3.1-nemotron-70b-instruct-fp8
lambda_ai
In $0.1200 / 1M tokens
Out $0.3000 / 1M tokens
Output: unknown
Function callingParallel function callingTool choiceSystem messages
131.1K
Same provider
Overall 60%
lfm-40b
lambda_ai
In $0.1000 / 1M tokens
Out $0.2000 / 1M tokens
Output: unknown
Function callingParallel function callingTool choiceSystem messages
131.1K
Same provider
Overall 55%
deepseek-v3-0324
lambda_ai
In $0.2000 / 1M tokens
Out $0.6000 / 1M tokens
Output: unknown
Function callingParallel function callingTool choiceSystem messages
131.1K
Same provider
Overall 51%
Hermes-3-Llama-3.1-70B
hyperbolic
In $0.1200 / 1M tokens
Out $0.3000 / 1M tokens
Output: unknown
Function callingParallel function callingTool choiceSystem messages
32.8K
Partial I/O overlap
Overall 49%
Qwen2.5-Coder-32B-Instruct
hyperbolic
In $0.1200 / 1M tokens
Out $0.3000 / 1M tokens
Output: unknown
Function callingParallel function callingTool choiceSystem messages
32.8K
Partial I/O overlap
Overall 49%
Llama-3.2-3B-Instruct
hyperbolic
In $0.1200 / 1M tokens
Out $0.3000 / 1M tokens
Output: unknown
Function callingParallel function callingTool choiceSystem messages
32.8K
Partial I/O overlap
Overall 49%
qwen25-coder-32b-instruct
lambda_ai
In $0.0500 / 1M tokens
Out $0.1000 / 1M tokens
Output: unknown
Function callingParallel function callingTool choiceSystem messages
131.1K
Same provider
Overall 47%
gpt-audio-mini-2025-10-06
Azure
In $0.6000 / 1M tokens
Out $2.4000 / 1M tokens
Output: audio, text
Function callingParallel function callingTool choiceSystem messages
16.4K
Partial I/O overlap
Overall 30%
gpt-audio-2025-08-28
Azure
In $2.5000 / 1M tokens
Out $10.0000 / 1M tokens
Output: audio, text
Function callingParallel function callingTool choiceSystem messages
16.4K
Partial I/O overlap
Overall 28%
gpt-audio-1.5-2026-02-23
Azure
In $2.5000 / 1M tokens
Out $10.0000 / 1M tokens
Output: audio, text
Function callingParallel function callingTool choiceSystem messages
16.4K
Partial I/O overlap
Overall 28%
gpt-4o-audio-preview-2024-12-17
Azure
In $2.5000 / 1M tokens
Out $10.0000 / 1M tokens
Output: audio, text
Function callingParallel function callingTool choiceSystem messages
16.4K
Partial I/O overlap
Overall 28%
gpt-4o-mini-audio-preview-2024-12-17
Azure
In $2.5000 / 1M tokens
Out $10.0000 / 1M tokens
Output: audio, text
Function callingParallel function callingTool choiceSystem messages
16.4K
Partial I/O overlap
Overall 28%