llama-3.2-90b
vercel_ai_gateway · chat model
llama-3.2-90b is listed here as a chat model from vercel_ai_gateway. This page shows simple API pricing, token limits, and capability flags so you can compare it with similar options.
Input
$0.7200 / 1M tokens
Output
$0.7200 / 1M tokens
Cached input
N/A
Context
8.2K
Quick read
Best for
Use this page when you need a fast view of cost, context size, and supported features before testing the model in your own workload.
Things to verify
Always check the provider page for discounts, cache pricing, region rules, and any model limits that may not appear in public metadata.
Pricing
| Item | Price |
|---|---|
| Input | $0.7200 / 1M tokens |
| Output | $0.7200 / 1M tokens |
| Embedding | $0.7200 / 1M tokens |
Token limits
Context window
8.2K
Max input tokens
128.0K
Max output tokens
8.2K
Max tokens
8.2K
Capabilities
| Capability | Supported |
|---|---|
| Vision | ✅ |
| Function calling | ✅ |
| Parallel function calling | — |
| Tool choice | ✅ |
| Prompt caching | — |
| Reasoning | — |
| Response schema | — |
| System messages | — |
| Audio input | — |
| Audio output | — |
| Web search | — |
| PDF input | — |
| Video input | — |
Benchmarks
Most benchmark rows are attached to the base model family rather than this provider route. Open benchmark explorer
| Benchmark | Score | Metric | Scope | Checked | Source |
|---|---|---|---|---|---|
| MMLU | 32.2 | macro_avg/acc_char | Base model: Llama 3.2 (Llama 3.2 1B) | 2026-05-31 | Link |
| ARC-Challenge | 32.8 | acc_char | Base model: Llama 3.2 (Llama 3.2 1B) | 2026-05-31 | Link |
| SQuAD | 49.2 | em | Base model: Llama 3.2 (Llama 3.2 1B) | 2026-05-31 | Link |
| MMLU | 58 | macro_avg/acc_char | Base model: Llama 3.2 (Llama 3.2 3B) | 2026-05-31 | Link |
| ARC-Challenge | 69.1 | acc_char | Base model: Llama 3.2 (Llama 3.2 3B) | 2026-05-31 | Link |
| SQuAD | 67.7 | em | Base model: Llama 3.2 (Llama 3.2 3B) | 2026-05-31 | Link |
| MMLU | 49.3 | macro_avg/acc | Base model: Llama 3.2 (Llama 3.2 1B bf16) | 2026-05-31 | Link |
| IFEval | 59.5 | Avg(Prompt/Instruction acc Loose/Strict) | Base model: Llama 3.2 (Llama 3.2 1B bf16) | 2026-05-31 | Link |
| MMLU | 63.4 | macro_avg/acc | Base model: Llama 3.2 (Llama 3.2 3B bf16) | 2026-05-31 | Link |
| IFEval | 77.4 | Avg(Prompt/Instruction acc Loose/Strict) | Base model: Llama 3.2 (Llama 3.2 3B bf16) | 2026-05-31 | Link |
Sources
| Source links | |
| Pricing data | LiteLLM model cost map |
| Synced at | 2026-05-28 |
Docs
| Official docs |
Similar models
This list is ranked by overall similarity. Use filters to emphasize the lens that matters most for the replacement you are making.
Comparing from
| Model | Cost | Input shape | Features | Context | Why it is close |
|---|---|---|---|---|---|
| llama-3.2-90b vercel_ai_gateway | In $0.7200 / 1M tokens Out $0.7200 / 1M tokens | imagetext
Output: text | VisionFunction callingTool choice | 8.2K | Current model Reference row |
| Model | Cost | Input shape | Features | Context | Why it is close |
|---|---|---|---|---|---|
| mistral-large-3 azure_ai | In $0.5000 / 1M tokens Out $1.5000 / 1M tokens | imagetext
Output: text | VisionFunction callingTool choice | 8.2K | Text + image covered Overall 92% |
| llama-4-scout vercel_ai_gateway | In $0.1000 / 1M tokens Out $0.3000 / 1M tokens | imagetext
Output: text | VisionFunction callingTool choice | 8.2K | Same provider Overall 86% |
| Llama-4-Scout-17B-16E-Instruct azure_ai | In $0.2000 / 1M tokens Out $0.7800 / 1M tokens | imagetext
Output: text | VisionFunction callingTool choice | 16.4K | Text + image covered Overall 85% |
| llama-3.2-11b vercel_ai_gateway | In $0.1600 / 1M tokens Out $0.1600 / 1M tokens | imagetext
Output: text | VisionFunction callingTool choice | 8.2K | Same provider Overall 84% |
| Llama-4-Maverick-17B-128E-Instruct-FP8 azure_ai | In $1.4100 / 1M tokens Out $0.3500 / 1M tokens | imagetext
Output: text | VisionFunction callingTool choice | 16.4K | Text + image covered Overall 82% |
| claude-3-haiku OpenRouter | In $0.2500 / 1M tokens Out $1.2500 / 1M tokens | imagetext
Output: text | VisionFunction callingTool choice | 4.1K | Text + image covered Overall 82% |
| llama-3.3-70b vercel_ai_gateway | In $0.7200 / 1M tokens Out $0.7200 / 1M tokens | imagetext
Output: text | Function callingTool choice | 8.2K | Same provider Overall 80% Missing image |
| Llama-3.2-11B-Vision-Instruct azure_ai | In $0.3700 / 1M tokens Out $0.3700 / 1M tokens | imagetext
Output: text | VisionFunction callingTool choice | 2.0K | Text + image covered Overall 79% |
| Qwen2.5-VL-32B-Instruct deepinfra | In $0.2000 / 1M tokens Out $0.6000 / 1M tokens | imagetext
Output: text | VisionFunction callingTool choice | 128.0K | Text + image covered Overall 78% |
| gpt-4o-mini vercel_ai_gateway | In $0.1500 / 1M tokens Out $0.6000 / 1M tokens | imagetext
Output: text | VisionFunction callingTool choice | 16.4K | Same provider Overall 77% |
| claude-3.5-haiku vercel_ai_gateway | In $0.8000 / 1M tokens Out $4.0000 / 1M tokens | imagetext file
Output: text | VisionFunction callingTool choice | 8.2K | Same provider Overall 76% |
| Llama-3.2-90B-Vision-Instruct azure_ai | In $2.0400 / 1M tokens Out $2.0400 / 1M tokens | imagetext
Output: text | VisionFunction callingTool choice | 2.0K | Text + image covered Overall 76% |
| claude-3-haiku vercel_ai_gateway | In $0.2500 / 1M tokens Out $1.2500 / 1M tokens | imagetext
Output: text | VisionFunction callingTool choice | 4.1K | Same provider Overall 76% |
| mistral-small-2503 azure_ai | In $0.1000 / 1M tokens Out $0.3000 / 1M tokens | imagetext
Output: text | VisionFunction callingTool choice | 128.0K | Text + image covered Overall 72% |
| mistral-large-2512 OpenRouter | In $0.5000 / 1M tokens Out $1.5000 / 1M tokens | imagetext file
Output: text | VisionFunction callingTool choice | 262.1K | Text + image covered Overall 69% |
| meta.llama3-3-70b-instruct-v1:0 bedrock_converse | In $0.7200 / 1M tokens Out $0.7200 / 1M tokens | imagetext
Output: text | Function calling | 4.1K | Partial I/O overlap Overall 64% Missing image |
| meta.llama-3.3-70b-instruct oci | In $0.7200 / 1M tokens Out $0.7200 / 1M tokens | imagetext
Output: unknown | Function calling | 4.0K | Partial I/O overlap Overall 36% Missing text, image |
| meta.llama-4-maverick-17b-128e-instruct-fp8 oci | In $0.7200 / 1M tokens Out $0.7200 / 1M tokens | imagetext
Output: unknown | Function calling | 4.0K | Partial I/O overlap Overall 36% Missing text, image |
| meta.llama-4-scout-17b-16e-instruct oci | In $0.7200 / 1M tokens Out $0.7200 / 1M tokens | imagetext
Output: unknown | Function calling | 4.0K | Partial I/O overlap Overall 36% Missing text, image |
| meta.llama-3.1-70b-instruct oci | In $0.7200 / 1M tokens Out $0.7200 / 1M tokens | imagetext
Output: unknown | Function calling | 4.0K | Partial I/O overlap Overall 36% Missing text, image |
| meta.llama-3.3-70b-instruct-fp8-dynamic oci | In $0.7200 / 1M tokens Out $0.7200 / 1M tokens | imagetext
Output: unknown | Function calling | 4.0K | Partial I/O overlap Overall 36% Missing text, image |
No models match this filter.