MetaLlama 3.1Open SourceArena #178Oct 15, 2024
NVIDIA: Llama 3.1 Nemotron 70B Instruct
NVIDIA's Llama 3.1 Nemotron 70B is a language model designed for generating precise and useful responses. Leveraging Llama 3.1 70B architecture and Reinforcement Learning from Human Feedback (RLHF), it excels in automatic alignment benchmarks. This model is tailored for applications requiring high accuracy in helpfulness and response generation, suitable for diverse user queries across multiple domains. Usage of this model is subject to Meta's Acceptable Use Policy.
Context Window
131K
tokens
Max Output
16K
tokens
Released
Oct 15, 2024
Arena Rank
#178
of 305 models
Capabilities
👁Vision
🧠Reasoning
🔧Tool Calling
⚡Prompt Caching
🖥Computer Use
🎨Image Generation
Supported Parameters
Frequency Penalty
Reduce repetition
Max Tokens
Output length limit
min_p
Presence Penalty
Encourage new topics
Repetition Penalty
Penalize repeated tokens
Response Format
JSON mode / structured output
Seed
Deterministic outputs
Stop Sequences
Custom stop tokens
Temperature
Controls randomness
Tool Choice
Control tool usage
Tool Calling
Function calling support
Top K
Top-K sampling
Top P
Nucleus sampling
Pricing Comparison
| Router | Input / 1M | Output / 1M | Cached Input / 1M |
|---|---|---|---|
| OpenRouter | $1.20 | $1.20 | — |
| Martian | $1.20 | $1.20 | — |
| DeepInfra | $1.20 | $1.20 | — |
Benchmarks
Open LLM Leaderboard
AverageOpen LLM Leaderboard
36.91/100IFEvalOpen LLM Leaderboard
73.81/100BBHOpen LLM Leaderboard
47.11/100MATH Lvl 5Open LLM Leaderboard
42.67/100GPQAOpen LLM Leaderboard
1.12/100MUSROpen LLM Leaderboard
13.2/100MMLU-PROOpen LLM Leaderboard
43.54/100Model IDs
OpenRouter
nvidia/llama-3.1-nemotron-70b-instructHugging Facenvidia/Llama-3.1-Nemotron-70B-Instruct-HF ↗
Tags
tool-calling
Related Models
Meta#133
Meta: Llama 3.1 405B (base)
33K ctx$0.40/1M in
Meta#180
Meta: Llama 3.1 70B Instruct
131K ctx$0.40/1M in
Meta#232
Meta: Llama 3.1 8B Instruct
16K ctx$0.02/1M in
Meta
Meta Llama 3.1 70B Instruct Turbo
131K ctx$0.88/1M in
Meta
Meta Llama 3.1 8B Instruct Turbo
131K ctx$0.18/1M in
Meta
Meta Llama 3.1 405B Instruct
131K ctx$0.80/1M in