AI Rate Card

Llama 3.1 Nemotron 70B Instruct · deepinfra

Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries. This model reaches Arena Hard of 85.0, AlpacaEval 2 LC of 57.6 and GPT-4-Turbo MT-Bench of 8.98, which are known to be predictive of LMSys Chatbot Arena Elo. As of 16th Oct 2024, this model is #1 on all three automatic alignment benchmarks (verified tab for AlpacaEval 2 LC), edging out strong frontier models such as GPT-4o and Claude 3.5 Sonnet.

Base modelAll models on this baseAll models of the providerto the provider

Input, $/1M $1.20

Output, $/1M $1.20

Limits

  • Every plan: 200 requests at once

Last checked 04.11.2026 12:08:11 UTC Source

Context 131 072

Accepts —

Last checked 04.11.2026 12:00:14 UTC

Source —

Price alerts

Sign in to follow the price

API

This model type has no common request format: see the provider's documentation.

Provider's API documentation

Source: AI Rate Card, https://airatecard.com/en/c/offer%3Adeepinfra%7Cnvidia/Llama-3.1-Nemotron-70B-Instruct, prices checked 2026-11-04

Technical details

ID: offer:deepinfra|nvidia/Llama-3.1-Nemotron-70B-Instruct