GPU infrastructure pioneer releasing open AI models optimised for enterprise deployment.
About
NVIDIA, the world's leading GPU manufacturer, has become a major open-source AI model publisher. The Nemotron series — RLHF fine-tuned on top of Llama — leads open-source helpfulness rankings while NVIDIA NIM provides containerised model inference optimised for NVIDIA hardware. Nemotron-4 340B was released as a fully open research model, while Llama-3.1-Nemotron-70B topped open-source model rankings on helpfulness.
Key highlights
Llama-3.1-Nemotron-70B led open-source helpfulness benchmarks at launch
NVIDIA NIM provides production-ready containerised inference for all major models
Nemotron-4 340B released fully open for synthetic training data generation
Available on NVIDIA API Catalog with a free tier for developers
All Nemotron models run optimally on NVIDIA H100/A100 hardware
Models
Context windows, pricing, capabilities, and API identifiers — everything you need to choose the right model for your workload.
2024
A Llama 3.1 70B model fine-tuned with NVIDIA RLHF for maximum helpfulness. Topped the open-source MT-Bench and Arena-Hard helpfulness rankings at launch.
nvidia/llama-3.1-nemotron-70b-instruct2024
A massive 340B dense model released for research and synthetic data generation. Useful as a teacher model for distillation and generating high-quality training sets.
nvidia/nemotron-4-340b-instruct2024
A knowledge-distilled 8B model pruned from Mistral NeMo 12B using NVIDIA pruning and distillation techniques. Strong performance for its compact size.
nvidia/mistral-nemo-minitron-8b-instructUse Cases
Each provider has specialisms shaped by their architecture decisions, training data, and API design. Here is where NVIDIA performs best.
Get started
Visit the official NVIDIA platform to access API keys, documentation, and pricing details.