LLM prices per 1M tokens

264 models · 161 price changes

NVIDIA NIM

Developer hub · fee not published

Unverified

Carries 13 of the models tracked here, from its own model catalog, checked Nov 9, 2026.

About NVIDIA NIM

NVIDIA's API catalog of hosted model endpoints for prototyping plus downloadable NIM inference microservices for self-hosting on NVIDIA GPUs.

Fee on tokens
Not published
Pricing model
Hosted API endpoints free for NVIDIA Developer Program prototyping; production self-hosted NIM requires an NVIDIA AI Enterprise license from $4,500 per GPU per year (about $1 per GPU per hour in the cloud); no per-token price
Bring your own key
No
Entry plan
Usage based
Hosting
Hosted

Features stated: none found. Not stated: Fallbacks, Load balancing, Caching, Guardrails, Observability, Rate limits, Budgets, Prompts, OpenAI-compatible, Bring your own key, Data residency, Private networking.

The terms, in their words

Markup
Hosted API endpoints free for NVIDIA Developer Program prototyping; production self-hosted NIM requires an NVIDIA AI Enterprise license from $4,500 per GPU per year (about $1 per GPU per hour in the cloud); no per-token price
Free tier
Free inference endpoints for NVIDIA Developer Program members (prototyping only); 90-day NVIDIA AI Enterprise trial
  • These licenses start at $4500 per GPU per year or ~ $1 per GPU per hour in the cloud. Pricing is based on the number of GPUs, not the number of NIMs.
  • Members of the NVIDIA Developer Program have free access to NIM API endpoints for prototyping
  • Using NIM in production requires an NVIDIA AI Enterprise license.

Source: docs.api.nvidia.com/nim/docs/product

NVIDIA NIM vsHugging Face InferenceCloudflare Workers AIHeliconeKong AI GatewayLiteLLMNeon AI Gateway