Model garden On request

Nemotron Mini 4B Instruct

This model runs as a dedicated deployment on large GPUs and isn't in the shared playground by default. Get in touch and we'll set it up for you.

Nemotron-Mini-4B-Instruct is a model for generating responses for roleplaying, retrieval augmented generation, and function calling. It is a small language model (SLM) optimized through distillation, pruning and quantization for speed and on-device deployment. It is a fine-tuned...

nvidia/Nemotron-Mini-4B-Instruct On request
text->text · nvidia · EU-hosted
4B
Parameters
4K
Context window
10GB
Minimum VRAM
POST /api/v1/chat/completions On request

Specifications

Parameters 4B
Context window 4,096 tokens
Minimum VRAM 10 GB
Architecture NemotronForCausalLM (vLLM)
License other
Modality text->text
Released September 2024
Publisher nvidia ↗

Pricing

€0.03
Input (per 1M tokens)
€0.08
Output (per 1M tokens)

Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly, see pricing.

Not available on the shared router. Pricing on request as a dedicated GPU deployment.

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "nvidia/Nemotron-Mini-4B-Instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Frequently asked questions

Can I run Nemotron Mini 4B Instruct in the EU?

Yes. HostYourAI runs Nemotron Mini 4B Instruct on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting Nemotron Mini 4B Instruct GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does Nemotron Mini 4B Instruct cost?

Via the shared EU router you pay €0.03 per million input tokens and €0.08 per million output tokens, with no fixed costs. For high volume or isolation you can also run Nemotron Mini 4B Instruct as a dedicated hourly GPU instance.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from NVIDIA

Request access

Nemotron Mini 4B Instruct isn't available by default yet. Leave your details and we'll arrange a dedicated deployment.

Request access