HostYourAI
Product
EU RouterHostYourAI CodeOpenAI-compatible APIAnthropic-compatible APIModel GardenDedicated InstancesPlaygroundFine-tuning (Loes)Connect your GPU pool
Solutions
Use cases
HostYourAI CodeLLM InferenceRAG pipelinesChatbotsAI agentsFine-tuning
Industries
GovernmentHealthcareFinanceLegal
Models
Kimi K3DeepSeek V4 ProDeepSeek V4 FlashGLM 5.2Llama 3.1 405BQwen3.5 397BLlama 3.3 70BMistralDeepSeek R1All models →
Compare
Azure OpenAIAWS BedrockClaude APIChatGPTOpenAI
Resources
DocumentationGuide: migrate to the EU RouterGuide: deploy your own LLM (vLLM)Guide: build RAG on EU GPUsModel catalog
Pricing
NL EN DE
Login Book Demo Get Started
Model garden Router · on request Dedicated · available

Gemma 4 31B IT NVFP4

Runs as your own dedicated GPU deployment, ready to launch from the wizard. Data stays in Europe.

This model is ready for commercial/non-commercial use. <br

Start for free ← All models
nvidia/Gemma-4-31B-IT-NVFP4 vLLM ready
text->text · nvidia · sovereign EU
Runs on EU infrastructure operated by European companies; US marketplace capacity is never part of this chain. Full chain
21B
Parameters
262K
Context window
48GB
Minimum VRAM
POST /api/v1/chat/completions On request

Specifications

Parameters 21B
Context window 262,144 tokens
Minimum VRAM 48 GB
Architecture Gemma4ForConditionalGeneration (vLLM)
License other
Modality text->text
Released April 2026
Publisher nvidia ↗

Pricing

Shared router · per token
On request
Not available on the shared router. Pricing on request as a dedicated GPU deployment.
Dedicated GPU · per hour
from €2,16 per hour
Your own vLLM instance on European cloud (48 GB VRAM), billed hourly.

Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly, see pricing.

✓ Verified working on 31-07-2026, responded in 3714 ms on our EU infrastructure.

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "nvidia/Gemma-4-31B-IT-NVFP4",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Frequently asked questions

Can I run Gemma 4 31B IT NVFP4 in the EU?

Yes. HostYourAI runs Gemma 4 31B IT NVFP4 on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting Gemma 4 31B IT NVFP4 GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does Gemma 4 31B IT NVFP4 cost?

Gemma 4 31B IT NVFP4 is available on request: through the shared EU router after a quick chat, or as your own dedicated GPU deployment billed per hour. Tell us your use case and we will set it up for you.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from NVIDIA

NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4

The pre-training data has a cutoff date of September 2025. The post-training data has a cutoff date of May 2026.

18B 1M context View model →
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16

The pre-training data has a cutoff date of September 2025. The post-training data has a cutoff date of May 2026.

32B 262K context View model →
Ising Calibration 1.5 31B NVFP4

GOVERNING TERMS: Use of this model is governed by the OpenMDW License Agreement, version 1.1. ADDITIONAL INFORMATION: Apache License, Version 2.0.

17B 262K context View model →
Ising Calibration 1.5 31B BF16

GOVERNING TERMS: Use of this model is governed by the OpenMDW License Agreement, version 1.1. ADDITIONAL INFORMATION: Apache License, Version 2.0.

31B 262K context View model →
Cosmos3 Super Text2Image 4Step

Cosmos3-Super-Text2Image-4Step is a 4-step distilled version of the base Cosmos3-Super-Text2Image model. Given a text prompt, it generates a high-fidelity image.

64B 262K context View model →
Qwen Image Flash

The NVIDIA Qwen-Image-Flash model generates images from text prompts using a four-step, DMD2-distilled version of Qwen/Qwen-Image. The distillation used DMD2 from NVIDIA FastGen, NVIDIA Model Optimizer, and NVIDIA AutoModel while retaining the base model architecture. The packaged scheduler is configured for the four-step, shift-3 trajectory.

20B View model →

Try Gemma 4 31B IT NVFP4 for free

Creating an account takes a minute. Test Gemma 4 31B IT NVFP4 straight away in the playground.

Start for free