Model garden Router · on request Dedicated · available

Qwen3.8 Flash Next FP4 Local

Runs as your own dedicated GPU deployment, ready to launch from the wizard. Data stays in Europe.

IMPORTANT: the NVFP4 scale factors in this checkpoint are in a new lossless compression format, but upstream vLLM support for this format has not yet landed. You must use one of the containers provided below.

nvidia/Qwen3.8-Flash-Next-FP4-Local On request
text+image->text · nvidia · sovereign EU
Runs on EU infrastructure operated by European companies; US marketplace capacity is never part of this chain. Full chain
96B
Parameters
262K
Context window
160GB
Minimum VRAM
POST /api/v1/chat/completions On request

Specifications

Parameters 96B
Context window 262,144 tokens
Minimum VRAM 160 GB
Architecture Qwen4ExpForConditionalGeneration (vLLM)
License other
Modality text+image->text
Released October 2026
Publisher nvidia ↗

Pricing

Shared router · per token
On request
Not available on the shared router. Pricing on request as a dedicated GPU deployment.
Dedicated GPU · per hour
from €5,33 per hour
Your own vLLM instance on European cloud (160 GB VRAM), billed hourly.

Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly, see pricing.

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "nvidia/Qwen3.8-Flash-Next-FP4-Local",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Frequently asked questions

Can I run Qwen3.8 Flash Next FP4 Local in the EU?

Yes. HostYourAI runs Qwen3.8 Flash Next FP4 Local on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting Qwen3.8 Flash Next FP4 Local GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does Qwen3.8 Flash Next FP4 Local cost?

Qwen3.8 Flash Next FP4 Local needs several GPUs at once, so it runs as a dedicated deployment billed per GPU-hour rather than per token. Tell us your volume and we will work it out with you.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from NVIDIA

Muse Spark Open 816B A42B DFlash2

This model is ready for commercial or non-commercial use. <br

4.4B 1M context View model →
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4

NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4 is the quantized release of NVIDIA Nemotron 3.5 Super VL, a vision-language model for reasoning, coding, tool use, document understanding, and video understanding. It uses NVFP4 quantization to reduce memory requirements, with quantization-aware distillation from the BF16 model.

66B View model →
NVIDIA Nemotron 3.5 Super VL 120B A12B BF16

NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 is the full-precision release of NVIDIA Nemotron 3.5 Super VL, a vision-language model for reasoning, coding, tool use, document understanding, and video understanding. The BF16 weights support customization, domain adaptation, and full-precision evaluation. For optimized deployment, see the NVFP4 release.

124B View model →
NVIDIA Nemotron 3.5 Super VL 120B A12B Base BF16

Looking for a post-trained model? See the BF16 release for customization or the NVFP4 release for optimized deployment.

124B View model →
NVIDIA Nemotron 3.5 Bolt 74B A9B BF16

NVIDIA Nemotron 3.5 Bolt 74B-A9B is a vision-language model (VLM) designed to run everyday agentic tasks locally. This is the full-precision (BF16) release of this model, intended primarily for customization and post-training rather than direct production inference.

75B View model →
GLM 5.3 Flash FP4 Local

IMPORTANT: the NVFP4 scale factors in this checkpoint are in a new lossless compression format, but upstream vLLM support for this format has not yet landed. You must use one of the containers provided below.

175B 1M context View model →

Try Qwen3.8 Flash Next FP4 Local for free

Creating an account takes a minute. Test Qwen3.8 Flash Next FP4 Local straight away in the playground.

Start for free