Model garden Router · on request Dedicated · available

Kimi K2 Thinking NVFP4

Runs as your own dedicated GPU deployment, ready to launch from the wizard. Data stays in Europe.

This model is ready for commercial/non-commercial use. <br

nvidia/Kimi-K2-Thinking-NVFP4 On request
text->text · nvidia · sovereign EU
Runs on EU infrastructure operated by European companies; US marketplace capacity is never part of this chain. Full chain
519B
Parameters
262K
Context window
714GB
Minimum VRAM
POST /api/v1/chat/completions On request

Specifications

Parameters 519B
Context window 262,144 tokens
Minimum VRAM 714 GB
Architecture DeepseekV3ForCausalLM (vLLM)
License other
Modality text->text
Released December 2025
Publisher nvidia ↗

Pricing

Shared router · per token
On request
Not available on the shared router. Pricing on request as a dedicated GPU deployment.
Dedicated GPU · per hour
from €23,76 per hour
Your own vLLM instance on European cloud (714 GB VRAM), billed hourly.

Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly, see pricing.

Bench index

Bench is our quality index for every model, 0 to 100. It rests on public measurements (Epoch AI with about 40 benchmarks, LiveBench, LMArena and more) and is refreshed every morning. Where nobody measures, it shows an estimate with a range.

65.2 / 100 · Via LiveBench

Translated from its LiveBench result onto the same scale.

Range 58.9 to 71.5

Sources: Epoch AI ↗ · LiveBench ↗ · LMArena ↗ · Refreshed daily, last on 28-10-2026

LiveBench · 61.6
Reasoning 63.5
Coding 67.4
Agentic coding 38.3
Mathematics 81.1
Data analysis 52.3
Language 66.5
Instruction following 62.0
LiveBench · All tasks
Reasoning
theory of mind 57.7
zebra puzzle 46.3
spatial 92.0
logic with navigation 58.0
Coding
code generation 71.8
code completion 63.0
Agentic coding
javascript 40.0
typescript 20.0
python 55.0
Mathematics
AMPS Hard 96.0
integrals with game 52.0
math comp 96.1
olympiad 80.3
Data analysis
consecutive events 15.7
tablejoin 45.1
tablereformat 96.1
Language
connections 88.0
plot unscrambling 43.4
typos 68.0
Instruction following
paraphrase 63.4
simplify 50.9
story generation 67.4
summarize 66.5

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "nvidia/Kimi-K2-Thinking-NVFP4",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Frequently asked questions

Can I run Kimi K2 Thinking NVFP4 in the EU?

Yes. HostYourAI runs Kimi K2 Thinking NVFP4 on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting Kimi K2 Thinking NVFP4 GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does Kimi K2 Thinking NVFP4 cost?

Kimi K2 Thinking NVFP4 needs several GPUs at once, so it runs as a dedicated deployment billed per GPU-hour rather than per token. Tell us your volume and we will work it out with you.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from NVIDIA

Muse Spark Open 816B A42B DFlash2

This model is ready for commercial or non-commercial use. <br

4.4B 1M context View model →
NVIDIA Nemotron 3.5 Super VL 120B A12B BF16

NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 is the full-precision release of NVIDIA Nemotron 3.5 Super VL, a vision-language model for reasoning, coding, tool use, document understanding, and video understanding. The BF16 weights support customization, domain adaptation, and full-precision evaluation. For optimized deployment, see the NVFP4 release.

124B View model →
NVIDIA Nemotron 3.5 Super VL 120B A12B Base BF16

Looking for a post-trained model? See the BF16 release for customization or the NVFP4 release for optimized deployment.

124B View model →
NVIDIA Nemotron 3.5 Bolt 74B A9B BF16

NVIDIA Nemotron 3.5 Bolt 74B-A9B is a vision-language model (VLM) designed to run everyday agentic tasks locally. This is the full-precision (BF16) release of this model, intended primarily for customization and post-training rather than direct production inference.

75B View model →
Qwen3.8 Flash Next FP4 Local

IMPORTANT: the NVFP4 scale factors in this checkpoint are in a new lossless compression format, but upstream vLLM support for this format has not yet landed. You must use one of the containers provided below.

96B 262K context View model →
GLM 5.3 Flash FP4 Local

IMPORTANT: the NVFP4 scale factors in this checkpoint are in a new lossless compression format, but upstream vLLM support for this format has not yet landed. You must use one of the containers provided below.

175B 1M context View model →

Try Kimi K2 Thinking NVFP4 for free

Creating an account takes a minute. Test Kimi K2 Thinking NVFP4 straight away in the playground.

Start for free