Skip to content

GPU & infra 04 EU compute

Dedicated GPU Instances

Your own GPU, your own model: deploy open models on dedicated European GPUs.

  • GLM
  • DeepSeek
  • Qwen
  • Kimi
  • Mistral
  • Llama
  • gpt-oss
  • Gemma
  • Loes
  • Nemotron
  • Claude Code
  • Codex
  • OpenCode
  • Cursor
  • Cline
  • Loes
  • OpenAI SDK
  • Anthropic SDK

What it does GPU & infra

Your own GPU, your own model

With dedicated instances you run an open model on a GPU that is yours alone. We deploy vLLM, run readiness probes and hand you an OpenAI- and Anthropic-compatible URL. Ideal when you want predictable performance or full isolation.

Read more

02 GPU & infra

How it works

  • Pick a model from the Model Garden or a HuggingFace ID
  • Set the VRAM and choose a European GPU
  • We deploy vLLM and run automatic readiness probes
  • You get a warm endpoint plus an API key

New instances run vLLM with their own encrypted upstream key, so your endpoint stays private.

03 GPU & infra

Pay only for what you run

Instances stay warm while someone is online and idle down when nobody is using them, so you do not pay for an unused GPU. Billed per hour on one prepaid credit balance.

04 GPU & infra

Example in code

Once your instance is warm, you call it through the Router by its model slug, exactly as you would call an OpenAI model:

python
from openai import OpenAI

client = OpenAI(
    base_url="https://hostyourai.com/api/v1",
    api_key="hyai-...",
)

resp = client.chat.completions.create(
    model="your-instance-model",
    messages=[{"role": "user", "content": "Hello"}],
)
print(resp.choices[0].message.content)

Want to deploy step by step? Read the guide Deploy your own LLM with vLLM.

05 GPU & infra

Which GPU for which model

GPU classVRAMTypical use
L40S / RTX 409024 to 48 GBModels up to roughly 20B parameters
A100 / H10080 GBModels up to roughly 70B, quantised
2× H100160 GB70B at full precision or high throughput
4× H100320 GBLarge models and heavy production workloads

On deploy we enforce a VRAM floor per model, so you cannot pick a GPU the model does not fit on. Live hourly prices show before you deploy and on the pricing page.

Questions

Questions about dedicated instances

Can I run my own or fine-tuned model?

Yes. Paste a HuggingFace ID, including a private repo with your own weights, and we deploy it through vLLM on your GPU.

Is my endpoint private?

Yes. New instances run vLLM with their own encrypted API key, so only your platform key can reach the endpoint.

Do I keep paying when nobody uses the model?

Instances idle down when nobody is online, so you do not pay for an unused GPU. You are billed per hour from your prepaid balance.

When do I pick dedicated over the Router?

For steady load, custom models, stricter isolation requirements or full control over behaviour. For variable traffic the shared Router is cheaper and faster to set up.

Can I link a knowledge base?

Yes. Link a knowledge base to your instance and every chat call automatically receives relevant context from your own documents. See the guide Build RAG on EU GPUs.

Where are the GPUs?

In European datacenters. Your data never leaves the EU and a Data Processing Agreement is available. For sector-specific requirements see healthcare and government.

Everything you need for AI

From model hosting to a customer-facing API, it is built for developers and businesses who want their AI running on infrastructure they actually control, inside the EU.

EU-hosted

100%

Your data and your models stay on European GPUs. GDPR-friendly by design.

Verified models, ready to serve

700+

Llama, Qwen, DeepSeek, Mistral, FLUX and plenty more. Pick one and it is warm in minutes, with no DevOps on your end.

OpenAI & Anthropic compatible

2 SDK

Point your existing client at the Router and keep your tools. No rewrite, no lock-in.

From zero to a warm endpoint in minutes

No infra to manage. Pick a model, get an OpenAI-compatible URL, ship.

01

Pick a model

Choose from the Model Garden or paste any HuggingFace ID. Set the VRAM and pick an EU GPU.

02

Get your endpoint

We deploy vLLM, run readiness probes, and hand you a warm OpenAI- and Anthropic-compatible URL plus an API key.

03

Route and ship

Point your client at the Router. It auto-routes to a warm instance and logs every request.

Works with the tools you already use

The Router speaks the OpenAI and Anthropic APIs, so it drops straight into the clients and SDKs your team already runs. Just change the base URL.

  • Docker
  • Anthropic
  • Hugging Face
  • LangChain
  • Python
  • Node.js
  • curl
  • Ollama
  • JetBrains
  • Jupyter
  • Vercel
  • Zapier
  • Postman
  • n8n

Built for teams that can't send data away

If a US cloud is off the table, HostYourAI gives you the same developer experience on European infrastructure.

01

Public sector & government

Citizen data that legally has to stay in the EU, with full auditability.

02

Regulated enterprise

Finance, healthcare and legal teams under GDPR, DORA and the AI Act.

03

EU SaaS & scale-ups

Ship AI features your customers trust, without a US sub-processor.

04

Agencies & integrators

Deliver private AI for clients on infrastructure you can stand behind.

The platform

One platform, four layers

Start with one layer and add the others when the work asks for it. They share one key, one balance and one Activity view.

Code

Your coding agent on open models in Europe, set up with one command.

Open

Control

Keys, budgets and guardrails per team, and personal data stopped before any model sees it.

Open

Serve

Shared per token, or running for you alone, from European data centres.

Open

EU compute

Private GPUs in Europe, H100 to B300, sized for response time, generation speed and concurrent users.

Open

Related pages

Explore more about EU-hosted AI on HostYourAI.

OpenAI-compatible API

A drop-in OpenAI-compatible API on European GPUs. Change only the base URL and run open models, GDPR-friendly, without rewriting your code.

Read more

RAG Pipelines Hosting

Host RAG pipelines for AI with your own knowledge base. Vector databases, embeddings, and LLMs in one platform.

Read more

Fine-Tuning LLM

Fine-tune LLMs for your specific use case. LoRA, QLoRA, full fine-tuning on dedicated GPUs.

Read more

Europe's AI infrastructure.
Come build with us.

Start with one key today. Add dedicated GPUs when your workload needs them.

  • Jantine
  • Hans
  • Sander
  • Jos
  • Daan
  • Kyra
  • Margriet
  • Stan
The team behind HostYourAI