Skip to content

Model hosting 04 EU compute

Machine Learning Hosting

GPU infrastructure for all your machine learning workloads.

  • GLM
  • DeepSeek
  • Qwen
  • Kimi
  • Mistral
  • Llama
  • gpt-oss
  • Gemma
  • Loes
  • Nemotron
  • Claude Code
  • Codex
  • OpenCode
  • Cursor
  • Cline
  • Loes
  • OpenAI SDK
  • Anthropic SDK

What it does Model hosting

Why machine learning hosting in the EU

Machine learning hosting means different things to different teams, so let us be precise about what HostYourAI does: we serve open machine learning models, today that means large language models, for inference. Models like Llama, Qwen, Mistral, DeepSeek and Gemma run with vLLM on European GPUs, behind an OpenAI-compatible API. Fine-tuning open models is possible too, scoped per project rather than as a self-service button.

What we are not is a training cluster or a generic MLOps suite. If you need to train a foundation model from scratch, you need different infrastructure. If you need a trained open model turned into a reliable production endpoint inside the EU, that is exactly the job this platform was built for.

Read more

01

Inference is where the sensitive data flows

Training happens once on curated data; inference happens millions of times on live customer input. That live traffic is what the GDPR cares about most, and it is the part you can move to European datacenters today without retraining anything.

02

Latency belongs close to your users

If your users are in Europe, serving from Europe removes an ocean from every round trip. For streaming chat interfaces the time to first token is what users feel, and shorter network paths help every single request.

03

Cost control without capacity gambling

Everything runs pay-as-you-go from one prepaid credit balance, topped up with iDEAL, card or SEPA. The shared Router bills per token, dedicated hardware bills per minute, and the pricing page shows how the two combine. No annual commitments to guess at.

02 Model hosting

From trained model to production endpoint

Say your team has picked, or fine-tuned, an open model. Getting it into production has a known shape here. First, check the model catalog: over 700 open models, with a state per model (warm, warming up, serveable, on request). If it is warm on the Router, you can call it immediately per token. If you want guaranteed capacity or a model variant of your own, you deploy dedicated GPU instances: vLLM boots with its own encrypted API key, deployment enforces a VRAM floor so the GPU is never too small for the model, and billing stops the moment you delete the instance. The walkthrough in Deploy your own LLM with vLLM covers the whole path, and the Playground lets you verify behaviour before you write a line of code.

WorkloadThe right shape
Prototyping and low, variable trafficShared Router, pay per token
Steady production traffic on one modelDedicated instance, pay per minute
Your own fine-tuned model weightsDedicated instance running your variant
Domain adaptation of an open modelFine-tuning, scoped per project
Documents grounding the answersKnowledge base linked to Router or instance (RAG)
03 Model hosting

How to start

Every shape speaks the same OpenAI-compatible protocol, so switching from prototype to production is a config change, not a rewrite.

javascript
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://hostyourai.com/api/v1",
  apiKey: "hyai-...",
});

const resp = await client.chat.completions.create({
  model: "qwen3-8b",
  messages: [{ role: "user", content: "Classify this support ticket." }],
});
console.log(resp.choices[0].message.content);
Questions

Questions about machine learning hosting

Can I train models from scratch on HostYourAI?

No. The platform is built for serving open models for inference. Fine-tuning an existing open model is possible as a per-project engagement, but large-scale training is out of scope.

Which model families are available?

Open-weight families such as Llama, Qwen, Mistral, DeepSeek and Gemma. The catalog lists over 700 models with their current serving state.

Does the platform autoscale my deployment?

We make no autoscaling promises. Dedicated instances are fixed capacity that bills per minute until you delete it; for elastic, per-token consumption you use the shared Router instead.

How do I serve my own fine-tuned weights?

Through a dedicated instance: vLLM loads your variant, protected by its own encrypted API key, on a GPU that meets the model's VRAM floor.

Is there support for retrieval over my own documents?

Yes. You can link a knowledge base to the Router or to an instance and relevant context is injected into completions automatically, with source citations on non-streaming responses.

What does hosting cost?

Router usage is billed per token and instances per minute, both drawn from one prepaid credit balance. There are no fixed monthly fees to start.

Everything you need for AI

From model hosting to a customer-facing API, it is built for developers and businesses who want their AI running on infrastructure they actually control, inside the EU.

EU-hosted

100%

Your data and your models stay on European GPUs. GDPR-friendly by design.

Verified models, ready to serve

700+

Llama, Qwen, DeepSeek, Mistral, FLUX and plenty more. Pick one and it is warm in minutes, with no DevOps on your end.

OpenAI & Anthropic compatible

2 SDK

Point your existing client at the Router and keep your tools. No rewrite, no lock-in.

From zero to a warm endpoint in minutes

No infra to manage. Pick a model, get an OpenAI-compatible URL, ship.

01

Pick a model

Choose from the Model Garden or paste any HuggingFace ID. Set the VRAM and pick an EU GPU.

02

Get your endpoint

We deploy vLLM, run readiness probes, and hand you a warm OpenAI- and Anthropic-compatible URL plus an API key.

03

Route and ship

Point your client at the Router. It auto-routes to a warm instance and logs every request.

Private by Default

HostYourAI keeps your models, prompts and data on European GPUs. It is built for teams that care about compliance, reliability and real control.

  • EU-hosted
  • GDPR-friendly
  • OpenAI-compatible
  • vLLM-powered
  • No lock-in

Full data sovereignty

EU

GPUs and data stay inside Europe, and so do your prompts.

Models you can audit

Open

Run open-weight models and see exactly what runs.

No monthly fee

€0

Prepaid credit per token or per minute, so you pay only for what you run.

Your keys, your models

Yours

Your keys, your models and your data. Move whenever you want.

Works with the tools you already use

The Router speaks the OpenAI and Anthropic APIs, so it drops straight into the clients and SDKs your team already runs. Just change the base URL.

  • Docker
  • Anthropic
  • Hugging Face
  • LangChain
  • Python
  • Node.js
  • curl
  • Ollama
  • JetBrains
  • Jupyter
  • Vercel
  • Zapier
  • Postman
  • n8n
The platform

One platform, four layers

Start with one layer and add the others when the work asks for it. They share one key, one balance and one Activity view.

Code

Your coding agent on open models in Europe, set up with one command.

Open

Control

Keys, budgets and guardrails per team, and personal data stopped before any model sees it.

Open

Serve

Shared per token, or running for you alone, from European data centres.

Open

EU compute

Private GPUs in Europe, H100 to B300, sized for response time, generation speed and concurrent users.

Open

Related pages

Explore more about EU-hosted AI on HostYourAI.

StarCoder2 15B Hosting Europe

Host StarCoder2 15B on dedicated 1x L40S / RTX 4090 (24-48 GB) in European data centers. GDPR compliant, from €0.85/hour, OpenAI-compatible API.

Read more

Self-Hosted LLM Platform

Self-hosted LLM platform with managed infrastructure. The control of self-hosting without the complexity.

Read more

Lambda Inference API Alternative

Lambda is winding down its Inference API. Move to HostYourAI: an OpenAI compatible API with open models on European GPUs, DPA included.

Read more

Europe's AI infrastructure.
Come build with us.

Start with one key today. Add dedicated GPUs when your workload needs them.

  • Jantine
  • Hans
  • Sander
  • Jos
  • Daan
  • Kyra
  • Margriet
  • Stan
The team behind HostYourAI