Skip to content

Fine-tuning 04 EU compute

Fine-Tuning LLM

Fine-tune open source models for your specific needs.

  • GLM
  • DeepSeek
  • Qwen
  • Kimi
  • Mistral
  • Llama
  • gpt-oss
  • Gemma
  • Loes
  • Nemotron
  • Claude Code
  • Codex
  • OpenCode
  • Cursor
  • Cline
  • Loes
  • OpenAI SDK
  • Anthropic SDK

What it does Fine-tuning

Why LLM fine-tuning in the EU

Fine-tuning takes an open model and teaches it your tone, your domain and your task. At HostYourAI this is project work, scoped and planned together, not a self-service button: your training data stays in the EU throughout, and the resulting model deploys to your own dedicated GPU instance served with vLLM. A concrete example is Loes, the sovereign Dutch model brand, fine-tuned from an open base for natural Dutch.

Training data is usually the most sensitive data a company owns: real conversations, real documents, real decisions. Sending it to a training pipeline outside Europe undoes years of careful data governance in one upload. Fine-tuning inside European datacenters keeps the whole loop, from dataset to deployed weights, under EU jurisdiction.

Read more

01

Your weights, your sovereignty

A fine-tuned open model is an asset you own. Unlike a proprietary API that can change pricing, behavior or availability overnight, your weights sit on infrastructure you control and can be redeployed anywhere vLLM runs. That is digital sovereignty in a practical form, and it is why open bases like Llama, Qwen and Mistral from the model catalog are the starting point.

02

Training data is the crown jewels

Datasets built from customer interactions almost always contain personal data, so the GDPR applies to the training run itself, not just to inference. Keeping preparation, training and evaluation in multiple European regions, with AES-256 encryption at rest and a Data Processing Agreement in place, means your legal basis does not depend on third-country transfer mechanisms.

03

Jurisdiction over the whole lifecycle

US cloud providers fall under the CLOUD Act, which can compel disclosure of data regardless of where the servers stand. A training pipeline on European infrastructure under a European provider removes that question entirely, which regulated sectors in particular tend to require.

02 Fine-tuning

When fine-tuning pays off, and when it does not

Fine-tuning is the heaviest tool in the box, so reach for it last. If the model lacks knowledge, retrieval is cheaper and easier to update: the guide Build RAG on EU GPUs shows how a linked knowledge base injects your documents into completions without touching the weights. If the model just needs steering, a good system prompt often suffices. Fine-tuning wins when you need consistent style at scale, deep fluency in a language or domain the base handles poorly, or a smaller model that matches a bigger one on your task and runs cheaper on dedicated GPU instances.

ApproachWhen to choose it
PromptingBehavior fixes with instructions and examples in the prompt
RAGThe model needs your documents or frequently changing knowledge
Fine-tuningConsistent style, domain language or task performance the base lacks
RAG plus fine-tuningDomain fluency and current knowledge at the same time
Smaller fine-tuned modelCut serving cost while keeping quality on one narrow task
03 Fine-tuning

How to start

A fine-tuned model is served exactly like any other: vLLM on your instance, OpenAI-compatible endpoint, your key. While the project is scoped you can already build against a base model such as Qwen3 8B and swap the slug later:

python
from openai import OpenAI

client = OpenAI(
    base_url="https://hostyourai.com/api/v1",
    api_key="hyai-...",
)

response = client.chat.completions.create(
    model="qwen3-8b",
    messages=[
        {"role": "system", "content": "Answer in formal Dutch, two sentences max."},
        {"role": "user", "content": "Explain what a knowledge base link does."},
    ],
)

print(response.choices[0].message.content)
Questions

Questions about LLM fine-tuning

Is fine-tuning self-service?

No. It is scoped per project: dataset review, base model selection, training and evaluation are planned together, and the output deploys to your own instance.

Does my training data leave the EU?

No. Preparation, training and deployment all run in European datacenters, covered by a DPA, and HostYourAI never trains on customer data for its own purposes.

Which base models are suitable?

Open models with permissive licenses, typically Llama, Qwen, Mistral or Gemma variants. The right base depends on your language, task and the GPU budget for serving.

Who owns the fine-tuned weights?

You do, within the license terms of the base model. You can export them and run them on any vLLM-compatible stack, as described in Deploy your own LLM with vLLM.

Should I fine-tune or use RAG?

Start with RAG if the gap is knowledge, since documents change faster than weights. Fine-tune when the gap is style, format or language quality. Many teams end up combining both.

What does it cost?

Training is quoted per project; serving afterwards is pay-as-you-go from your prepaid credit balance. See the pricing page for how billing works.

Everything you need for AI

From model hosting to a customer-facing API, it is built for developers and businesses who want their AI running on infrastructure they actually control, inside the EU.

EU-hosted

100%

Your data and your models stay on European GPUs. GDPR-friendly by design.

Verified models, ready to serve

700+

Llama, Qwen, DeepSeek, Mistral, FLUX and plenty more. Pick one and it is warm in minutes, with no DevOps on your end.

OpenAI & Anthropic compatible

2 SDK

Point your existing client at the Router and keep your tools. No rewrite, no lock-in.

From zero to a warm endpoint in minutes

No infra to manage. Pick a model, get an OpenAI-compatible URL, ship.

01

Pick a model

Choose from the Model Garden or paste any HuggingFace ID. Set the VRAM and pick an EU GPU.

02

Get your endpoint

We deploy vLLM, run readiness probes, and hand you a warm OpenAI- and Anthropic-compatible URL plus an API key.

03

Route and ship

Point your client at the Router. It auto-routes to a warm instance and logs every request.

Private by Default

HostYourAI keeps your models, prompts and data on European GPUs. It is built for teams that care about compliance, reliability and real control.

  • EU-hosted
  • GDPR-friendly
  • OpenAI-compatible
  • vLLM-powered
  • No lock-in

Full data sovereignty

EU

GPUs and data stay inside Europe, and so do your prompts.

Models you can audit

Open

Run open-weight models and see exactly what runs.

No monthly fee

€0

Prepaid credit per token or per minute, so you pay only for what you run.

Your keys, your models

Yours

Your keys, your models and your data. Move whenever you want.

Works with the tools you already use

The Router speaks the OpenAI and Anthropic APIs, so it drops straight into the clients and SDKs your team already runs. Just change the base URL.

  • Docker
  • Anthropic
  • Hugging Face
  • LangChain
  • Python
  • Node.js
  • curl
  • Ollama
  • JetBrains
  • Jupyter
  • Vercel
  • Zapier
  • Postman
  • n8n
The platform

One platform, four layers

Start with one layer and add the others when the work asks for it. They share one key, one balance and one Activity view.

Code

Your coding agent on open models in Europe, set up with one command.

Open

Control

Keys, budgets and guardrails per team, and personal data stopped before any model sees it.

Open

Serve

Shared per token, or running for you alone, from European data centres.

Open

EU compute

Private GPUs in Europe, H100 to B300, sized for response time, generation speed and concurrent users.

Open

Related pages

Explore more about EU-hosted AI on HostYourAI.

Dedicated GPU Instances

Deploy any open model on a dedicated European GPU with vLLM. Your own endpoint, encrypted upstream keys, idle when nobody is online.

Read more

OpenAI-compatible API

A drop-in OpenAI-compatible API on European GPUs. Change only the base URL and run open models, GDPR-friendly, without rewriting your code.

Read more

Model Garden

Browse a curated catalog of serveable open chat, image and embedding models with live warm/EU state. Deploy in one click on European GPUs.

Read more

Europe's AI infrastructure.
Come build with us.

Start with one key today. Add dedicated GPUs when your workload needs them.

  • Jantine
  • Hans
  • Sander
  • Jos
  • Daan
  • Kyra
  • Margriet
  • Stan
The team behind HostYourAI