Skip to content

EU Router 03 Serve

AI API Europe

OpenAI compatible AI API running entirely in Europe.

  • GLM
  • DeepSeek
  • Qwen
  • Kimi
  • Mistral
  • Llama
  • gpt-oss
  • Gemma
  • Loes
  • Nemotron
  • Claude Code
  • Codex
  • OpenCode
  • Cursor
  • Cline
  • Loes
  • OpenAI SDK
  • Anthropic SDK

What it does EU Router

Why an AI API in Europe in the EU

An AI API in Europe should be judged like any other API: by its endpoints, its compatibility and how fast you reach a working request. HostYourAI's API is OpenAI-compatible at https://hostyourai.com/api/v1, authenticated with keys that start with hyai-, and it serves open models like Qwen, Llama, Mistral and DeepSeek with vLLM on European GPUs.

The EU part is not a footnote. Every request is processed in European datacenters, which means the API you build against for convenience is also the one your compliance team can approve: DPA available, public subprocessor list, no training on your data.

Read more

01

Latency where your users are

Streamed tokens generated in Europe arrive at European clients over a short network path. For interactive products, where perceived speed is the time to the first token, keeping inference on the continent is the cheapest performance win you will find.

02

One privacy answer for every feature

Build every AI feature on an EU-processed API and the data protection story is answered once, centrally, instead of per feature. Prompts stay in the EU, encrypted in transit with TLS and at rest with AES-256, and are never used for training.

03

Open models keep you portable

The API serves open-weight models, so the thing you depend on is a standard interface plus public weights, not a proprietary black box. If your needs change, you switch models in the model catalog or move to dedicated GPU instances without touching client code.

02 EU Router

Endpoints and compatibility in detail

The core is POST /v1/chat/completions, matching the OpenAI schema: messages, temperature, max_tokens, and SSE streaming with stream: true. Official OpenAI SDKs work by setting the base URL. Non-streaming responses can also carry a sources array with citations when a knowledge base is linked, as described in Build RAG on EU GPUs.

For code written against the Anthropic SDK there is a /v1/messages shim: it authenticates with an x-api-key header, handles text-only messages, and returns streaming in buffered form. You can try every model in the Playground before writing code, and the per-request activity view shows what each call consumed. Usage is billed per token from a prepaid credit balance; see the pricing page.

EndpointWhat it does
POST /v1/chat/completionsOpenAI-style chat completion, hyai- bearer key
POST /v1/chat/completions with stream: trueToken-by-token output over SSE
POST /v1/messagesAnthropic-compatible shim, x-api-key auth, text-only, buffered streaming
GET /v1/modelsLists the models your key can call
knowledge_base_id in the request bodyInjects RAG context from a linked knowledge base into the completion
03 EU Router

How to start

Generate a key in the dashboard for the EU Inference Router, then make your first streaming call.

javascript
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://hostyourai.com/api/v1",
  apiKey: "hyai-...",
});

const stream = await client.chat.completions.create({
  model: "qwen3-32b",
  messages: [{ role: "user", content: "Write a haiku about servers in Europe." }],
  stream: true,
});
for await (const chunk of stream) {
  process.stdout.write(chunk.choices[0]?.delta?.content ?? "");
}
Questions

Questions about an AI API in Europe

Which SDKs work out of the box?

Any OpenAI SDK that lets you set a base URL. Code written for the Anthropic SDK can use the /v1/messages shim with x-api-key auth.

How does streaming behave?

/v1/chat/completions streams over SSE exactly like OpenAI's API. The Anthropic-compatible /v1/messages endpoint streams in buffered form and supports text-only content.

How do I see what a request cost?

The activity view logs usage per request, and everything draws from one prepaid balance topped up with iDEAL, card or SEPA.

Can the API ground answers in my own data?

Yes. Link a knowledge base to the Router or an instance, or pass knowledge_base_id in the request body, and relevant context is injected automatically. Non-streaming responses include source citations.

Is there a way to test without writing code?

Yes, the Playground in the app lets you chat with any catalog model and tune parameters before you integrate the API.

What availability can I plan for?

The platform carries a 99.9% uptime SLA, and popular models stay warm in a pool so first tokens are not delayed by cold starts.

Everything you need for AI

From model hosting to a customer-facing API, it is built for developers and businesses who want their AI running on infrastructure they actually control, inside the EU.

EU-hosted

100%

Your data and your models stay on European GPUs. GDPR-friendly by design.

Verified models, ready to serve

700+

Llama, Qwen, DeepSeek, Mistral, FLUX and plenty more. Pick one and it is warm in minutes, with no DevOps on your end.

OpenAI & Anthropic compatible

2 SDK

Point your existing client at the Router and keep your tools. No rewrite, no lock-in.

From zero to a warm endpoint in minutes

No infra to manage. Pick a model, get an OpenAI-compatible URL, ship.

01

Pick a model

Choose from the Model Garden or paste any HuggingFace ID. Set the VRAM and pick an EU GPU.

02

Get your endpoint

We deploy vLLM, run readiness probes, and hand you a warm OpenAI- and Anthropic-compatible URL plus an API key.

03

Route and ship

Point your client at the Router. It auto-routes to a warm instance and logs every request.

Private by Default

HostYourAI keeps your models, prompts and data on European GPUs. It is built for teams that care about compliance, reliability and real control.

  • EU-hosted
  • GDPR-friendly
  • OpenAI-compatible
  • vLLM-powered
  • No lock-in

Full data sovereignty

EU

GPUs and data stay inside Europe, and so do your prompts.

Models you can audit

Open

Run open-weight models and see exactly what runs.

No monthly fee

€0

Prepaid credit per token or per minute, so you pay only for what you run.

Your keys, your models

Yours

Your keys, your models and your data. Move whenever you want.

Works with the tools you already use

The Router speaks the OpenAI and Anthropic APIs, so it drops straight into the clients and SDKs your team already runs. Just change the base URL.

  • Docker
  • Anthropic
  • Hugging Face
  • LangChain
  • Python
  • Node.js
  • curl
  • Ollama
  • JetBrains
  • Jupyter
  • Vercel
  • Zapier
  • Postman
  • n8n
The platform

One platform, four layers

Start with one layer and add the others when the work asks for it. They share one key, one balance and one Activity view.

Code

Your coding agent on open models in Europe, set up with one command.

Open

Control

Keys, budgets and guardrails per team, and personal data stopped before any model sees it.

Open

Serve

Shared per token, or running for you alone, from European data centres.

Open

EU compute

Private GPUs in Europe, H100 to B300, sized for response time, generation speed and concurrent users.

Open

Related pages

Explore more about EU-hosted AI on HostYourAI.

AI for the legal sector

AI for lawyers and legal teams on European GPUs. Confidential documents stay in the EU, with open models and a Data Processing Agreement.

Read more

Phi 3.5 MoE Hosting Europe

Host Phi 3.5 MoE on dedicated 1x RTX PRO 6000 (96 GB) in European data centers. GDPR compliant, from €2.21/hour, OpenAI-compatible API.

Read more

Your LLM API and the EU AI Act

The EU AI Act fully applies from 2 August 2026. What it means for teams using LLMs, and how an EU-hosted API with per-request logging and a DPA helps.

Read more

Europe's AI infrastructure.
Come build with us.

Start with one key today. Add dedicated GPUs when your workload needs them.

  • Jantine
  • Hans
  • Sander
  • Jos
  • Daan
  • Kyra
  • Margriet
  • Stan
The team behind HostYourAI