EU Router 03 Serve

OpenAI-compatible API

Keep your OpenAI client and SDK. Change the base URL and run open models on EU GPUs.

Get started Model Garden

Screenshot of the Models page: models on your own GPUs next to models per token, with tier, context, price and first token

What it does EU Router

Drop-in compatible with OpenAI

HostYourAI exposes an OpenAI-compatible endpoint (/v1/chat/completions). Your existing OpenAI SDK keeps working: point the base URL at our Router and use your HostYourAI API key. Streaming, system prompts and parameters behave the way you expect.

02 EU Router

What changes in your code?

02EU Router

Only the base URL and the API key. The rest of your integration stays identical, whether you use Python, Node or another language. You migrate in minutes instead of weeks.

Same request and response format as OpenAI
Streaming over server-sent events
Open models such as Llama, Qwen, Mistral and DeepSeek
Optional RAG context injection when you link a knowledge base

03 EU Router

EU-hosted and privacy-first

The models run on European GPUs you control. Your data never leaves the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open weights also mean no training on your data.

04 EU Router

Example in code

Here is what a request looks like with the OpenAI SDK. Only the base URL and the key change, and streaming behaves the way you expect:

python

from openai import OpenAI

client = OpenAI(
    base_url="https://hostyourai.com/api/v1",
    api_key="hyai-...",
)

resp = client.chat.completions.create(
    model="llama-3.3-70b",
    messages=[{"role": "user", "content": "Hello"}],
    stream=True,
)
for chunk in resp:
    print(chunk.choices[0].delta.content or "", end="")

Want a full step-by-step? Read the guide Migrate your OpenAI client to the EU Router.

05 EU Router

What stays the same, what changes

Part	With OpenAI	With HostYourAI
Endpoint	`/v1/chat/completions`	`/v1/chat/completions`, identical
Base URL	api.openai.com	hostyourai.com/api/v1
API key	`sk-...`	`hyai-...`
Model name	gpt-4o, gpt-4o-mini	llama-3.3-70b, qwen3-8b and more
Streaming	Server-sent events	Server-sent events, identical
Data processing	United States	GPUs in the EU

Frameworks built on the OpenAI API, such as LangChain and LlamaIndex, work as well: you just hand them a different base URL and key.

Questions

Questions about the OpenAI-compatible API

Does this work with LangChain, LlamaIndex and other frameworks?

Yes. Anything that accepts an OpenAI-compatible base URL works directly. You configure the base URL and your hyai- key, nothing else.

Which model replaces gpt-4o?

For general tasks Llama 3.3 70B is the common pick; for speed and low cost a smaller model such as Qwen3 8B. Compare models in the catalog or test them side by side in the Playground.

Does streaming work?

Yes, over server-sent events, exactly like OpenAI. Your existing streaming code stays unchanged.

Can I ground answers in my own documents?

Yes. Link a knowledge base and the Router automatically injects relevant context into your requests. Read the guide Build RAG on EU GPUs.

What does a request cost?

You pay per token, per model class, from one prepaid credit balance. Rates are on the pricing page.

Is this GDPR-proof?

Processing happens on European GPUs, a Data Processing Agreement is available and there is no training on your data. For regulated sectors see healthcare, finance and government.

Everything you need for AI

From model hosting to a customer-facing API, it is built for developers and businesses who want their AI running on infrastructure they actually control, inside the EU.

EU-hosted

100%

Your data and your models stay on European GPUs. GDPR-friendly by design.

Verified models, ready to serve

700+

Llama, Qwen, DeepSeek, Mistral, FLUX and plenty more. Pick one and it is warm in minutes, with no DevOps on your end.

OpenAI & Anthropic compatible

2 SDK

Point your existing client at the Router and keep your tools. No rewrite, no lock-in.

From zero to a warm endpoint in minutes

No infra to manage. Pick a model, get an OpenAI-compatible URL, ship.

01

Pick a model

Choose from the Model Garden or paste any HuggingFace ID. Set the VRAM and pick an EU GPU.

02

Get your endpoint

We deploy vLLM, run readiness probes, and hand you a warm OpenAI- and Anthropic-compatible URL plus an API key.

03

Route and ship

Point your client at the Router. It auto-routes to a warm instance and logs every request.

Built for teams that can't send data away

If a US cloud is off the table, HostYourAI gives you the same developer experience on European infrastructure.

01

Public sector & government

Citizen data that legally has to stay in the EU, with full auditability.

02

Regulated enterprise

Finance, healthcare and legal teams under GDPR, DORA and the AI Act.

03

EU SaaS & scale-ups

Ship AI features your customers trust, without a US sub-processor.

04

Agencies & integrators

Deliver private AI for clients on infrastructure you can stand behind.

Private by Default

HostYourAI keeps your models, prompts and data on European GPUs. It is built for teams that care about compliance, reliability and real control.

EU-hosted
GDPR-friendly
OpenAI-compatible
vLLM-powered
No lock-in

Full data sovereignty

EU

GPUs and data stay inside Europe, and so do your prompts.

Models you can audit

Open

Run open-weight models and see exactly what runs.

No monthly fee

€0

Prepaid credit per token or per minute, so you pay only for what you run.

Your keys, your models

Yours

Your keys, your models and your data. Move whenever you want.

Model garden

Works with 700+ open models

Text and image models on dedicated EU GPUs. Every model tested on our own hardware.

Browse all models

The platform

One platform, four layers

Start with one layer and add the others when the work asks for it. They share one key, one balance and one Activity view.

Code

Your coding agent on open models in Europe, set up with one command.

Open

Control

Keys, budgets and guardrails per team, and personal data stopped before any model sees it.

Open

Serve

Shared per token, or running for you alone, from European data centres.

Open

EU compute

Private GPUs in Europe, H100 to B300, sized for response time, generation speed and concurrent users.

Open

Related pages

Explore more about EU-hosted AI on HostYourAI.

Chatbot Hosting Platform

Host AI chatbots on European infrastructure. Customer service, internal assistants, and more with GDPR compliance.

Dedicated GPU Instances

Deploy any open model on a dedicated European GPU with vLLM. Your own endpoint, encrypted upstream keys, idle when nobody is online.

Fine-Tuning LLM

Fine-tune LLMs for your specific use case. LoRA, QLoRA, full fine-tuning on dedicated GPUs.

OpenAI-compatible API

Drop-in compatible with OpenAI

What changes in your code?

EU-hosted and privacy-first

Example in code

What stays the same, what changes

Questions about the OpenAI-compatible API

Does this work with LangChain, LlamaIndex and other frameworks?

Which model replaces gpt-4o?

Does streaming work?

Can I ground answers in my own documents?

What does a request cost?

Is this GDPR-proof?

Everything you need for AI

From zero to a warm endpoint in minutes

Pick a model

Get your endpoint

Route and ship

Built for teams that can't send data away

Private by Default

Works with 700+ open models

One platform, four layers

Code

Control

Serve

EU compute

Related pages

Europe's AI infrastructure.Come build with us.

Europe's AI infrastructure.
Come build with us.