EU Router 03 Serve
Use your Anthropic SDK unchanged and run open models on EU infrastructure.
GLM
DeepSeek
Qwen
Kimi
Mistral
Llama
gpt-oss
Gemma
Loes
Nemotron
Claude Code
Codex
OpenCode
Cursor
Cline
Loes
OpenAI SDK
Anthropic SDKWhat it does EU Router
Besides the OpenAI API, the Router also speaks the Anthropic API. Through /v1/messages you point your existing Anthropic client at HostYourAI with x-api-key authentication (an Authorization: Bearer header works too). You keep your tooling; inference runs on open models in the EU.
Read more
02 EU Router
/v1/messages shape of the Anthropic API, including count_tokensx-api-key or Authorization: BearerThis lets you use one platform for both OpenAI- and Anthropic-based applications, without two separate vendors.
Whether your team uses the OpenAI or the Anthropic SDK, both point at the same Router and the same EU GPUs. That simplifies your stack and keeps all your inference inside Europe.
With the Anthropic SDK you set the base URL to the Router and use your key as x-api-key:
from anthropic import Anthropic
client = Anthropic(
base_url="https://hostyourai.com",
api_key="hyai-...",
)
msg = client.messages.create(
model="llama-3.3-70b",
max_tokens=512,
messages=[{"role": "user", "content": "Hello"}],
)
print(msg.content[0].text)Prefer the OpenAI SDK? The same Router also runs our OpenAI-compatible API.
Claude Code works directly on the Router. Set a few environment variables and pick a model from the catalog:
export ANTHROPIC_BASE_URL="https://hostyourai.com"
export ANTHROPIC_AUTH_TOKEN="hyai-rt-..."
export ANTHROPIC_MODEL="Qwen/Qwen3.6-27B-FP8"
export ANTHROPIC_SMALL_FAST_MODEL="Qwen/Qwen3.6-27B-FP8"
claudePick a model that supports tools, otherwise Claude Code cannot read files or run commands. GET /v1/models shows supports_tools per model and how much context is currently being served (served_context_length). Agentic coding uses a lot of context; if you want guaranteed large context for your coding sessions, email info@hostyourai.com. Other Anthropic tools such as Cline and opencode are set up the same way: base URL to HostYourAI, your own key and a model from the catalog. Everything about coding agents on our router is on HostYourAI Code.
| Anthropic feature | Status at HostYourAI |
|---|---|
/v1/messages request and response | Supported |
/v1/messages/count_tokens | Supported (fast estimate) |
x-api-key and Bearer authentication | Supported |
| System and user messages | Supported |
| Streaming | Token by token, Anthropic event format |
| Tool calling | Supported on models with tool support (see catalog) |
| Images in messages | Not yet, text-only |
If you need multimodal input, use the OpenAI-compatible route on the same Router.
Because your code is already built on the Anthropic SDK and you want to move processing to the EU. You change the base URL and the key; your application stays the same. See also the Claude API alternative.
No. You call open models such as Llama, Qwen and Mistral, served on European GPUs. The API shape is Anthropic; the models are open weights from the catalog.
Yes, token by token. The Router translates the stream live into the Anthropic event format, so streaming clients such as Claude Code just work.
Yes. Set ANTHROPIC_BASE_URL to https://hostyourai.com, use your HostYourAI key and pick a model from the catalog. See the example above.
Yes. Both routes run over the same Router, the same API key and the same credit balance. Useful when different teams use different SDKs.
On GPUs in European datacenters. Your prompts never leave the EU, a Data Processing Agreement is available and there is no training on your data.
The same as the OpenAI route: per token, per model class, from one prepaid balance. See the pricing page.
From model hosting to a customer-facing API, it is built for developers and businesses who want their AI running on infrastructure they actually control, inside the EU.
EU-hosted
100%
Your data and your models stay on European GPUs. GDPR-friendly by design.
Verified models, ready to serve
700+
Llama, Qwen, DeepSeek, Mistral, FLUX and plenty more. Pick one and it is warm in minutes, with no DevOps on your end.
OpenAI & Anthropic compatible
2 SDK
Point your existing client at the Router and keep your tools. No rewrite, no lock-in.
No infra to manage. Pick a model, get an OpenAI-compatible URL, ship.
01
Choose from the Model Garden or paste any HuggingFace ID. Set the VRAM and pick an EU GPU.
02
We deploy vLLM, run readiness probes, and hand you a warm OpenAI- and Anthropic-compatible URL plus an API key.
03
Point your client at the Router. It auto-routes to a warm instance and logs every request.
HostYourAI keeps your models, prompts and data on European GPUs. It is built for teams that care about compliance, reliability and real control.
Full data sovereignty
EU
GPUs and data stay inside Europe, and so do your prompts.
Models you can audit
Open
Run open-weight models and see exactly what runs.
No monthly fee
€0
Prepaid credit per token or per minute, so you pay only for what you run.
Your keys, your models
Yours
Your keys, your models and your data. Move whenever you want.
The Router speaks the OpenAI and Anthropic APIs, so it drops straight into the clients and SDKs your team already runs. Just change the base URL.
Docker
Anthropic
Hugging Face
LangChain
Python
Node.js
curl
Ollama
JetBrains
Jupyter
Vercel
Zapier
Postman
n8nText and image models on dedicated EU GPUs. Every model tested on our own hardware.
Start with one layer and add the others when the work asks for it. They share one key, one balance and one Activity view.
Explore more about EU-hosted AI on HostYourAI.
Model Garden
Browse a curated catalog of serveable open chat, image and embedding models with live warm/EU state. Deploy in one click on European GPUs.
Read moreEU Inference Router
One OpenAI- and Anthropic-compatible endpoint that routes your requests to open models on European GPUs. Drop-in, EU-hosted, no lock-in.
Read moreOpenAI-compatible API
A drop-in OpenAI-compatible API on European GPUs. Change only the base URL and run open models, GDPR-friendly, without rewriting your code.
Read moreStart with one key today. Add dedicated GPUs when your workload needs them.
