Skip to content

EU Router 03 Serve

Ollama cloud alternative

The same open models you run locally in Ollama, delivered as a hosted API on European GPUs: no GPU management, and an SLA instead of a laptop.

  • GLM
  • DeepSeek
  • Qwen
  • Kimi
  • Mistral
  • Llama
  • gpt-oss
  • Gemma
  • Loes
  • Nemotron
  • Claude Code
  • Codex
  • OpenCode
  • Cursor
  • Cline
  • Loes
  • OpenAI SDK
  • Anthropic SDK

What it does EU Router

Where Ollama stops and hosting starts

Ollama might be the nicest way to work with open models locally: one command and Llama or Qwen runs on your own machine. For prototypes, privacy-sensitive experiments and offline work there is little better. But then the prototype works, and the question every builder knows arrives: how do I get this into production?

For production you want a hosted, OpenAI-compatible endpoint that is reachable day and night, without managing GPUs yourself. HostYourAI is exactly that, with a bonus the American alternatives do not offer: everything runs on GPUs in European data centers, under European law.

The moment your laptop lid closes, your API is down. A 70B model does not fit in the average consumer GPU. And renting and managing a server with serious GPUs yourself is a second job: drivers, CUDA versions, monitoring, failover. For a demo that is overkill, but once customers depend on your API you want an SLA (ours is 99.9%) instead of an ssh session at three in the morning.

Read more

02 EU Router

From localhost to production in three steps

Ollama already speaks the OpenAI format locally, so your code is essentially ready.

  1. Create an API key. Register, top up your prepaid balance (iDEAL works too) and generate a hyai key in the dashboard.
  2. Swap your base_url. From http://localhost:11434/v1 to https://hostyourai.com/api/v1.
  3. Pick your model. Find the hosted variant of the model you ran locally in the model catalog and test it in the Playground.
python
from openai import OpenAI

# Local with Ollama:
# client = OpenAI(base_url="http://localhost:11434/v1", api_key="ollama")

# Production on European GPUs:
client = OpenAI(
    base_url="https://hostyourai.com/api/v1",
    api_key="hyai-...",
)

response = client.chat.completions.create(
    model="llama-3.3-70b",
    messages=[{"role": "user", "content": "Hello from production."}],
)

Prefer the Anthropic SDK? That works too: there is a /v1/messages endpoint with x-api-key authentication.

03 EU Router

The same open models, heavier hardware

The catalog contains the model families you know from Ollama: Llama, Qwen, Mistral, DeepSeek, Gemma. There is one difference. Locally you usually run quantized GGUF variants because VRAM is tight; our GPUs serve the full weights through vLLM. In practice that often means noticeably better quality than the "same" model on your laptop, plus room for the large variants that simply do not fit locally.

04 EU Router

The EU bonus

The biggest difference with US hosted-Ollama-style services is jurisdiction. HostYourAI is a Dutch company, there is no US cloud in the chain and we never train on your data. A data processing agreement is ready to sign and data is encrypted with AES-256. Why that matters for European teams is covered on our AI compliance in Europe and AI data sovereignty pages.

Questions

Questions about an Ollama cloud alternative

Can I run the same models as in Ollama?

Mostly, yes. The well-known open families (Llama, Qwen, Mistral, DeepSeek, Gemma) are in the catalog. We serve the full HF weights through vLLM rather than quantized GGUF files, so quality tends to be better than what you ran locally.

Do I have to rewrite my code?

No. Ollama and HostYourAI both speak the OpenAI format. You swap the base_url and the API key, and your existing code, LangChain chains and tools keep working.

Can I keep using Ollama locally for development?

Yes, and it is a solid setup: Ollama locally for fast iteration, HostYourAI in production. Make the base_url an environment variable and you switch without touching code.

What does it cost?

You pay prepaid per use, with no subscription, and topping up works with iDEAL as well. See the pricing page for current rates.

Can I run a model that is not in the catalog?

Yes. On a dedicated GPU instance you deploy a model yourself with vLLM, also within the EU. Useful for your own fine-tunes or niche models.

Everything you need for AI

From model hosting to a customer-facing API, it is built for developers and businesses who want their AI running on infrastructure they actually control, inside the EU.

EU-hosted

100%

Your data and your models stay on European GPUs. GDPR-friendly by design.

Verified models, ready to serve

700+

Llama, Qwen, DeepSeek, Mistral, FLUX and plenty more. Pick one and it is warm in minutes, with no DevOps on your end.

OpenAI & Anthropic compatible

2 SDK

Point your existing client at the Router and keep your tools. No rewrite, no lock-in.

From zero to a warm endpoint in minutes

No infra to manage. Pick a model, get an OpenAI-compatible URL, ship.

01

Pick a model

Choose from the Model Garden or paste any HuggingFace ID. Set the VRAM and pick an EU GPU.

02

Get your endpoint

We deploy vLLM, run readiness probes, and hand you a warm OpenAI- and Anthropic-compatible URL plus an API key.

03

Route and ship

Point your client at the Router. It auto-routes to a warm instance and logs every request.

Works with the tools you already use

The Router speaks the OpenAI and Anthropic APIs, so it drops straight into the clients and SDKs your team already runs. Just change the base URL.

  • Docker
  • Anthropic
  • Hugging Face
  • LangChain
  • Python
  • Node.js
  • curl
  • Ollama
  • JetBrains
  • Jupyter
  • Vercel
  • Zapier
  • Postman
  • n8n

Built for teams that can't send data away

If a US cloud is off the table, HostYourAI gives you the same developer experience on European infrastructure.

01

Public sector & government

Citizen data that legally has to stay in the EU, with full auditability.

02

Regulated enterprise

Finance, healthcare and legal teams under GDPR, DORA and the AI Act.

03

EU SaaS & scale-ups

Ship AI features your customers trust, without a US sub-processor.

04

Agencies & integrators

Deliver private AI for clients on infrastructure you can stand behind.

The platform

One platform, four layers

Start with one layer and add the others when the work asks for it. They share one key, one balance and one Activity view.

Code

Your coding agent on open models in Europe, set up with one command.

Open

Control

Keys, budgets and guardrails per team, and personal data stopped before any model sees it.

Open

Serve

Shared per token, or running for you alone, from European data centres.

Open

EU compute

Private GPUs in Europe, H100 to B300, sized for response time, generation speed and concurrent users.

Open

Related pages

Explore more about EU-hosted AI on HostYourAI.

vLLM Hosting Europe

vLLM hosting in Europe for maximum inference performance. PagedAttention, continuous batching, optimized for throughput.

Read more

Private LLM Hosting

Private LLM hosting on dedicated hardware. No shared resources, full data isolation, your own AI infrastructure.

Read more

ChatGPT alternative for Europe

A ChatGPT alternative that runs on open models and European GPUs. OpenAI-compatible API, GDPR-friendly and without your data leaving the EU.

Read more

Europe's AI infrastructure.
Come build with us.

Start with one key today. Add dedicated GPUs when your workload needs them.

  • Jantine
  • Hans
  • Sander
  • Jos
  • Daan
  • Kyra
  • Margriet
  • Stan
The team behind HostYourAI