Skip to content

Model hosting 03 Serve

Llama 3 Hosting

Deploy Meta's Llama 3.3 models on dedicated European infrastructure.

  • GLM
  • DeepSeek
  • Qwen
  • Kimi
  • Mistral
  • Llama
  • gpt-oss
  • Gemma
  • Loes
  • Nemotron
  • Claude Code
  • Codex
  • OpenCode
  • Cursor
  • Cline
  • Loes
  • OpenAI SDK
  • Anthropic SDK

What it does Model hosting

Why Llama hosting in the EU

Meta's Llama family is the workhorse of open LLMs: permissively licensed, well documented, and available in sizes from pocket models to 70B heavyweights. HostYourAI runs the Llama 3.1, 3.2 and 3.3 generations with vLLM on European GPUs, so you get Llama's quality without sending a single prompt outside the EU.

You can call Llama models in two ways. The shared EU Inference Router gives instant pay-per-token access, with popular sizes kept warm. For steady production traffic or strict isolation requirements, dedicated GPU instances run your chosen Llama with its own encrypted API key.

Read more

01

Open weights, sovereign serving

Llama's weights are public, so nothing forces you to run them on American infrastructure. Hosting them on European GPUs turns an open model into a genuinely sovereign stack: the weights, the vLLM serving layer and the hardware are all outside any single vendor's control.

02

Data protection stays simple

Prompts to a Llama model here are processed in European datacenters and never used for training. With a DPA and a public subprocessor list, your GDPR documentation for the feature stays a page, not a project.

03

Pay for tokens, not for idle theory

On the Router you pay per token from a prepaid balance; a dedicated Llama instance bills per minute until you delete it. Both draw from one balance, explained on the pricing page, so experimenting with a bigger Llama is a decision you can reverse the same day.

02 Model hosting

Choosing a Llama size for your workload

The Llama generations split neatly by job. The small 3.2 models (1B and 3B) are built for high-volume, low-stakes tasks: routing, tagging, extraction, guardrails. Llama 3.1 8B is the default choice for summarization and structured output, cheap enough to call on every request. At the top, Llama 3.3 70B delivers roughly the assistant quality people expect from a frontier chat model, with strong instruction following and multilingual output, including Dutch.

A practical pattern is to start every feature on 3.3 70B via the Router, measure quality, then push individual tasks down to smaller sizes until quality drops. The Model Garden shows which Llama variants are warm right now, and each can be tried in the Playground before you write code.

Llama variantTypical use
Llama 3.2 1BClassification, routing, guardrail checks at very high volume
Llama 3.2 3BShort summaries, entity extraction, autocomplete
Llama 3.1 8BGeneral summarization, structured JSON output, drafting
Llama 3.1 70BComplex reasoning and long-context analysis
Llama 3.3 70BProduction chat assistants, multilingual dialogue, RAG answers
03 Model hosting

How to start

Llama models sit behind the standard OpenAI-compatible endpoint, so any OpenAI SDK works unchanged.

python
from openai import OpenAI

client = OpenAI(
    base_url="https://hostyourai.com/api/v1",
    api_key="hyai-...",
)

response = client.chat.completions.create(
    model="llama-3.3-70b",
    messages=[
        {"role": "system", "content": "You are a concise Dutch-speaking assistant."},
        {"role": "user", "content": "Leg in twee zinnen uit wat vLLM doet."},
    ],
    max_tokens=200,
)
print(response.choices[0].message.content)
Questions

Questions about Llama hosting

Which Llama versions are available?

The Llama 3.1, 3.2 and 3.3 generations, from 1B up to 70B. The Model Garden shows the live state of each: warm, warming up, serveable or on request.

Is Llama 3.3 70B kept warm on the Router?

Popular models are kept warm through a warm pool so requests start generating immediately. The catalog page for each model shows its current state before you call it.

Can Llama answer in Dutch?

Yes. Llama 3.1 and 3.3 are multilingual and handle Dutch well, which is one reason Dutch teams pick 70B for customer-facing chat.

How much GPU does a 70B Llama need?

A large card in the 80 GB class or a multi-GPU setup. You do not have to size this yourself: deployment enforces a VRAM floor, so a dedicated instance always gets hardware the model fits on.

Can I combine Llama with my own documents?

Yes. Link a knowledge base to the Router or to your instance and relevant context is injected into completions automatically. The guide Build RAG on EU GPUs shows the setup end to end.

Everything you need for AI

From model hosting to a customer-facing API, it is built for developers and businesses who want their AI running on infrastructure they actually control, inside the EU.

EU-hosted

100%

Your data and your models stay on European GPUs. GDPR-friendly by design.

Verified models, ready to serve

700+

Llama, Qwen, DeepSeek, Mistral, FLUX and plenty more. Pick one and it is warm in minutes, with no DevOps on your end.

OpenAI & Anthropic compatible

2 SDK

Point your existing client at the Router and keep your tools. No rewrite, no lock-in.

From zero to a warm endpoint in minutes

No infra to manage. Pick a model, get an OpenAI-compatible URL, ship.

01

Pick a model

Choose from the Model Garden or paste any HuggingFace ID. Set the VRAM and pick an EU GPU.

02

Get your endpoint

We deploy vLLM, run readiness probes, and hand you a warm OpenAI- and Anthropic-compatible URL plus an API key.

03

Route and ship

Point your client at the Router. It auto-routes to a warm instance and logs every request.

Private by Default

HostYourAI keeps your models, prompts and data on European GPUs. It is built for teams that care about compliance, reliability and real control.

  • EU-hosted
  • GDPR-friendly
  • OpenAI-compatible
  • vLLM-powered
  • No lock-in

Full data sovereignty

EU

GPUs and data stay inside Europe, and so do your prompts.

Models you can audit

Open

Run open-weight models and see exactly what runs.

No monthly fee

€0

Prepaid credit per token or per minute, so you pay only for what you run.

Your keys, your models

Yours

Your keys, your models and your data. Move whenever you want.

Works with the tools you already use

The Router speaks the OpenAI and Anthropic APIs, so it drops straight into the clients and SDKs your team already runs. Just change the base URL.

  • Docker
  • Anthropic
  • Hugging Face
  • LangChain
  • Python
  • Node.js
  • curl
  • Ollama
  • JetBrains
  • Jupyter
  • Vercel
  • Zapier
  • Postman
  • n8n
The platform

One platform, four layers

Start with one layer and add the others when the work asks for it. They share one key, one balance and one Activity view.

Code

Your coding agent on open models in Europe, set up with one command.

Open

Control

Keys, budgets and guardrails per team, and personal data stopped before any model sees it.

Open

Serve

Shared per token, or running for you alone, from European data centres.

Open

EU compute

Private GPUs in Europe, H100 to B300, sized for response time, generation speed and concurrent users.

Open

Related pages

Explore more about EU-hosted AI on HostYourAI.

LLM Hosting Netherlands

Host your Large Language Models in Dutch data centers. GDPR compliant, low latency, dedicated GPU instances. The best LLM hosting solution in the Netherlands.

Read more

Command R Hosting Europe

Host Command R on dedicated 1x RTX PRO 6000 (96 GB) in European data centers. GDPR compliant, from €1.93/hour, OpenAI-compatible API.

Read more

CodeLlama 34B Hosting Europe

Host CodeLlama 34B on dedicated 1x RTX PRO 6000 (96 GB) in European data centers. GDPR compliant, from €1.93/hour, OpenAI-compatible API.

Read more

Europe's AI infrastructure.
Come build with us.

Start with one key today. Add dedicated GPUs when your workload needs them.

  • Jantine
  • Hans
  • Sander
  • Jos
  • Daan
  • Kyra
  • Margriet
  • Stan
The team behind HostYourAI