Model garden Router · on request Dedicated · available

Llama 2 70b chat hf

Runs as your own dedicated GPU deployment, ready to launch from the wizard. Data stays in Europe.

Llama 2 70b chat hf is an open-source language model from Meta with 69B parameters, hosted on EU GPUs via an OpenAI-compatible API.

meta-llama/Llama-2-70b-chat-hf On request
text->text · meta-llama · sovereign EU
Runs on EU infrastructure operated by European companies; US marketplace capacity is never part of this chain. Full chain
69B
Parameters
—
Context window
166GB
Minimum VRAM
POST /api/v1/chat/completions On request

Specifications

Parameters 69B
Minimum VRAM 166 GB
Architecture LlamaForCausalLM (vLLM)
License llama2
Modality text->text
Released July 2023
Publisher meta-llama ↗

Pricing

Shared router · per token
On request
Not available on the shared router. Pricing on request as a dedicated GPU deployment.
Dedicated GPU · per hour
from €5,07 per hour
Your own vLLM instance on European cloud (166 GB VRAM), billed hourly.

Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly, see pricing.

Bench index

Bench is our quality index for every model, 0 to 100. It rests on public measurements (Epoch AI with about 40 benchmarks, LiveBench, LMArena and more) and is refreshed every morning. Where nobody measures, it shows an estimate with a range.

29.6 / 100 · Measured

Measured by Epoch AI across 14 benchmarks, with a range.

Range 18.3 to 34.0 · Rank 216 of 270 at Epoch AI

Sources: Epoch AI ↗ · LiveBench ↗ · LMArena ↗ · Refreshed daily, last on 24-10-2026

Every benchmark (14)
TriviaQA 87.6
HellaSwag 80.4
LAMBADA 78.9
ARC AI2 71.1
GSM8K 69.6
PIQA 65.6
Winogrande 60.4
MMLU 59.9
BBH 53.2
OpenBookQA 46.9
MATH level 5 3.3
DTBench 2.7
GPQA diamond 1.8
OTIS Mock AIME 2024-2025 0.0

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/Llama-2-70b-chat-hf",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Frequently asked questions

Can I run Llama 2 70b chat hf in the EU?

Yes. HostYourAI runs Llama 2 70b chat hf on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting Llama 2 70b chat hf GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does Llama 2 70b chat hf cost?

Llama 2 70b chat hf needs several GPUs at once, so it runs as a dedicated deployment billed per GPU-hour rather than per token. Tell us your volume and we will work it out with you.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from Meta

Try Llama 2 70b chat hf for free

Creating an account takes a minute. Test Llama 2 70b chat hf straight away in the playground.

Start for free