Model garden Router · available Dedicated · available

Llama 3.1 8B Instruct

Instantly via the EU router or as a dedicated GPU deployment. Data stays in Europe.

Llama 3.1 8B Instruct is an open-source language model from Meta with 8B parameters, hosted on EU GPUs via an OpenAI-compatible API.

meta-llama/Llama-3.1-8B-Instruct vLLM ready
text->text · meta-llama · EU-hosted
8B
Parameters
Context window
24GB
Minimum VRAM
POST /api/v1/chat/completions 200 OK

Specifications

Parameters 8B
Minimum VRAM 24 GB
Architecture LlamaForCausalLM (vLLM)
License llama3.1
Modality text->text
Released July 2024
Publisher meta-llama ↗

Pricing

Shared router · per token
€0.05
Input (per 1M tokens)
€0.12
Output (per 1M tokens)
Dedicated GPU · per hour
from €1,16 per hour
Your own vLLM instance on European cloud (24 GB VRAM), billed hourly.

Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly, see pricing.

✓ Verified working on 14-07-2026, responded in 170 ms on our EU infrastructure.

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/Llama-3.1-8B-Instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Frequently asked questions

Can I run Llama 3.1 8B Instruct in the EU?

Yes. HostYourAI runs Llama 3.1 8B Instruct on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting Llama 3.1 8B Instruct GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does Llama 3.1 8B Instruct cost?

Via the shared EU router you pay €0.05 per million input tokens and €0.12 per million output tokens, with no fixed costs. For high volume or isolation you can also run Llama 3.1 8B Instruct as a dedicated hourly GPU instance.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from Meta

Try Llama 3.1 8B Instruct for free

Creating an account takes a minute. Test Llama 3.1 8B Instruct straight away in the playground.

Start for free