HostYourAI
Product
EU RouterHostYourAI CodeOpenAI-compatible APIAnthropic-compatible APIModel GardenDedicated InstancesPlaygroundFine-tuning (Loes)Connect your GPU pool
Solutions
Use cases
HostYourAI CodeLLM InferenceRAG pipelinesChatbotsAI agentsFine-tuning
Industries
GovernmentHealthcareFinanceLegal
Models
Kimi K3DeepSeek V4 ProDeepSeek V4 FlashGLM 5.2Llama 3.1 405BQwen3.5 397BLlama 3.3 70BMistralDeepSeek R1All models →
Compare
Azure OpenAIAWS BedrockClaude APIChatGPTOpenAI
Resources
DocumentationGuide: migrate to the EU RouterGuide: deploy your own LLM (vLLM)Guide: build RAG on EU GPUsModel catalog
Pricing
NL EN DE
Login Book Demo Get Started
Model garden Router · on request Dedicated · available

salamandra 2b instruct gptq

Runs as your own dedicated GPU deployment, ready to launch from the wizard. Data stays in Europe.

This model is the gptq-quantized version of Salamandra-2b-instruct for speculative decoding.

Start for free ← All models
BSC-LT/salamandra-2b-instruct-gptq vLLM ready
text->text · BSC-LT · sovereign EU
Runs on EU infrastructure operated by European companies; US marketplace capacity is never part of this chain. Full chain
2.3B
Parameters
8K
Context window
16GB
Minimum VRAM
POST /api/v1/chat/completions On request

Specifications

Parameters 2.3B
Context window 8,192 tokens
Minimum VRAM 16 GB
Architecture LlamaForCausalLM (vLLM)
License apache-2.0
Modality text->text
Released October 2024
Publisher BSC-LT ↗

Pricing

Shared router · per token
On request
Not available on the shared router. Pricing on request as a dedicated GPU deployment.
Dedicated GPU · per hour
from €2,16 per hour
Your own vLLM instance on European cloud (16 GB VRAM), billed hourly.

Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly, see pricing.

✓ Verified working on 01-08-2026, responded in 219 ms on our EU infrastructure.

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "BSC-LT/salamandra-2b-instruct-gptq",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Frequently asked questions

Can I run salamandra 2b instruct gptq in the EU?

Yes. HostYourAI runs salamandra 2b instruct gptq on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting salamandra 2b instruct gptq GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does salamandra 2b instruct gptq cost?

salamandra 2b instruct gptq is available on request: through the shared EU router after a quick chat, or as your own dedicated GPU deployment billed per hour. Tell us your use case and we will set it up for you.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from BSC-LT

salamandra 7b fc 2607

salamandra 7b fc 2607 is an open-source language model from BSC-LT with 7.8B parameters, hosted on EU GPUs via an OpenAI-compatible API.

7.8B View model →
ALIA 40b fc 2607

ALIA 40b fc 2607 is an open-source language model from BSC-LT with 40B parameters, hosted on EU GPUs via an OpenAI-compatible API.

40B View model →
salamandra 7b instruct 2606

[!NOTE] WARNING: Although this model has undergone safety and value alignment, it may still occasionally generate unintended or undesired outputs. Sampling Parameters: For optimal performance, we recommend using temperatures close to zero (0 - 0.2). Additionally, we advise against using any type of repetition penalty, as from our experience, it negatively impacts instructed model's responses.

7.8B 164K context View model →
ALIA 40b instruct 2606

[!NOTE] WARNING: Although this model has undergone safety and value alignment, it may still occasionally generate unintended or undesired outputs. Sampling Parameters: For optimal performance, we recommend using temperatures close to zero (0 - 0.2). Additionally, we advise against using any type of repetition penalty, as from our experience, it negatively impacts instructed model's responses.

40B 164K context View model →
ALIA 40b fc 2606

[!NOTE] WARNING: This model has been trained on instructions but has not undergone safety or value alignment. Work In Progress: New versions will be released over the coming months.

40B 164K context View model →
ALIA 40b fc 2605

[!NOTE] WARNING: This model has been trained on instructions but has not undergone safety or value alignment. Work In Progress: New versions will be released over the coming months.

40B 164K context View model →

Try salamandra 2b instruct gptq for free

Creating an account takes a minute. Test salamandra 2b instruct gptq straight away in the playground.

Start for free