Model garden Router · on request Dedicated · available

stablelm 2 12b chat

Runs as your own dedicated GPU deployment, ready to launch from the wizard. Data stays in Europe.

Stable LM 2 12B Chat is a 12 billion parameter instruction tuned language model trained on a mix of publicly available datasets and synthetic datasets, utilizing Direct Preference Optimization (DPO).

stabilityai/stablelm-2-12b-chat On request
text->text · stabilityai · sovereign EU
Runs on EU infrastructure operated by European companies; US marketplace capacity is never part of this chain. Full chain
12B
Parameters
4K
Context window
32GB
Minimum VRAM
POST /api/v1/chat/completions On request

Specifications

Parameters 12B
Context window 4,096 tokens
Minimum VRAM 32 GB
Architecture StableLmForCausalLM (vLLM)
License other
Modality text->text
Released April 2024
Publisher stabilityai ↗

Pricing

Shared router · per token
On request
Not available on the shared router. Pricing on request as a dedicated GPU deployment.
Dedicated GPU · per hour
from €1,95 per hour
Your own vLLM instance on European cloud (32 GB VRAM), billed hourly.

Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly, see pricing.

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "stabilityai/stablelm-2-12b-chat",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Frequently asked questions

Can I run stablelm 2 12b chat in the EU?

Yes. HostYourAI runs stablelm 2 12b chat on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting stablelm 2 12b chat GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does stablelm 2 12b chat cost?

stablelm 2 12b chat is available on request: through the shared EU router after a quick chat, or as your own dedicated GPU deployment billed per hour. Tell us your use case and we will set it up for you.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from Stabilityai

Try stablelm 2 12b chat for free

Creating an account takes a minute. Test stablelm 2 12b chat straight away in the playground.

Start for free