03 Model garden Serve

Qwen2.5 32B Instruct GPTQ Int4

Name: Qwen2.5 32B Instruct GPTQ Int4 hosting (EU)
Brand: HostYourAI
Availability: LimitedAvailability

curl

$ curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

Serve Model garden On request

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

text->text · Qwen · sovereign EU

Runs on EU infrastructure operated by European companies, from your request to the GPU. See the full chain

Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we release a number of base language models and instruction-tuned language models ranging from 0.5 to 72 billion parameters. Qwen2.5 brings the following improvements upon Qwen2:

Router: Router · on request
Dedicated: Dedicated · available

33BParameters

33KContext window

24GBMinimum VRAM

POST /api/v1/chat/completions On request

Specifications

Parameters	33B
Context window	32,768 tokens
Minimum VRAM	24 GB
Architecture	Qwen2ForCausalLM (vLLM)
License	apache-2.0
Modality	text->text
Released	September 2024
Publisher	Qwen ↗

Pricing

Shared router · per token

On request Not available on the shared router. Pricing on request as a dedicated GPU deployment.

Dedicated GPU · per hour

from €2,03 per hourYour own vLLM instance on European cloud (24 GB VRAM), billed per minute.

Shared EU router, you pay only per token. Dedicated GPU deployments are billed per minute, see pricing.

Questions

Frequently asked questions

Can I run Qwen2.5 32B Instruct GPTQ Int4 in the EU?

Yes. HostYourAI runs Qwen2.5 32B Instruct GPTQ Int4 on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting Qwen2.5 32B Instruct GPTQ Int4 GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does Qwen2.5 32B Instruct GPTQ Int4 cost?

Qwen2.5 32B Instruct GPTQ Int4 is available on request: through the shared EU router after a quick chat, or as your own dedicated GPU deployment billed per minute. Tell us your use case and we will set it up for you.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.