HostYourAI
Product
EU RouterHostYourAI CodeOpenAI-compatible APIAnthropic-compatible APIModel GardenDedicated InstancesPlaygroundFine-tuning (Loes)Connect your GPU pool
Solutions
Use cases
HostYourAI CodeLLM InferenceRAG pipelinesChatbotsAI agentsFine-tuning
Industries
GovernmentHealthcareFinanceLegal
Models
DeepSeek V4 ProDeepSeek V4 FlashGLM 5.2Llama 3.1 405BQwen3.5 397BLlama 3.3 70BMistralDeepSeek R1All models →
Compare
Azure OpenAIAWS BedrockClaude APIChatGPTOpenAI
Resources
DocumentationGuide: migrate to the EU RouterGuide: deploy your own LLM (vLLM)Guide: build RAG on EU GPUsModel catalog
Pricing
NL EN DE
Login Book Demo Get Started
Model garden Router · on request Dedicated · on request

Qwen2.5 Coder 32B Instruct AWQ

This model runs as a dedicated deployment on large GPUs and isn't in the shared playground by default. Get in touch and we'll set it up for you.

Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (formerly known as CodeQwen). As of now, Qwen2.5-Coder has covered six mainstream model sizes, 0.5, 1.5, 3, 7, 14, 32 billion parameters, to meet the needs of different developers. Qwen2.5-Coder brings...

Request access ← All models
Qwen/Qwen2.5-Coder-32B-Instruct-AWQ vLLM ready
text->text · Qwen · EU-hosted
33B
Parameters
33K
Context window
160GB
Minimum VRAM
POST /api/v1/chat/completions On request

Specifications

Parameters 33B
Context window 32,768 tokens
Minimum VRAM 160 GB
Architecture Qwen2ForCausalLM (vLLM)
License apache-2.0
Modality text->text
Released November 2024
Publisher Qwen ↗

Pricing

Shared router · per token
On request
Not available on the shared router. Pricing on request as a dedicated GPU deployment.
Prefer per token on the shared router? This model runs always-on as Qwen2.5 Coder 32B Instruct.
Dedicated GPU · per hour
On request
Dedicated deployment, from 160 GB of VRAM. Billed per GPU-hour.

Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly, see pricing.

✓ Verified working on 16-07-2026, responded in 58575 ms on our EU infrastructure.

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "Qwen/Qwen2.5-Coder-32B-Instruct-AWQ",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Frequently asked questions

Can I run Qwen2.5 Coder 32B Instruct AWQ in the EU?

Yes. HostYourAI runs Qwen2.5 Coder 32B Instruct AWQ on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting Qwen2.5 Coder 32B Instruct AWQ GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does Qwen2.5 Coder 32B Instruct AWQ cost?

Qwen2.5 Coder 32B Instruct AWQ needs several GPUs at once, so it runs as a dedicated deployment billed per GPU-hour rather than per token. Tell us your volume and we will work it out with you.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from Qwen

Qwen3.6 27B FP8

[!Note] This repository contains FP8-quantized model weights and configuration files for the post-trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc. The quantization method is fine-grained fp8 quantization with block size of 128, and its performance metrics are nearly identical to those of the original model.

28B 262K context View model →
Qwen3.6 27B

[!Note] This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc.

28B 262K context View model →
Qwen3.6 35B A3B FP8

[!Note] This repository contains FP8-quantized model weights and configuration files for the post-trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc. The quantization method is fine-grained fp8 quantization with block size of 128, and its performance metrics are nearly identical to those of the original model.

36B 262K context View model →
Qwen3.6 35B A3B

[!Note] This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc.

36B 262K context View model →
Qwen3.5 35B A3B GPTQ Int4

[!Note] This repository contains int4-quantized model weights and configuration files for the post-trained model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc.

36B 262K context View model →
Qwen3.5 0.8B Base

[!Note] This repository contains model weights and configuration files for the pre-trained only model in the Hugging Face Transformers format. These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, etc. The intended use cases are fine-tuning, in-context learning experiments, and other research or development purposes, not direct interaction. However, the control tokens, e.g., <|imstart| and <|imend| were trained to allow efficient LoRA-style PEFT with the official chat template, mitigating the need to finetune embeddings, a significant optimization given Qwen3.5's larger

0.9B 262K context View model →

Request access

Qwen2.5 Coder 32B Instruct AWQ isn't available by default yet. Leave your details and we'll arrange a dedicated deployment.

Request access