Qwen3 VL 8B Instruct FP8
Runs as your own dedicated GPU deployment, ready to launch from the wizard. Data stays in Europe.
$ curl https://hostyourai.com/api/v1/chat/completions \
-H "Authorization: Bearer hyai-..." \
-H "Content-Type: application/json" \
-d '{
"model": "Qwen/Qwen3-VL-8B-Instruct-FP8",
"messages": [{"role": "user", "content": "Hello!"}]
}'
Call it now
Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.
text+image->text · Qwen · sovereign EU
Runs on EU infrastructure operated by European companies, from your request to the GPU. See the full chain
This repository contains an FP8 quantized version of the Qwen3-VL-8B-Instruct model. The quantization method is fine-grained fp8 quantization with block size of 128, and its performance metrics are nearly identical to those of the original BF16 model. Enjoy!
- Router
- Router · on request
- Dedicated
- Dedicated · available
Specifications
| Parameters | 8.8B |
|---|---|
| Context window | 262,144 tokens |
| Minimum VRAM | 16 GB |
| Architecture | Qwen3VLForConditionalGeneration (vLLM) |
| License | apache-2.0 |
| Modality | text+image->text |
| Released | October 2025 |
| Publisher | Qwen ↗ |
Pricing
Shared router · per token
Dedicated GPU · per hour
Shared EU router, you pay only per token. Dedicated GPU deployments are billed per minute, see pricing.
✓ Verified working on 27-07-2026, responded in 1108 ms on our EU infrastructure.
Bench index
Bench is our quality index for every model, 0 to 100. It rests on public measurements (Epoch AI with about 40 benchmarks, LiveBench, LMArena and more) and is refreshed every morning. Where nobody measures, it shows an estimate with a range.
No public benchmark yet: estimated from size and release date.
Range 26.7 to 49.8
Sources: Epoch AI ↗ · LiveBench ↗ · LMArena ↗ · Refreshed daily, last on 19-11-2026
Frequently asked questions
Can I run Qwen3 VL 8B Instruct FP8 in the EU?
Yes. HostYourAI runs Qwen3 VL 8B Instruct FP8 on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.
Is hosting Qwen3 VL 8B Instruct FP8 GDPR-compliant?
Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.
How much does Qwen3 VL 8B Instruct FP8 cost?
Qwen3 VL 8B Instruct FP8 is available on request: through the shared EU router after a quick chat, or as your own dedicated GPU deployment billed per minute. Tell us your use case and we will set it up for you.
Is the API OpenAI-compatible?
Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.
More models from Qwen
One platform, four layers
Start with one layer and add the others when the work asks for it. They share one key, one balance and one Activity view.
Try Qwen3 VL 8B Instruct FP8 for free
Creating an account takes a minute. Test Qwen3 VL 8B Instruct FP8 straight away in the playground.







