Model garden Router · op aanvraag Dedicated · beschikbaar

granite docling 258M

Dit model draait als eigen dedicated GPU-deployment, direct te starten via de wizard. Data blijft in Europa.

Granite Docling 258M builds upon the Idefics3 architecture, but introduces two key modifications: it replaces the vision encoder with siglip2-base-patch16-512 and substitutes the language model with a Granite 165M LLM. Try out our Granite-Docling-258 demo today.

ibm-granite/granite-docling-258M vLLM ready
text+image->text · ibm-granite · sovereign EU
Runs on EU infrastructure operated by European companies; US marketplace capacity is never part of this chain. Full chain
0.3B
Parameters
8K
Contextvenster
8GB
Minimale VRAM
POST /api/v1/chat/completions Op aanvraag

Specificaties

Parameters 0.3B
Contextvenster 8,192 tokens
Minimale VRAM 8 GB
Architectuur Idefics3ForConditionalGeneration (vLLM)
Licentie apache-2.0
Modaliteit text+image->text
Uitgebracht May 2025
Uitgever ibm-granite ↗

Prijzen

Gedeelde router · per token
Op aanvraag
Niet beschikbaar op de gedeelde router. Prijs op aanvraag als dedicated GPU-deployment.
Dedicated GPU · per uur
vanaf €0,74 per uur
Eigen vLLM-instance op Europese cloud (8 GB VRAM), per uur afgerekend.

Gedeelde EU-router, pay-per-token, scale-to-zero. Dedicated GPU-deployments worden per uur afgerekend, zie prijzen.

✓ Werkend geverifieerd op 22-07-2026, respons in 331 ms op onze EU-infrastructuur.

Bench-index

Bench is onze kwaliteitsindex voor elk model, 0 tot 100. Hij steunt op openbare metingen (Epoch AI met zo’n 40 benchmarks, LiveBench, LMArena en meer) en wordt elke ochtend ververst. Waar niemand meet, staat een schatting met bandbreedte.

~14,8 / 100 · Schatting

Nog geen openbare benchmark: geschat uit grootte en releasedatum.

Bandbreedte 3,4 tot 26,2

Bronnen: Epoch AI ↗ · LiveBench ↗ · LMArena ↗ · Dagelijks bijgewerkt, laatst op 16-10-2026

Direct aanroepen

Drop-in vervanger voor OpenAI: wijzig alleen de base-URL en de API-key. Ook het Anthropic-formaat (/v1/messages) wordt ondersteund.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "ibm-granite/granite-docling-258M",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Veelgestelde vragen

Kan ik granite docling 258M in de EU draaien?

Ja. HostYourAI draait granite docling 258M op GPU's in Europese datacenters via vLLM. Prompts en outputs verlaten de EU niet en er is geen Amerikaanse cloudprovider in de keten.

Is granite docling 258M hosten AVG/GDPR-compliant?

Ja. Alle verwerking vindt plaats binnen de EU, er is een verwerkersovereenkomst (DPA) beschikbaar en de subprocessor-lijst is openbaar. Open-source gewichten betekenen ook: geen training op jouw data.

Wat kost granite docling 258M?

granite docling 258M is beschikbaar op aanvraag: via de gedeelde EU-router na kort overleg, of als eigen dedicated GPU-deployment per uur. Vertel ons je use case, dan zetten we het voor je klaar.

Is de API compatibel met OpenAI?

Ja. Je gebruikt de standaard OpenAI-SDK's met een aangepaste base-URL (https://hostyourai.com/api/v1). Ook de Anthropic Messages API wordt ondersteund als drop-in.

Andere modellen van Ibm-granite

granite 4.2 30b

Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems. All Granite models are released under the Apache 2.0 license, enabling unrestricted commercial and academic use.

29B 131K context Bekijk model →
granite 4.2 8b

Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems. All Granite models are released under the Apache 2.0 license, enabling unrestricted commercial and academic use.

8.8B 131K context Bekijk model →
granite 4.2 3b

Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems. All Granite models are released under the Apache 2.0 license, enabling unrestricted commercial and academic use.

3.7B 131K context Bekijk model →
granite swash 3b a600m

Model Summary Granite-SWASH-3B-a600M is a 3B parameter decoder-only sparse language model with per-layer Sliding Window Attention (SWA) and learnable attention sinks (LSE-based). Trained on a mix of open source and proprietary data, it is a broad, general-purpose, English-language base model that serves as an early exploration and small-scale preview for upcoming Granite series model releases.

3B 8K context Bekijk model →
granite swash 2b

Model Summary Granite-SWASH-2B is a 2B parameter decoder-only dense language model with per-layer Sliding Window Attention (SWA) and learnable attention sinks (LSE-based). Trained on a mix of open source and proprietary data, it is a broad, general-purpose, English-language base model that serves as an early exploration and small-scale preview for upcoming Granite series model releases.

2.1B 8K context Bekijk model →
granite embedding 311m multilingual r2

Model Summary: Granite-Embedding-311M-Multilingual-R2 is a 311M parameter dense embedding model from the Granite Embeddings collection for high-quality multilingual text embeddings. It produces 768-dimensional vectors with a context length of up to 32,768 tokens. The model supports 200+ languages (based on the multilingual pretraining corpus of the underlying encoder), with enhanced support for 52 languages and programming code that receive explicit retrieval-pair and cross-lingual training. All training data uses permissive, enterprise-friendly licenses, plus IBM-collected and IBM-generated d

0.3B 33K context Bekijk model →

Probeer granite docling 258M gratis

Account aanmaken duurt een minuut. Test granite docling 258M direct in de playground.

Start gratis