HostYourAI
Product
EU RouterHostYourAI CodeOpenAI-compatible APIAnthropic-compatible APIModel GardenDedicated InstancesPlaygroundFine-tuning (Loes)Connect your GPU pool
Solutions
Use cases
HostYourAI CodeLLM InferenceRAG pipelinesChatbotsAI agentsFine-tuning
Industries
GovernmentHealthcareFinanceLegal
Models
Kimi K3DeepSeek V4 ProDeepSeek V4 FlashGLM 5.2Llama 3.1 405BQwen3.5 397BLlama 3.3 70BMistralDeepSeek R1All models →
Compare
Azure OpenAIAWS BedrockClaude APIChatGPTOpenAI
Resources
DocumentationGuide: migrate to the EU RouterGuide: deploy your own LLM (vLLM)Guide: build RAG on EU GPUsModel catalog
Pricing
NL EN DE
Login Book Demo Get Started
Model garden Router · on request Dedicated · available

granite 4.0 h tiny

Runs as your own dedicated GPU deployment, ready to launch from the wizard. Data stays in Europe.

📣 Update [10-07-2025]: Added a default system prompt to the chat template to guide the model towards more professional, accurate, and safe responses.

Start for free ← All models
ibm-granite/granite-4.0-h-tiny vLLM ready
text->text · ibm-granite · sovereign EU
Runs on EU infrastructure operated by European companies; US marketplace capacity is never part of this chain. Full chain
6.9B
Parameters
131K
Context window
24GB
Minimum VRAM
POST /api/v1/chat/completions On request

Specifications

Parameters 6.9B
Context window 131,072 tokens
Minimum VRAM 24 GB
Architecture GraniteMoeHybridForCausalLM (vLLM)
License apache-2.0
Modality text->text
Released September 2025
Publisher ibm-granite ↗

Pricing

Shared router · per token
On request
Not available on the shared router. Pricing on request as a dedicated GPU deployment.
Dedicated GPU · per hour
from €2,16 per hour
Your own vLLM instance on European cloud (24 GB VRAM), billed hourly.

Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly, see pricing.

✓ Verified working on 21-07-2026, responded in 222 ms on our EU infrastructure.

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "ibm-granite/granite-4.0-h-tiny",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Frequently asked questions

Can I run granite 4.0 h tiny in the EU?

Yes. HostYourAI runs granite 4.0 h tiny on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting granite 4.0 h tiny GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does granite 4.0 h tiny cost?

granite 4.0 h tiny is available on request: through the shared EU router after a quick chat, or as your own dedicated GPU deployment billed per hour. Tell us your use case and we will set it up for you.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from Ibm-granite

granite 4.2 8b

Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems. All Granite models are released under the Apache 2.0 license, enabling unrestricted commercial and academic use.

8.8B 131K context View model →
granite 4.2 3b

Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems. All Granite models are released under the Apache 2.0 license, enabling unrestricted commercial and academic use.

3.7B 131K context View model →
granite guardian 4.1 8b

Granite Guardian 4.1 8B introduces improved Bring Your Own Criteria (BYOC) support, enabling users to define arbitrary judging criteria beyond the pre-baked safety and hallucination detectors. The model can now faithfully evaluate complex, multi-part requirements such as formatting rules, length constraints, and domain-specific instructions.

8.4B 131K context View model →
granite vision 4.1 4b

Model Summary: Granite Vision 4.1 4B is a vision-language model (VLM) that delivers frontier-level performance on structured document extraction tasks — chart extraction, table extraction, and semantic key-value pair extraction — in a compact 4B parameter footprint, providing a lightweight alternative to much larger frontier models for these tasks:

4B 131K context View model →
granite speech 4.1 2b plus

Granite-Speech-4.1-2B-Plus has similar capabilities to the Granite-Speech-4.1-2B model. The plus model adds two new community-requested rich transcription features that can be activated with a simple prompt change: speaker-attributed ASR (speaker labels and word transcripts) and word-level timing information. Unlike the base mode, the plus model doesn't provide punctuation and capitalization.

2.1B 4K context View model →
granite speech 4.1 2b

Model Summary: Granite Speech 4.1 2B is a compact and efficient speech-language model, specifically designed for multilingual automatic speech recognition (ASR) and bidirectional automatic speech translation (AST) for English, French, German, Spanish, Portuguese and Japanese.

2.3B 4K context View model →

Try granite 4.0 h tiny for free

Creating an account takes a minute. Test granite 4.0 h tiny straight away in the playground.

Start for free