Skip to content
HostYourAI
03 Model garden Serve

granite 4.2 8b fp8

Runs as your own dedicated GPU deployment, ready to launch from the wizard. Data stays in Europe.

Get started ← All models
curl 
$ curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "ibm-granite/granite-4.2-8b-fp8",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

Serve Model garden On request
ibm-granite/granite-4.2-8b-fp8

text->text · ibm-granite · sovereign EU

Runs on EU infrastructure operated by European companies, from your request to the GPU. See the full chain

[!NOTE] This repository contains the FP8 version of Granite-4.2-8B. Please refer to the original model's model card for additional details: https://huggingface.co/ibm-granite/granite-4.2-8b

Router
Router · on request
Dedicated
Dedicated · available
8.8BParameters
131KContext window
16GBMinimum VRAM
POST /api/v1/chat/completions On request

Specifications

Parameters8.8B
Context window131,072 tokens
Minimum VRAM16 GB
ArchitectureGraniteForCausalLM (vLLM)
Licenseapache-2.0
Modalitytext->text
ReleasedAugust 2026
Publisheribm-granite ↗

Pricing

Shared router · per token

On request Not available on the shared router. Pricing on request as a dedicated GPU deployment.

Dedicated GPU · per hour

from €2,03 per hourYour own vLLM instance on European cloud (16 GB VRAM), billed per minute.

Shared EU router, you pay only per token. Dedicated GPU deployments are billed per minute, see pricing.

Questions

Frequently asked questions

Can I run granite 4.2 8b fp8 in the EU?

Yes. HostYourAI runs granite 4.2 8b fp8 on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting granite 4.2 8b fp8 GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does granite 4.2 8b fp8 cost?

granite 4.2 8b fp8 is available on request: through the shared EU router after a quick chat, or as your own dedicated GPU deployment billed per minute. Tell us your use case and we will set it up for you.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from Ibm-granite

granite speech 5.0 2b

 2.3B 16K context

Model Summary: Granite Speech 5.0 2B is a compact and efficient speech-language model, specifically designed for multilingual automatic speech recognition (ASR) and bidirectional automatic speech translation (AST) for English, French, German, Spanish, Portuguese and Japanese.

View model →

granite 4.2 30b

 29B 131K context

Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems. All Granite models are released under the Apache 2.0 license, enabling unrestricted commercial and academic use.

View model →

granite 4.2 8b

 8.8B 131K context

Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems. All Granite models are released under the Apache 2.0 license, enabling unrestricted commercial and academic use.

View model →

granite 4.2 3b

 3.7B 131K context

Granite is a family of open-source large language models developed by IBM, designed for enterprise and research use. Granite models are built to be versatile, safe, and efficient — covering a range of sizes and capabilities from compact edge-deployable models to large-scale reasoning systems. All Granite models are released under the Apache 2.0 license, enabling unrestricted commercial and academic use.

View model →

granite guardian 4.1 8b

 8.4B 131K context

Granite Guardian 4.1 8B introduces improved Bring Your Own Criteria (BYOC) support, enabling users to define arbitrary judging criteria beyond the pre-baked safety and hallucination detectors. The model can now faithfully evaluate complex, multi-part requirements such as formatting rules, length constraints, and domain-specific instructions.

View model →

granite vision 4.1 4b

 4B 131K context

Model Summary: Granite Vision 4.1 4B is a vision-language model (VLM) that delivers frontier-level performance on structured document extraction tasks — chart extraction, table extraction, and semantic key-value pair extraction — in a compact 4B parameter footprint, providing a lightweight alternative to much larger frontier models for these tasks:

View model →
The platform

One platform, four layers

Start with one layer and add the others when the work asks for it. They share one key, one balance and one Activity view.

Code

Your coding agent on open models in Europe, set up with one command.

Open

Control

Keys, budgets and guardrails per team, and personal data stopped before any model sees it.

Open

Serve

Shared per token, or running for you alone, from European data centres.

Open

EU compute

Private GPUs in Europe, H100 to B300, sized for response time, generation speed and concurrent users.

Open

Try granite 4.2 8b fp8 for free

Creating an account takes a minute. Test granite 4.2 8b fp8 straight away in the playground.

Get started
  • Jantine
  • Hans
  • Sander
  • Jos
  • Daan
  • Kyra
  • Margriet
  • Stan
The team behind HostYourAI