Model garden On request

Checkpoint 2b instructed beta

This model runs as a dedicated deployment on large GPUs and isn't in the shared playground by default. Get in touch and we'll set it up for you.

2b Version of model Sxxxxxx, without last epoch, instructed with baseline dataset including RAGMultilingual

BSC-LT/Checkpoint_2b_instructed_beta On request
text->text · BSC-LT · EU-hosted
2.3B
Parameters
8K
Context window
8GB
Minimum VRAM
POST /api/v1/chat/completions On request

Specifications

Parameters 2.3B
Context window 8,192 tokens
Minimum VRAM 8 GB
Architecture LlamaForCausalLM (vLLM)
License apache-2.0
Modality text->text
Released August 2024
Publisher BSC-LT ↗

Pricing

€0.02
Input (per 1M tokens)
€0.05
Output (per 1M tokens)

Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly, see pricing.

Not available on the shared router. Pricing on request as a dedicated GPU deployment.

Call it now

Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.

curl https://hostyourai.com/api/v1/chat/completions \
  -H "Authorization: Bearer hyai-..." \
  -H "Content-Type: application/json" \
  -d '{
    "model": "BSC-LT/Checkpoint_2b_instructed_beta",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Frequently asked questions

Can I run Checkpoint 2b instructed beta in the EU?

Yes. HostYourAI runs Checkpoint 2b instructed beta on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.

Is hosting Checkpoint 2b instructed beta GDPR-compliant?

Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.

How much does Checkpoint 2b instructed beta cost?

Via the shared EU router you pay €0.02 per million input tokens and €0.05 per million output tokens, with no fixed costs. For high volume or isolation you can also run Checkpoint 2b instructed beta as a dedicated hourly GPU instance.

Is the API OpenAI-compatible?

Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.

More models from BSC-LT

salamandra 7b instruct 2606

[!NOTE] WARNING: Although this model has undergone safety and value alignment, it may still occasionally generate unintended or undesired outputs. Sampling Parameters: For optimal performance, we recommend using temperatures close to zero (0 - 0.2). Additionally, we advise against using any type of repetition penalty, as from our experience, it negatively impacts instructed model's responses.

7.8B 164K context View model →
ALIA 40b instruct 2606

[!NOTE] WARNING: Although this model has undergone safety and value alignment, it may still occasionally generate unintended or undesired outputs. Sampling Parameters: For optimal performance, we recommend using temperatures close to zero (0 - 0.2). Additionally, we advise against using any type of repetition penalty, as from our experience, it negatively impacts instructed model's responses.

40B 164K context View model →
ALIA 40b fc 2606

[!NOTE] WARNING: This model has been trained on instructions but has not undergone safety or value alignment. Work In Progress: New versions will be released over the coming months.

40B 164K context View model →
ALIA 40b fc 2605

[!NOTE] WARNING: This model has been trained on instructions but has not undergone safety or value alignment. Work In Progress: New versions will be released over the coming months.

40B 164K context View model →
ALIA 40b instruct 2605

[!NOTE] WARNING: This model has been trained on instructions but has not undergone safety or value alignment. Work In Progress New versions will be available during the coming weeks/months. Sampling Parameters: For optimal performance, we recommend using temperatures close to zero (0 - 0.2). Additionally, we advise against using any type of repetition penalty, as from our experience, it negatively impacts instructed model's responses.

40B 164K context View model →
ALIA 40b instruct 2601

[!NOTE] WARNING: Although this model has undergone safety and value alignment, it may still occasionally generate unintended or undesired outputs. Work In Progress New versions will be available during the coming weeks/months. Sampling Parameters: For optimal performance, we recommend using temperatures close to zero (0 - 0.2). Additionally, we advise against using any type of repetition penalty, as from our experience, it negatively impacts instructed model's responses.

40B 164K context View model →

Request access

Checkpoint 2b instructed beta isn't available by default yet. Leave your details and we'll arrange a dedicated deployment.

Request access