Orca 2 is built for research purposes only and provides a single turn response in tasks such as reasoning over user given data, reading comprehension, math problem solving and text summarization. The model is designed to excel particularly in reasoning.
Specifications
| Parameters | 13B |
|---|---|
| Context window | 4,096 tokens |
| Minimum VRAM | 30 GB |
| Architecture | LlamaForCausalLM (vLLM) |
| License | other |
| Modality | text->text |
| Released | November 2023 |
| Publisher | microsoft (Hugging Face) |
Pricing
| Input (per 1M tokens) | € 0.10 |
|---|---|
| Output (per 1M tokens) | € 0.18 |
Shared EU router, pay-per-token, scale-to-zero. Dedicated GPU deployments are billed hourly — see pricing.
Call it now
Drop-in replacement for OpenAI: change only the base URL and API key. The Anthropic format (/v1/messages) is supported too.
curl https://hostyourai.com/api/v1/chat/completions \
-H "Authorization: Bearer hyai-..." \
-H "Content-Type: application/json" \
-d '{
"model": "microsoft/Orca-2-13b",
"messages": [{"role": "user", "content": "Hello!"}]
}'
Frequently asked questions
Can I run Orca 2 13b in the EU?
Yes. HostYourAI runs Orca 2 13b on GPUs in European datacenters via vLLM. Prompts and outputs never leave the EU and there is no US cloud provider in the chain.
Is hosting Orca 2 13b GDPR-compliant?
Yes. All processing happens inside the EU, a Data Processing Agreement (DPA) is available and the subprocessor list is public. Open-source weights also mean: no training on your data.
How much does Orca 2 13b cost?
Via the shared EU router you pay €0.10 per million input tokens and €0.18 per million output tokens, with no fixed costs. For high volume or isolation you can also run Orca 2 13b as a dedicated hourly GPU instance.
Is the API OpenAI-compatible?
Yes. You use the standard OpenAI SDKs with a custom base URL (https://hostyourai.com/api/v1). The Anthropic Messages API is supported as a drop-in as well.
Creating an account takes a minute. Test Orca 2 13b straight away in the playground.
Start for free