---
id: "open-inference"
site: "openinference.ai"
headquarters: "US"
gateways: ["openrouter"]
models: 6
endpoints: 7
tokens_week: 191991074264
token_share: "1.2%"
rank: 19
cheapest_on: "4 of 7 shared models"
cheaper_than: "100% of offers at the median"
vs_card: "77% off the card price at the median over 6 models"
cache_hit: "85.2%"
uptime_1d: 99.5000
latency_p50_ms: 1108
tokens_per_second: 24
trains_on_some: false
retains_on_some: false
quantization: "fp4 (4), fp8 (2), bf16 (1)"
---
# OpenInference

`deepseek/deepseek-v4.1-flash`, `deepseek/deepseek-v4.1-flash-1017`, `deepseek/deepseek-v4-flash`, `deepseek/deepseek-v4-flash-0731`, `google/gemma-4-31b-it`, `z-ai/glm-5.3-flash`