API, routing, model access, and dashboard updates for LLM Gateway.
Anthropic's next-generation Claude Fable 5 lands with 1M context, Reve joins as a new image provider, xAI's Grok Imagine Video 1.5 turns images into 15-second clips, and NVIDIA's Nemotron 3 Ultra 550B arrives.
Read more about Claude Fable 5, Reve Image Gen & More New Models →
Monthly Chat subscriptions from $9, Flex and Priority service tiers, sandbox test keys for the LLM SDK, a no_training model filter, public DevPass profiles, and a stack of product polish.
Read more about Chat Plans, Service Tiers, SDK Sandbox & More →
Give any API key a time-to-live when you create it — minutes, hours, or days. Expired keys are disabled automatically, and you can bring them back online anytime with a fresh expiration.
Read more about API Key Expiration (TTL) →
Pin conversations to one provider for warm caches with x-session-id, route Bedrock by region, and reach Gemini via Google AI Studio plus Vertex embeddings.
Read more about Smarter Routing: Sticky Sessions, Bedrock Regions & More →
Share a referral link and reward new signups, toggle provider cache writes per project, see cache and audio costs in your logs, plus a faster Chat and more.
Read more about Referrals, Cache Controls & Product Updates →
Claude Opus 4.8 lands with a 1M context window, Sonnet 4.6 gets 1M context too, and Qwen3.7 Max, Grok Build 0.1, Kimi K2.6, and GLM-5.1 join the gateway.
Read more about Claude Opus 4.8 + a Wave of New Models →
Send PDFs and text-family documents to Gemini models via the OpenAI-compatible `file` content block.
Read more about Document Reading (PDFs & more) →
ByteDance Seedance video models land in the gateway, Chat gets pinning and cross-org sharing, plus vertex-anthropic, grok-4.20, and a stack of fixes.
Read more about Seedance Video Models, Pinned Chats, Sharing Across Orgs & More →
Turn text into vectors for semantic search, clustering, and RAG — through the same gateway you already use for chat.
Read more about OpenAI-Compatible Embeddings →
Sessions are now Agents — monitor your AI coding agents, track costs per agent, and drill into individual sessions.
Read more about Sessions Rebranded to Agents →
Showing 10 of 103 updates
Load more