AivexaNewsSearch
AI news for builders and product teamsUpdated Oct 10, 2026, 19:01 UTC

Together AI

First-party releases and research from Together AI. Headlines and excerpts link to the original articles.

Latest stories

Newest first

Canary rollouts: upgrade models in production without downtime

Together AI described canary rollouts for moving live traffic between model deployments on dedicated inference without downtime, using staged traffic ramps, health checks, metric gates and human-approved pausing or reversal. It reported a Qwen2.5-7B to Qwen3.5-9B canary whose gate caught a 137% p95 regression at 10% of traffic, then was canceled and reversed with live requests served and none failed.

Read original

The Open Source AI Stack

Together AI published a deep dive into the open model AI stack, describing five independent layers — model, inference, gateways and routers, harness, and tools — and arguing that keeping them separate lets developers swap in a new open model in minutes instead of rebuilding their workflow.

A/B test models in production

Together AI describes running A/B experiments at the endpoint level, splitting live traffic among one control and up to 20 variants with fixed percentages. It covers ramping via member updates, measuring platform and product metrics per deployment, and ending tests by promoting a rollout or deleting the experiment.

Read original

Kimi K3: the complete developer guide

Moonshot AI's Kimi K3, described as a 2.8-trillion-parameter open-weights model and the first open-source model in the 3-trillion-parameter class, is now served on Together AI via an OpenAI-compatible API. The guide covers KDA and Attention Residuals architecture, Stable LatentMoE sparsity, reasoning effort levels, 1M context, tools, vision, benchmarks, and per-token pricing.