AWS Trainium Frontier competition: Co-design models and kernels on purpose-built AI chips

AWS announced the AWS Trainium Frontier competition, which challenges academic and industry teams to train language models from scratch on purpose-built AWS Trainium chips and explore how optimal model architectures differ when hardware constraints change fundamentally from conventional accelerators.

The competition runs in two phases. Phase 1 gives every team a single Trainium2 chip and a 30-minute training budget, scored on validation bits-per-byte (val_bpb) after exactly 30 minutes; lower is better. The top 10 teams advance to Phase 2, which provides a full Trainium2 server with a four-hour budget and adds a second scoring axis: inference performance on CORE, an aggregate score across in-context learning tasks spanning reasoning, comprehension, and world knowledge. Final scores are a 50/50 composite of the two phases.

Participants start from a provided approximately 50M parameter baseline described as nanochat-derived: a GPT-style dense LLM with RMSNorm, rotary embeddings, and a ReLU² MLP. They may modify architecture, optimizer, training loop, and optionally custom Neuron Kernel Interface (NKI) kernels. Model size is uncapped; the stated constraint is time on the chip rather than parameter count. The pipeline includes a Muon + AdamW optimizer and native PyTorch support for Neuron.

Resources listed for participants include full NKI documentation (programming guide, ISA reference, architecture docs, example kernels), Neuron Explorer for profiling, a Trainium-optimized autoresearch framework for AI-assisted experimentation, and the CORE evaluation harness. Eligible academic teams can obtain AWS Promotional Credits covering Trainium compute and Amazon Bedrock access.

Prizes are $25,000 for first, $10,000 for second, and $5,000 for third. The top three finalists present their work at an Annapurna Labs research event during NeurIPS 2026 in Sydney, Australia, with travel and expenses the finalists' responsibility, and have the opportunity to co-publish findings with Annapurna Labs researchers. Top 10 team members receive Neuron team jackets and swag packs.

Key dates: Phase 1 opens Aug. 31, 2026, and closes Sept. 30, 2026, when the top 10 are announced. Phase 2 opens Oct. 7, 2026, and closes Nov. 4, 2026. Finalists are selected Nov. 11, 2026, with presentations Dec. 6–12, 2026, in Sydney. Registration deadline is Sept. 30, 2026.

The competition is open to the first 100 teams to register, with teams of one to four members. Participants must be 18 or older. AWS employees, interns, and scholars (2025–2026) and their immediate family members are ineligible, and residents of certain countries are excluded; full terms apply.