Trainium of Thought: Model and Kernel Co-Design under a 30-Minute Training Budget
My entry in the AWS Trainium Frontier Competition on Devpost, a language-model training competition on a single Trainium2 chip in which wall-clock time is the only budget. The architecture and the fused kernels were developed together so that more useful optimizer steps fit into 30 minutes.
Phase 1 ongoing. Currently 2nd on the public leaderboard; 1st at its peak.




