@dalias @sarahjamielewis @ariarhythmic Transformer models were originally designed for machine translation, they just got "repurposed" into the LLM next-word-predictors, so given that they share the same underlying math primitives, it's not that surprising to me that they'd share the same foundational runtime implementation.