← Previous · All Episodes · Next →
LT2: Linear-Time Looped Transformers Episode

LT2: Linear-Time Looped Transformers

Replaces quadratic softmax attention in looped architectures with linear/sparse mechanisms for iterative memory refinement, achieving parity with standard looped transformers at much lower cost.

· 42:37

|
← Previous · All Episodes · Next →