A Princeton Researcher Proposes Recurrent Looped Transformer (RLT) that Carries Decoder State across Every Token, Fixing 96 Blocks per Token with Unbounded Temporal Depth

policyMarkTechPostSep 13, 2026

Yifan Zhang's Recurrent Looped Transformer (RLT) technical report proposes a causal encoder paired with a recurrent decoder that carries its final hidden state and layerwise sliding-window attention cache across every prompt and response token, with no rese...

Impact: LowConfidence: LowNovelty: Incremental
policymarktechpostcodingopen-source

See the whole story

Read the original on MarkTechPost

Sens.ai aggregates and assesses published reporting. The assessment above is machine generated; the original source is authoritative.