NVIDIA AI Releases Gated DeltaNet-2: A Linear Attention Layer That Decouples Erase and Write in the Delta Rule
By Asif Razzaq Publication Date: 2026-05-24 07:42:00 Linear attention replaces the unbounded KV cache of softmax attention with a fixed-size…