Jul 4, 2026
DeltaNet vs SSM: Two Fixed-Size Memory Systems Beyond Attention
C-Kernel-Engine architecture note DeltaNet and SSM/Mamba are two ways to reduce the amount of unbounded attention history a model has to carry by introducing fixed-size learned state. They a...
Read post →