Sparse Delta Memory multiplies hidden capacity

A sparse addressing layer can expand the effective hidden state of recurrent models by orders of...