Rewon Child

1 post

Generative Modeling with Sparse Transformers
Generative Modeling with Sparse Transformers

We've developed the Sparse Transformer, a deep neural network which sets new records at predicting what comes next in a sequence—whether text, images, or sound.