here you goThings I’ve made, read and saved — shared here.

Scaling Transformer to 1M Tokens and beyond with RMT

Preprints and otherBulatov, Kuratov, and Burtsev 2023Cite as [@bulatovScalingTransformer1M2023]

Bulatov, Aydar, Yuri Kuratov, and Mikhail S. Burtsev. 2023. “Scaling Transformer to 1M Tokens and beyond with RMT.”

BibTeX
@misc{bulatovScalingTransformer1M2023,
  title = {Scaling {{Transformer}} to {{1M}} Tokens and beyond with {{RMT}}},
  author = {Bulatov, Aydar and Kuratov, Yuri and Burtsev, Mikhail S.},
  year = 2023
}

Download