Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
Ren, Liliang, Yang Liu, Yadong Lu, Yelong Shen, Chen Liang, and Weizhu Chen. 2024. “Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling.” arXiv:2406.07522 [id='cs.CL' full_name='Computation and Language' is_active=True alt_name='cmp-lg' in_archive='cs' is_general=False description='Covers natural language processing. Roughly includes material in ACM Subject Class I.2.7. Note that work on artificial languages (programming languages, logics, formal systems) that does not explicitly address natural-language issues broadly construed (natural-language processing, computational linguistics, speech, text retrieval, etc.) is not appropriate for this area.']. arxiv.org/abs/2406.07522
BibTeX
@misc{ren2024samba,
title = {Samba: {{Simple}} Hybrid State Space Models for Efficient Unlimited Context Language Modeling},
author = {Ren, Liliang and Liu, Yang and Lu, Yadong and Shen, Yelong and Liang, Chen and Chen, Weizhu},
year = 2024,
eprint = {2406.07522},
primaryclass = {id='cs.CL' full\_name='Computation and Language' is\_active=True alt\_name='cmp-lg' in\_archive='cs' is\_general=False description='Covers natural language processing. Roughly includes material in ACM Subject Class I.2.7. Note that work on artificial languages (programming languages, logics, formal systems) that does not explicitly address natural-language issues broadly construed (natural-language processing, computational linguistics, speech, text retrieval, etc.) is not appropriate for this area.'},
url = {https://arxiv.org/abs/2406.07522},
archiveprefix = {arXiv}
}