here you goThings I’ve made, read and saved — shared here.

LLaMA Now Goes Faster on CPUs

n.d. “LLaMA Now Goes Faster on CPUs.” justine.lol/matmul/

Abstract

I wrote 84 new matmul kernels to improve llamafile CPU performance.

BibTeX
@misc{LLaMANowGoes,
  title = {{{LLaMA Now Goes Faster}} on {{CPUs}}},
  url = {https://justine.lol/matmul/},
  urldate = {2024-04-01},
  abstract = {I wrote 84 new matmul kernels to improve llamafile CPU performance.},
  langid = {english}
}

Download