#slm
1 note or post, 1 link.
Notes and posts
Small LLMs aka SLMs
Finetuning ( via ) PEFT + TRL -- Examples of using peft with trl to finetune 8-bit models with Low Rank Adaption (LoRA) Unsloth -- Fine-tuning LLMs Guide | Unsloth Documentation Axolotl -- Axolotl AI - Open Source Fine…
Links Open in the Archive
distil labs | Blog
distilling small language models