distilling small language models
Related
Small LLMs aka SLMs
Note ·
Finetuning ( via ) PEFT + TRL -- Examples of using peft with trl to finetune 8-bit models with Low Rank Adaption (LoRA)…
Grok
Note ·
Connect Grok to Hermes Agent
Software construction kits
Note ·
Software Construction Kits.. inspired by Folklore.org: Calculator Construction Set. See also Malleable software in the…
Extract Structured Information
Note ·
Extracting structured information from unstructured text using LLMs is a good tool to have in your llm toolkit…
AI on a budget
Note ·
What if you do not want to use AI SaaS products for any reason (monetary - subscriptions add up quick, privacy - do not…
Keeping up with AI
Note ·
Sources on keeping up with AI. This is a good start as of July 2025 - How I keep up with AI progress (and why you must…