Fine-tuning an SLM locally is difficult. I’ve learnt it the hard way. I’ve been pulling my hair out over the last 3 days trying to train an SLM that texts just like me. So much scope to improve.
Full blog here: https://sskorde.com/writing/fine-tuning-a-model-to-text-like-me/