Frontier models have made this a golden age for training tiny models 🤏
I just trained a tiny autocomplete model on the Enron emails dataset for 35 cents:
• 944K parameters, 0.98 MB
• trained in 14 minutes on HF Jobs ($0.35)
• runs in your browser
• always out of the office