A Lightweight Framework for Studying Learning Dynamics
Pico demystifies how language models learn. Lightweight and efficient, it's your go-to toolkit for training and analyzing models across different scales.
Built around two core libraries: pico-train for model training and pico-analyze for in-depth analysis—designed from the ground up to work seamlessly together.