Came to know about Task specific pruning via this X/MaximeRivest post. See (Reda et al. 2025)
Pruning might be useful for niche languages. (I am thinking of Nim after reading this thread earlier)
References
- Reda, Jangda, Chintalapudi (2025). Task Specific Pruning with LLM-sieve: How Many Parameters Does Your Task Really Need?.