Came to know about Task specific pruning via this X/MaximeRivest post. See (Reda et al., 2025)
Pruning might be useful for niche languages. (I am thinking of Nim after reading this thread earlier)
References
Reda, W., Jangda, A., & Chintalapudi, K. (2025). Task Specific Pruning with LLM-sieve: How Many Parameters Does Your Task Really Need? https://arxiv.org/abs/2505.18350