Projected Language Models: A Large Model Pre-Segmented Into Smaller Ones
This paper has been accepted at the Foundation Models in the Wild workshop at ICML 2024. Large language models are versatile tools but are not suitable for small inference budgets. Small models have more efficient inference but their lower capacity means that their performance can be good only if one limits their scope to a …
Read more “Projected Language Models: A Large Model Pre-Segmented Into Smaller Ones”