Large language models (LLMs) are powerful models with surprising capabilities for broad downstream language processing tasks. They are however very expensive to deploy, even if pretrained. With the following seed grant from Penn State Global, we will scratch the surface towards lowering this resource barrier via optimized distributed inference through a collaboration with the Indian Institute of Science (IISc):
https://www.psu.edu/news/global-programs/story/penn-state-indian-institute-science-award-joint-research-seed-grants?utm_audience=Staff&utm_source=newswire&utm_medium=email&utm_campaign=Penn%20State%20Today&utm_content=09-12-2024-21-38&utm_term=Research%20-%201