Presenting work on “Distributed LLM Inference” at IFIP Performance ’25

I just presented our first work on LLM model serving at IFIP Performance 2025 this week. The work, grounded in a real LLM serving system called PETALS, is the first to our knowledge that mathematically formulates and tackles the unique resource allocation problems (which we termed “block placement and request routing”) in this type of […]

Chairing MobiHoc 2025 – Houston, TX

Great honor to co-chair this year’s TPC with Prof. Yin Sun from Auburn University. Excellent talks and keynote addresses centered around NextG (6G in particular) and the interplay between wireless/mobile networking and AI. Big thanks to everyone on the TPC and the organizing committee for excellent teamwork in putting this program together! linkedin post

Ting’s Promotion to Full Professor

I’m honored to share that I’ve been promoted to Full Professor at the Department of Computer Science, School of EECS, Penn State University. I’m deeply grateful to my mentors, colleagues, students, and collaborators who have supported, inspired, and sometimes tolerated me throughout this journey. Big thank you for being part of it.

papers accepted to ToN and ICDCS

The following papers are just accepted to Trans. Networking and ICDCS: Yudi Huang and Ting He, Overlay Routing Over an Uncooperative Underlay, accepted to IEEE/ACM Transactions on Networking, March 2025. [Supplementary Materials] Jinyi Yoon, Jiho Lee, Ting He, Nakjung Choi and Bo Ji, S2M3: Split-and-Share Multi-Modal Models for Distributed Multi-Task Inference on the Edge, IEEE ICDCS, […]

Hosting Prof. Parimal Parag from IISc

Parimal is visiting as part of the bigger Penn State-IISc Collaboration Initiative funded by our joint seed grant. He gave a talk at the CSE Colloquium on “The Power of Two in Large Service Marketplaces”: https://psu.mediaspace.kaltura.com/media/Parimal+Parag+-+CSE+Colloqium+-+Feb+27+-+2025/1_3x0t2zzl  

Ting listed in the 2024 “N2Women: Stars in Networking and Communications”

I am honored to be the only Associate Professor in this year’s list. Sincere thanks to Dr. Tom La Porta for your generous support and nomination. And thank you N2Women for the award! PSU news: https://www.psu.edu/news/engineering/story/n2women-names-computer-science-researcher-star-networking-and-communications COE news: https://news.engr.psu.edu/2025/he-ting-n2women-star-of-networking-and-communications.aspx ============= In alphabetical order (by last name), here are the 10 Stars for 2024: • Carneiro Viana, Aline, Research […]

Seed grant with IISc on “Large-scale Distributed Learning for Democratizing Future AI”

Large language models (LLMs) are powerful models with surprising capabilities for broad downstream language processing tasks. They are however very expensive to deploy, even if pretrained. With the following seed grant from Penn State Global, we will scratch the surface towards lowering this resource barrier via optimized distributed inference through a collaboration with the Indian […]

Two papers accepted to MobiHoc ’24

The first paper extends our long-term research on network (topology) tomography to machine learning, by studying the use of tomographic information in overlay-based decentralized learning: Yudi Huang, Tingyang Sun, and Ting He, Overlay-based Decentralized Federated Learning in Bandwidth-limited Networks, ACM MobiHoc, October 2024. [full version in arXiv] The second paper results from our collaboration with Prof. […]

Tutorial at SIGMETRICS’24 and Keynote at NetSoft’24 on Network Tomography

Network tomography is a fascinating field about “reverse-engineering a blackbox network using external measurements” that combines statistical inference, performance evaluation, measurement design, and intricate algorithms. After summarizing in our book Network Tomography (cambridge.org) our learnings on a relatively easier branch of “network performance tomography” which assumes the routing topology to be known, my team has […]

Celebrating graduation for Yudi and Daniel

Congratulations on Dr. Huang (left 2) and Dr-to-be Chiu (left 3)! Congratulations again to Dr. Xie (already started at ByteDance)! And welcome to our newest member Tuan (left 1)! It is certainly a productive commencement season for NSRG with three graduates (Tian, Yudi, Daniel). Best luck on all your next endeavors.

Powered by WordPress. Designed by WooThemes

Skip to toolbar