Hongyi Wang

Hongyi Wang

Assistant Professor at Rutgers CS

Efficient ML Systems and LLM Infrastructure

Building scalable, practical, and trustworthy machine learning systems.

I am an Assistant Professor in the Department of Computer Science at Rutgers University. My research focuses on scalable and efficient machine learning algorithms and systems, with a current emphasis on LLMs.

Selected Papers Research Group CV
Rutgers CS Distributed ML LLM Systems Federated Learning

Background

I was a Senior Project Scientist at the Machine Learning Department at CMU, working with Eric Xing. I obtained my PhD in Computer Science from UW-Madison, advised by Dimitris Papailiopoulos.

Research Direction

I study efficient training and serving of large-scale machine learning models, especially large language models under real system constraints.

Selected work

Selected Publications

Full publication list
arXiv 2025 K2-V2: A 360-Open, Reasoning-Enhanced LLM COLM 2024 LLM360: Towards Fully Transparent Open-Source LLMs MLSys 2023 Cuttlefish: Low-Rank Model Training without All the Tuning ICLR 2020 Oral Federated Learning with Matched Averaging

Recent notes

News

People

Research Group

Daize DongPhD at Rutgers CS Haolong JiaPhD at Rutgers CS
Jiawei WuPhD at Rutgers CS
Junlin ChenUndergraduate at Rutgers Ryan ChengUndergraduate at Rutgers
Shawn CuiMiddle School Student

Courses

Teaching

Spring 2026CS 439, Intro to Data Science
Fall 2025RU CS 671, Recent Advances in Large Language Models

Community

Services

Area Chair: NeurIPS 2026, MLSys 2025, CPAL 2026

PC Member: DAC 2024, EuroSys 2024, SOSP 2023 (light PC), MLSys 2023-2026, SIGKDD 2022, AAAI 2021-2022

Reviewer (Journals): JMLR, TMLR, IEEE TNNLS, IEEE IoT-J, IEEE/ACM Transactions on Networking

Reviewer (Conferences): SC 2026, COLM 2026, ICML 2019-2026, NeurIPS 2019-2025, CVPR 2021-2023, ICCV 2021-2022, ICLR 2021-2025, AAAI 2021-2024, SIGKDD 2022-2023