System

DATE-serve: Orchestrating Dependency, Arithmetic Intensity, and Thermal-awareness for Energy-Efficient Multimodal Inference
To appear.
Ziyang Jia, Sara Rashidi Golrouye, Laxmi Bhuyan, Benjamin Kubwimana, Devashree Tripathy, Zexin Li, Cong Liu, Daniel Wong
Real-Time Continual Learning on Embedded GPUs
Online continual learning (OCL) is an enabling technology for safety-critical autonomous embedded systems whose deployment environments …
Zexin Li, Dongjoo Seo, Nikil Dutt, Jun Sheng, Cong Liu
LeMix: Unified Scheduling for LLM Training and Inference on Multi-GPU Systems
To appear soon.
Yufei Li, Zexin Li, Yinglun Zhu, Cong Liu
PDF Cite DOI
BOXR: Body and head motion Optimization framework for eXtended Reality
The emergence of standalone Extended Reality (XR) systems has enhanced user mobility, accommodating both subtle, frequent head motions …
Ziliang Zhang, Zexin Li, Hyoseung Kim, Cong Liu
PDF Cite Code DOI
DuoJoule: Accurate On-Device Deep Reinforcement Learning for Energy and Timeliness
Deep Reinforcement Learning (DRL) is critical for autonomous systems to continuously learn and adapt in dynamic environments. However, …
Soheil Shirvani, Aritra Samanta, Zexin Li, Cong Liu
PDF Cite DOI
RT-LM: Uncertainty-Aware Resource Management for Real-Time On-Device Language Models
Recent advancements in language models~(LMs) have gained substantial attentions on their capability to generate human-like responses. …
Yufei Li, Zexin Li, Wei Yang, Cong Liu
PDF Cite DOI
R^3: On-device Real-Time Deep Reinforcement Learning for Autonomous Robotics
Autonomous robotic systems, like autonomous vehicles and robotic search and rescue, require efficient on-device training for continuous …
Zexin Li, Aritra Samanta, Yufei Li, Andrea Soltoggio, Hyoseung Kim, Cong Liu
PDF Cite Code DOI
RED: A Systematic Real-Time Scheduling Approach for Robotic Environmental Dynamics
Intelligent robots are designed to effectively navigate dynamic and unpredictable environments laden with moving mechanical elements …
Zexin Li, Tao Ren, Xiaoxi He, Cong Liu
PDF Cite DOI
Efficient algorithms for task mapping on heterogeneous CPU/GPU platforms for fast completion time
In GPU-based embedded systems, the problem of computation and data mapping for multiple applications while minimizing the completion …
Zexin Li, Yuqun Zhang*, Ao Ding, Husheng Zhou, Cong Liu
PDF Cite Code DOI