Jiangsu(江溯) Du(杜)

I am now a PostDoc at the Sun Yat-sen University, working on High Performance Computing, and Distributed Artificial Intelligence System.

Technical Blog (Chinese)

Travel Vlog


News

06 Feb 2023 Started PostDoc at the Sun Yat-sen University with Prof. Yutong Lu.

19 Oct 2021 Started visiting scholar at the University of Singapore with Prof. Yang You.

19 Oct 2021 Joined LuChen as a Research Intern, leading the large-scale Model Inference Project, EnergonAI, cooperating with Jiarui Fang, Shenggan Cheng, and Ziming Liu.

25 June 2021 Joined Tencent Shanghai, Visualization Group, as a Research Intern, working on technical verification of GPU pooling, mentored by Song Jike and Feng Kehuan.

25 Feb 2019 Visited Svalbard, what an amazing place.

1 Sept 2018 Started my Ph.D. at Sun Yat-sen University with Prof. Xiangke Liao and Prof. Yunfei Du.

Education

  • Ph.D in Computer Science, Sun Yat-sen University && National SuperComputer Center in Guangzhou, 2018.9 - 2022.12
  • Visiting Scholar, National University of Singapore && HPC-AI lab. 2021.10.17-2022.10.16.
  • M.Sc in High Performance Computing and Data Science, The University of Edinburgh && Edinburgh Parallel Computing Center, 2016.9 - 2017.9
  • B.Sc. in Spatial Information and Digital Technology, Wuhan University, 2012.9 - 2016.7

Selected Publications

  1. Jiangsu Du, Jinhui Wei, Jiazhi Jiang, Shenggan Cheng, Dan Huang, Zhiguang Chen, Yulong Lu, “Liger: Interleaving Intra- and Inter-Operator Parallelism for Distributed Large Model Inference”, PPoPP, 2024.
  2. Shengyuan Ye, Jiangsu Du*, Liekang Zeng, Wenzhong Ou, Xiaowen Chu, Yutong Lu, Xu Chen*, “Galaxy: A Resource-Efficient Collaborative Edge AI System for In-situ Transformer Inference”, INFOCOM, 2024.
  3. Jiangsu Du, Jiazhi Jiang, Yang You, Dan Huang, Yutong Lu, “Handling Heavy-tailed Input of Transformer Inference on GPUs”, ICS, 2022.
  4. Yuanxin Wei, Shengyuan Ye, Jiazhi Jiang, Xu Chen, Dan Huang*, Jiangsu Du*, Yutong Lu, “Communication-Efficient Model Parallelism for Distributed In-situ Transformer Inference”, DATE, 2024.
  5. Jiangsu Du, Xin Zhu, Minghua Shen, Yunfei Du, Yutong Lu, Nong Xiao, and Xiangke Liao, “Model Parallelism Optimization for Distributed Inference via Decoupled CNN Structure”, TPDS.
  6. Jiangsu Du, Jiazhi Jiang, Jiang Zheng, Hongbin Zhang, Dan Huang, Yutong Lu, “Improving Computation and Memory Efficiency for Real-world Transformer Inference on GPUs”, TACO, 2023.
  7. Jiangsu Du, Minghua Shen, Yunfei Du. “A Distributed In-Situ CNN Inference System forIoT Applications”, ICCD 2020.
  8. Jiazhi Jiang, Jiangsu Du, Dan Huang, Zhiguang Chen, Yutong Lu, Xiangke Liao, “Full-Stack Optimizing Transformer Inference on ARM Many-Core CPU”, TPDS, 2023.

Google Scholar

Professional Service

  • Program committee: HiPC’22.
  • Reviewer: CCGRID’23, IOTJ.