About Me

about

Hi, I am Shenggui Li, you can call me Frank Lee as well. I am an incoming PhD student of the 📍S-Lab in Nanyang Technological University @ Singapore, advised by Prof. Tianwei Zhang and Prof. Ivor Tsang. Prior to that, I obtained my 🤓 B.Eng in Computer Science in Nanyang Technological University in 2021 advised by Prof. Chen Change Loy. I also worked with Prof. Yang You from 2021 to 2024 as a research asssistant in the HPC-AI Lab and a founding member of HPC-AI Technology.

My interest lies at the intersection of 🤖 machine learning and ⚡️ high performance computing. I first proposed the concept of sequence parallelism in 2021, which has attracted follow-ups and is widely adopted for large-scale model training. I am the author of Ring Self-Attention and Colossal-AI. During my undergraduate study, I had the privilege to spend a wonderful year on the NTU HPC Team and we won the overall 🥈 2nd place in the student cluster competition of ISC21.

I am involved in several interesting projects, feel free to email me for collaboration.

News

Selected Publications

Efficient & Large Scale Machine Learning
Cluster Scheduling

Honours and Awards

  • [2024]  A*STAR Computing & Information Science Scholarship
  • [2021]  Overall 2nd Place, ISC21 Student Cluster Competition
  • [2020]  Merit Award, APAC HPC-AI Competition
  • [2018]  NTU President Research Scholar
  • [2017-2021]  NTU Science & Technology Undergraduate Scholarship
  • [2012-2016]  Singapore SM1 Scholarship

Skills

Deep Learning
Python
C++
PyTorch
TensorFlow
CUDA
Optimization
System
Git
Kafka
Vault
Grafana
Prometheus
Docker
Kubernetes
CI/CD
MySQL
MongoDB
Nginx
AWS
App Development
JavaScript
Golang
Java
React
Node.js
Django
FastAPI
Next.js
MicroApp
Cypress