Cai Shaofeng

I am currently a Senior Research Fellow in the Department of Computer Science, National University of Singapore.
I mainly work on neural networks, focusing on architecture engineering, AutoML, and DL techniques and systems.
My research interests extend to regularization, anomaly detection, and tabular data learning, advised by Prof. Ooi Beng Chin.

Email  /  Google Scholar  /  Github

Education

  • National University of Singapore (NUS)   2016 - 2021   
    • Ph.D. in Computer Science, School of Computing
    • Dean’s Graduate Research Excellence Award
    • Advisor: Prof. Ooi Beng Chin
  • Peking University (PKU)
    • BEc in Economics (double degree), National School of Development   2013 - 2016   
    • Cumulative Grade Point Average: 3.66/4.0
  • Peking University (PKU)
    • BSc in Computer Science, School of Computer Science and Technology   2012 - 2016   
    • Cumulative Grade Point Average: 3.65/4.0, Excellent Graduate
Publications

Current Research Initiatives

  • NAS Algorithms and Systems for Tabular Data; In-database ML System

  • Deep/Auto Feature Emebdding for Tabular Data; Cohort Neural Networks

  • Algorithms and Frameworks for Anomaly Detection

2024

  • [VLDB 2024] Database Native Model Selection: Harnessing Deep Neural Networks in Database Systems. [pdf]
    Naili Xing, Shaofeng Cai*, Gang Chen, Zhaojing Luo, Beng Chin Ooi, Jian Pei.
    In Proceedings of the VLDB Endowment

  • [VLDB 2024] METER: A Dynamic Concept Adaptation Framework for Online Anomaly Detection. [pdf]
    Jiaqi Zhu, Shaofeng Cai, Fang Deng, Beng Chin Ooi, Wenqiao Zhang
    In Proceedings of the VLDB Endowment

  • [OpenReview] Anytime Neural Architecture Search on Tabular Data. [pdf]
    Naili Xing*, Shaofeng Cai*, Zhaojing Luo, Beng Chin Ooi, Jian Pei
    Reivewed at 12th International Conference on Learning Representations

2023

  • [SIGMOD 2023] Robust and Transferable Log-based Anomaly Detection. [pdf]
    Peng Jia, Shaofeng Cai*, Beng Chin Ooi, Pinghui Wang, Yiyuan Xiong.
    In International Conference on Management of Data

  • [SIGMOD 2023] Regularized Pairwise Relationship based Analytics for Structured Data. [pdf]
    Zhaojing Luo, Shaofeng Cai, Yatong Wang, Beng Chin Ooi
    In International Conference on Management of Data

2022

  • [VLDB 2022] DyHealth: Making Neural Networks Dynamic for Effective Healthcare Analytics. [pdf]
    Kaiping Zheng, Shaofeng Cai, Horng Ruey Chua, Melanie Herschel, Meihui Zhang, Beng Chin Ooi.
    In Proceedings of the VLDB Endowment

  • [ICLR 2022] NASI: Label- and Data-agnostic Neural Architecture Search at Initialization. [pdf]
    Yao Shu, Shaofeng Cai, Zhongxiang Dai, Beng Chin Ooi and Kian Hsiang Low.
    In 10th International Conference on Learning Representations
    Key Words: training-free neural architecture search, neural tangent kernel

2021

  • [SIGMOD 2021] ARM-Net: Adaptive Relation Modeling Network for Structured Data. [pdf]
    Shaofeng Cai, Kaiping Zheng, Gang Chen, HV Jagadish, Beng Chin Ooi, Meihui Zhang.
    In International Conference on Management of Data

  • [AAAI 2021] Adaptive Knowledge Driven Regularization for Deep Neural Networks. [pdf]
    Zhaojing Luo, Shaofeng Cai, Can Cui, Beng Chin Ooi, Yang Yang.
    In AAAI Conference on Artificial Intelligence

  • [WACV 2021] Dynamic Routing Networks. [pdf]
    Shaofeng Cai, Yao Shu, Wei Wang.
    In IEEE/CVF Winter Conference on Applications of Computer Vision

  • [WACV 2021] GraphTCN: Spatio-Temporal Interaction Modeling for Human Trajectory Prediction. [pdf]
    Chengxin Wang*, Shaofeng Cai*, Gary Tan.
    In IEEE/CVF Winter Conference on Applications of Computer Vision

2020

  • [SIGMOD 2020] TRACER: A Framework for Facilitating Accurate and Interpretable Analytics for High Stakes Applications. [pdf]
    Kaiping Zheng, Shaofeng Cai, Horng Ruey Chua, Wei Wang, Kee Yuan Ngiam, Beng Chin Ooi.
    In International Conference on Management of Data

  • [TKDE 2020] The Disruptions of 5G on Data-driven Technologies and Applications. [pdf]
    Dumitrel Loghin, Shaofeng Cai, Gang Chen, Tien Tuan Anh Dinh, Feiyi Fan, Qian Lin, Janice Ng, Beng Chin Ooi, Xutao Sun, Quang-Trung Ta, Wei Wang, Xiaokui Xiao, Yang Yang, Meihui Zhang, Zhonghua Zhang.
    In IEEE transactions on Knowledge and Data Engineering

  • [VLDB 2020] Privacy Preserving Vertical Federated Learning for Tree-based Models. [pdf]
    Yuncheng Wu, Shaofeng Cai, Xiaokui Xiao, Gang Chen, Beng Chin Ooi.
    In Proceedings of the VLDB Endowment

  • [VLDB 2020] Model Slicing for Supporting Complex Analytics with Elastic Inference Cost and Resource Constraints. [pdf]
    Shaofeng Cai, Gang Chen, Beng Chin Ooi, Jinyang Gao.
    In Proceedings of the VLDB Endowment

  • [ICLR 2020] Understanding Architectures Learnt by Cell-based Neural Architecture Search. [pdf]
    Yao Shu, Wei Wang, Shaofeng Cai.
    In 8th International Conference on Learning Representations

2019

  • [TKDE 2019] Improving Data Analytics with Fast and Adaptive Regularization. [pdf]
    Zhaojing Luo, Shaofeng Cai, Gang Chen, Jinyang Gao, Wang-Chien Lee, Kee Yuan Ngiam, Meihui Zhang.
    In IEEE transactions on Knowledge and Data Engineering

  • [arXiv 2019] Effective and Efficient Dropout for Deep Convolutional Neural Networks. [pdf]
    Shaofeng Cai, Yao Shu, Wei Wang, Meihui Zhang, Gang Chen, Beng Chin Ooi.

2018

  • [ICDE 2018] Adaptive Lightweight Regularization Tool for Complex Analytics. [pdf]
    Zhaojing Luo, Shaofeng Cai, Jinyang Gao, Meihui Zhang, Kee Yuan Ngiam, Gang Chen, Wang-Chien Lee.
    In International Conference on Data Engineering