University of California, Merced
[1/2025] Our work on the CXL memory evaluation (Performance Characterization of CXL Memory and Its Use Cases) has been accepted to IPDPS'25.
[12/2024] Thanks MICRON for their generous donation of CXL memory hardware!
[10/2024] Our collaborative work with Meta on using memory tiering for recommendation models has been accepted to HPCA'25. :)
[10/2024] Our collaborative work with Microsoft on using memory tiering for GNN has been accepted to HPCA'25.
[6/2024] Our paper on CXL memory (Efficient Tensor Offloading for Large Deep-Learning Model Training based on Compute Express Link) is accepted by SC'24.
[6/2024] Many thanks to AMD for their hardware donation!
[4/2024] Our paper on tiered memory ("FlexMem: Adaptive Page Profiling and Migration for Tiered Memory") is accepted by USENIX ATC'24.
[4/2024] Multiple undergraduate/master students (from UC Merced, UMN, UIUC, and Wisconsin) will join the lab for summer internship. :)
[4/2024] Dong Li was invited to give a talk at the Empowering Software through Machine Learning (ESwML) workshop associated with EuroSys'24.
[3/2024] Dong Li was invited to join two panels in ExHET'24 and GPGPU'24 workshops associated with PPoPP'24.
[1/2024] Our paper on tiered memory ("Rethinking Memory Profiling and Migration for Multi-Tiered Large Memory Systems") is accepted by EuroSys'24.
[1/2024] Welcome new PhD student, Shangye Chen!
[10/2023] Our paper on dynamic neural network ("Enabling Large Dynamic Neural Network Training with Learning-based Memory Management") is accepted by HPCA'24.
[8/2023] The undergraduate student Elgin Li joined PASA to enrich his experiences in research. Welcome Elgin!
[6/2023] Our project on tensor network is funded by the NFS PPoSS program. Thanks to our collaborators at NCSU and Oregon State!
[6/2023] NSF funds us to establish an IUCRC center, the Center for Memory System Research (CEMSYS)! Looking forward to the future collaboration between UC Merced, UC Davis and industry partners.
[5/2023] We summarized the discussions at the 1st Workshop for Heterogeneous and Composable Memory and published the summary as a SigArch blog.
[3/2023] A paper "Auto-HPCnet: An Automatic Framework to Build Neural Network-based Surrogate for High-Performance Computing Applications " is accepted to HPDC'23.
[2/2023] Co-chaired Workshop for Heterogeneous and Composable Memory
[2/2023] Invited as a panelist in the panel on "Challenges and Solutions for the upcoming Extreme Heterogeneity Era" in International Workshop on Extreme Heterogeneity Solutions associated with PPoPP'23.
[12/2022] Welcome new PhD students, Bin Ma and Jianbo Wu!
[11/2022] Dong Li was invited as a panelist in the panel on "AI for HPC" in Seventh International Workshop on Extreme Scale Programming Models and Middleware associated with SC'22.
[11/2022] Dong Li co-chaired the AI for Scientific Applications workshop associated with SC'22.
[11/2022] Thanks Oracle for supporting our research on large-scale AI model training!
[11/2022] Thanks Lawrence Livermore National Lab (LLNL) for supporting our research on heterogeneous memory!
[11/2022] Group meeting with DarchR Lab@UC Davis for research collaboration.
[11/2022] A paper "Merchandiser: Data Placement on Heterogeneous Memory for Task-Parallel HPC Applications with Load-Balance Awareness" is accepted to PPoPP'23.
[11/2022] Prof. Jian Huang@UIUC visited us and gave a talk "The ISA of Future Storage Systems: Interface, Specialization and Approach".
[9/2022] A paper on using heterogeneous memory to train GNN (titled "Betty: Enabling Large-Scale GNN Training with Batch-Level Graph Partitioning") is accepted to ASPLOS'23.
[9/2022] Welcome Prof. Tsung-wei Huang@Utah visits us.
[8/2022] Welcome new PhD student, Jin Huang!
[8/2022] Thanks SK hynix for supporting our research on heterogeneous memory.
[6/2022] A paper on mixed-precision AI model training is accepted into ATC'22.
[5/2022] Dong Xu and Jie Liu will go to SK hynix and Tencent for summer internship. Congratulations!
[4/2022] Congratulations to my student, Jie Ren. She will join the College of William and Mary as a tenure-track assistant professor since fall!
[4/2022] Congratulations to my student, Wenqian Dong. She will join the Florida International University as a tenure-track assistant professor since fall!
[4/2022] Congratulations to my student, Jiawen Liu. He will join the Meta (facebook) AI Research.
[4/2022] A paper, "Campo: A Cost-Aware and High-Performance Mixed Precision Optimizer for Neural Network Training", is accepted to ATC'22.
[10/2021] Dong gave a talk on large AI model training at ECE@UMass.
[10/2021] Thanks Facebook and Western Digital for supporting our research on big memory.
[9/2021] A paper, "Flame: A Self-Adaptive Auto-Labeling System for Heterogeneous Mobile Processors" is accepted into SEC'21.
[9/2021] Thanks ANL and SK Hynix for supporting our research on machine learning systems and big memory!
[8/2021] Welcome new PhD student, Dong Xu :-)
[6/2021] Dong was invited to give a talk and be a panelist at 2nd Workshop on Heterogeneous Memory Systems (HMEM)
[6/2021] A paper "Fauce: Fast and Accurate Deep Ensembles with Uncertainty for Cardinality Estimation" is accepted into VLDB'21.
[6/2021] Dong was selected to be an associate editor for IEEE Transactions on Parallel and Distributed Systems (TPDS).
[5/2021] An NSF grant is funded to support our research on big memory for HPC.
[5/2021] Dong was invited to give a keynote at the Eleventh International Workshop on Accelerators and Hybrid Emerging Systems (AsHES).
[4/2021] Our work on training billion-scale NLP models on heterogeneous memory is accepted into USENIX ATC'21! This is a collaboration work with Microsoft.
[4/2021] Our ASPLOS'21 paper won the distinguished artifact award! Only two papers won this award.
[3/2021] Four papers are accepted into ICS'21!
[3/2021] Prof. Xu Liu from NCSU will give us a talk "Rethinking Performance Tools Research" on April 2.
[3/2021] Our collaboration work with LLNL on MPI fault tolerance benchmark suite is reported by HPCWire.
[3/2021] Wenqian got an internship offer! She will go to the HP labs during the summer working on scientific machine learning.
[1/2021] Our collaboration work with Microsoft on training large NLP models with heterogeneous memory draws some attentions from media (see 1 and 2). :)
[1/2021] A paper "Tahoe: Tree Structure-Aware High Performance Inference Engine for Decision Tree Ensemble on GPU" is accepted into EuroSys'21.
[12/2020] Dong was invited to give a talk at IBM Research Almaden, titled "Memory Management in Heterogeneous Memory Systems: Case Studies with Machine Learning Workloads".
[12/2020] Shuangyan Yang joined us as a PhD student. Welcome aboard, Shuangyan!
[12/2020] A paper “ArchTM: Architecture-Aware, High Performance Transaction for Persistent Memory” is accepted in FAST'21!
[12/2020] Welcome Yan Li from Western Digital to visit us. She gave a talk, “NAND Flash and its Application”.
[11/2020] A paper “Sparta: High-Performance, Element-Wise Sparse Tensor Contraction on Heterogeneous Memory” is accepted in PPoPP'21!
[10/2020] Wenqian's SC'20 work is highlighted by the U.S. Department of Energy!
[10/2020] Dong was invited to give a talk@NCSU, titled "Is Big Memory Useful for HPC Applications? A Case Study with Molecular Dynamics Simulation".
[10/2020] A paper “Sentinel: Efficient Tensor Migration and Allocation on Heterogeneous Memory Systems for Deep Learning” is accepted in HPCA'21!
[10/2020] Dong was invited to give a talk at Intel, titled "Performance Optimization of ANN on Optane-based Heterogeneous Memory".
[9/2020] Welcome Dr. Zhao Zhang from Texas Advanced Computing Center! He will give us a talk virtually, "Scalable Deep Learning on Supercomputers".
[9/2020] A paper “HM-ANN: Efficient Billion-Point Nearest Neighbor Search on Heterogeneous Memory” is accepted in NeurIPS'20!
[9/2020] Congratulate Jiawen for his internship in the Facebook research!
[8/2020] The lab has a new website! :)
[8/2020] A paper “MATCH: An MPI Fault Tolerance Benchmark Suite” is accepted in IISWC'20.
[7/2020] A paper “Exploring Non-Volatility of Non-Volatile Memory for High Performance Computing Under Failures” is accepted in Cluster’20.
[6/2020] A paper “Ribbon: High Performance Cache Line Flushing for Persistent Memory” is accepted in PACT’20.
[6/2020] A paper “Smart-PGSim: Using Neural Network to Accelerate AC-OPF Power Grid Simulation” is accepted in SC’20.
[3/2020] Congratulations to Jie Ren, Kai, Jie Liu, Jiawen and Wenqian for their summer internships in Microsoft research, ByteDance, Futurewei and PNNL!
[3/2020] A paper “RIANN: Real-time Incremental Learning with Approximate Nearest Neighbor on Mobile Devices” is accepted in USENIX OpML’20.
[2/2020] A paper “Flame: A Self-Adaptive Auto-Labeling System for Heterogeneous Mobile Processors” is accepted in On-Device Intelligence Workshop at MLSys’20.
[1/2020] Dong was invited to join IEEE Transactions on Parallel and Distributed Systems (TPDS) Review Board.
[1/2020] Dong was invited as participate in the SIAM parallel processing panel.
[12/2019] Welcome Dr. Cong Xu from HP Labs visiting us!
[12/2019] A paper “Demystifying the Performance of HPC Scientific Applications on NVM-based Memory Systems” is accepted in IPDPS’20.
11/2019] The PASA lab went to SC’19! Jie Ren, Kai and Anzheng were selected by SC as student volunteers.
[10/2019] Congratulate Luanzheng for winning the Graduate Dean’s Dissertation Fellowship, because of his outstanding performance during PhD study!
[8/2019] Welcome Zhen Xie to join PASA as a postdoc!
[8/2019] A paper “Adaptive Neural Network-Based Approximation to Accelerate Eulerian Fluid Simulation” is accepted in SC’19!
[7/2019] Attended Persistent Programming in Real-Life workshop in San Diego.
[6/2019] Two papers were accepted by IPDPS’19: One is about runtime concurrency control and operation scheduling on TensorFlow, and the other is about application resilience modeling. See you in Brazil!
[5/2019] Anzheng and Jiawen went to Rio, Brazil (IPDPS’19) to present our papers. Enjoy the trip![4/2019] Attended SysML’19 with Jiawen, Jie Liu and Xin at Stanford.
[4/2019] Attended SysML’19 with Jiawen, Jie Liu and Xin at Stanford.
[3/2019] Attended the annual non-volatile memory workshop in San Diego to present our work!
[2/2019] Congratulations to Wenqian Dong and Luanzheng Guo for their internship at Pacific Northwest National Laboratory and Lawrence Livermore National Lab.
[1/2019] Welcome new PhD student, Jie Liu!
[1/2019] Welcome Dr. Naoya Maruyama from Lawrence Livermore National Lab to visit the PASA lab!
[1/2019] Three papers on non-volatile memory were accepted in 10th Annual Non-Volatile Memories Workshop.
[9/2018] Our research on resilience computation patterns is highlighted in HPCWire (our paper:FlipTracker: Understanding Natural Error Resilience in HPC Applications)
[8/2018] Congratulations to Wenqian, Anzheng, Kai, and Jie! They are accepted as student volunteers for SC’18. Congratulations to Jiawen and Jie! They are accepted as student volunteers for OSDI’18.
[9/2018] A paper (FlipTracker: Understanding Natural Error Resilience in HPC Applications) is accepted by SC’18.
[7/2018] A paper (Processing-in-Memory for Energy-efficient Neural Network Training: A Heterogeneous Approach) is accepted by MICRO’18.
[6/2018] A paper (GMOD: A Dynamic GPU Memory Overflow Detector) is accepted by PACT’18.
[6/2018] A paper (Runtime Data Management on Non-Volatile Memory-Based Heterogeneous Memory for Task Parallel Programs) is accepted by SC’18.
[5/2018] A paper (Modeling Application Resilience in Large Scale Parallel Execution) is accepted by ICPP’18.
[5/2018] Welcome Dr. Guoyang Chen (Alibaba research) to visit the PASA lab!
[4/2018] Congratulations to Anzheng, Kai, Jie, and Jiawen! They will go to Lawrence Livermore National Lab and Oak Ridge National Lab as summer student interns.
[4/2018] The PASA Lab gets research fund from Lawrence Livermore National Lab to support its work on HPC resilience.
[4/2018] Welcome Prof. Xia Ning (Indiana University – Purdue University Indianapolis) to visit the PASA lab!
[2/2018] Two papers are accepted as posters in Non-Volatile Memories Workshop.
[12/2017] Congratulations to Wenqian, Jie, and Jiawen. They are selected as student volunteers for SC’17.
[8/2017] Welcome four new PhD students, Wenqian Dong, Jiawen Liu, Jie Ren, and Letian Kang!
[6/2017] Two papers are accepted in IEEE Cluster. One paper is about NVM crash consistence, “Algorithm-Directed Crash Consistence in Non-Volatile Memory for HPC”. The other paper is about GPU performance modeling, “Performance Modeling for Optimal Data Placement on GPU with Heterogeneous Memory Systems”.
[6/2017] One paper, “Unimem: Runtime Data Management on Non-Volatile Memory-based Heterogeneous Main Memory”, is accepted in SC’17.
[6/2017] One paper, “Performance Evaluation and Modeling of HPC I/O on Non-Volatile Memory”, is accepted in NAS’17.
[6/2017] NSF funds our project on processing-in-memory.
[2/2017] Two students in PASA lab get internships during the summer. They are PhD student Luanzheng Guo (Lawrence Livermore National Lab), and Kai Wu (Los Alamos National Lab). Congratulations, students!
[11/2016] Our poster is nominated as the best poster in SC’16.
[11/2016] The PASA lab went to SC’16. Four PhD students of the lab were selected as SC’16 student volunteers.
[6/2016] We are selected as an NVIDIA Research Center with Dong as the lead PI.
[6/2016] NSF funds our project on heterogeneous memory.
[5/2016] Undergraduate student, Hanlin He, won UC Merced Outstanding Student Award in the class of 2016. Congratulations, Hanlin!
[5/2016] Three students in PASA lab get internships during the summer! They are PhD student Luanzheng Guo (Lawrence Livermore National Lab), and undergraduate students Hanlin He and Kian Bradley (Lawrence Berkeley National Lab). Congratulations, students!
[3/2016] A paper (Algorithm-directed Data Placement in Explicitly Managed Non-Volatile Memory) is accepted by HPDC’16.
[1/2016] Dong received an NSF CAREER Award!
[9/2015] Two undergraduate students (Hanlin He and Zachary Canann) join PASA!
[9/2015] The PhD student, Yingchao Huang, is selected as a student volunteer for SC’15.
[8/2015] 2 PhD students (Yingchao Huang and Anzheng Guolu) and 3 Master students (Wei Liu, Hanbin Tao, and Himanshu Pillai) join PASA!