Zifan Shi
Hello! I am a research scientist at Adobe Research.
I obtained my PhD degree at the Department of Computer Science and Engineering, the Hong Kong University of Science and Technology (HKUST), supervised by Prof. Dit-Yan Yeung and Prof. Qifeng Chen.
During my PhD study, I was a visiting student researcher at Stanford University, advised by Prof. Gordon Wetzstein.
Before that, I obtained a Bachelor's degree at Nanjing University.
My research interests include generative models and 3D&4D vision.
If you're interested in collaborating or doing an internship with me, please don't hesitate to get in touch!
:)
Email  / 
Github  / 
Google Scholar   
|
|
- [03/2025]: One paper is accepted to CVPR 2025.
- [11/2024]: One papers is accepted to 3DV 2025.
- [07/2024]: Two papers are accepted to ECCV 2024.
- [02/2024]: One paper is accepted to CVPR 2024.
- [01/2024]: One paper is accepted to ICLR 2024 (Spotlight).
- [09/2023]: One paper is accepted to NeurIPS 2023 Datasets and Benchmarks Track.
- [07/2023]: One paper is accepted to ICCV 2023.
- [02/2023]: Two papers, with one highlight, are accepted to CVPR 2023.
- [10/2022]: Our survey on 3D generative models is available now.
- [09/2022]: One paper is accepted to NeurIPS 2022 (Spotlight).
- [07/2022]: One paper is accepted to ECCV 2022 (Oral).
- [07/2021]: One paper is accepted to IROS 2021.
- [03/2021]: One paper is accepted to CVPR 2021.
|
Publications
(* indicates equal contribution)
|
Exploring Sparse MoE in GANs for Text-conditioned Image Synthesis
Jiapeng Zhu*,
Ceyuan Yang*,
Kecheng Zheng,
Yinghao Xu,
Zifan Shi,
Yifei Zhang,
Qifeng Chen,
Yujun Shen
CVPR 2025  
Paper /
Code
|
|
Learning Naturally Aggregated Appearance for Efficient 3D Editing
Ka Leong Cheng,
Qiuyu Wang,
Zifan Shi,
Kecheng Zheng,
Yinghao Xu,
Ouyang Hao,
Qifeng Chen,
Yujun Shen
3DV 2025  
Paper /
Project Page /
Code
|
|
GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generation
Yinghao Xu*,
Zifan Shi*,
Yifan Wang,
Hansheng Chen,
Ceyuan Yang,
Sida Peng,
Yujun Shen,
Gordon Wetzstein
ECCV 2024  
Paper /
Project Page /
Code /
Hugging Face Demo
|
|
Real-time 3D-aware Portrait Editing from a Single Image
Qingyan Bai,
Zifan Shi,
Yinghao Xu,
Ouyang Hao,
Qiuyu Wang,
Ceyuan Yang,
Xuan Wang,
Gordon Wetzstein,
Yujun Shen,
Qifeng Chen
ECCV 2024  
Paper /
Project Page /
Code /
Hugging Face Demo
|
|
Gaussian Shell Maps for Efficient 3D Human Generation
Rameen Abdal*,
Yifan Wang*,
Zifan Shi*,
Yinghao Xu,
Ryan Po,
Zhengfei Kuang,
Qifeng Chen,
Dit-Yan Yeung,
Gordon Wetzstein
CVPR 2024  
Paper /
Project Page /
Code
|
|
DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model
Yinghao Xu,
Hao Tan,
Fujun Luan,
Sai Bi,
Peng Wang,
Jiahao Li,
Zifan Shi,
Kalyan Sunkavalli,
Gordon Wetzstein,
Zexiang Xu,
Kai Zhang
ICLR 2024 (Spotlight Presentation)  
Paper /
Project Page
|
|
GenDeF: Learning Generative Deformation Field for Video Generation
Wen Wang,
Kecheng Zheng,
Qiuyu Wang,
Hao Chen,
Zifan Shi,
Ceyuan Yang,
Yujun Shen,
Chunhua Shen
arXiv 2023  
Paper /
Project Page /
Code
|
|
Benchmarking and Analyzing 3D-aware Image Synthesis with a Modularized Codebase
Qiuyu Wang,
Zifan Shi,
Kecheng Zheng,
Yinghao Xu,
Sida Peng,
Yujun Shen
NeurIPS 2023 Datasets and Benchmarks Track  
Paper /
Code
|
|
LinkGAN: Linking GAN Latents to Pixels for Controllable Image Synthesis
Jiapeng Zhu*,
Ceyuan Yang*,
Yujun Shen*,
Zifan Shi,
Deli Zhao,
Qifeng Chen
ICCV 2023  
Paper /
Project Page /
Code
|
|
Learning 3D-aware Image Synthesis with Unknown Pose Distribution
Zifan Shi*,
Yujun Shen*,
Yinghao Xu,
Sida Peng,
Yiyi Liao,
Sheng Guo,
Qifeng Chen,
Dit-Yan Yeung
CVPR 2023  
Paper /
Project Page /
Code /
Demo
|
|
DiscoScene: Spatially Disentangled Generative Radiance Field for Controllable 3D-aware Scene Synthesis
Yinghao Xu,
Menglei Chai,
Zifan Shi,
Sida Peng,
Ivan Skorokhodov,
Aliaksandr Siarohin,
Ceyuan Yang,
Yujun Shen,
Hsin-Ying Lee,
Bolei Zhou,
Sergey Tulyakov
CVPR 2023 (Highlight Presentation)  
Paper /
Project Page /
Code /
Demo
|
|
3D Generative Models: A Survey
Zifan Shi*,
Sida Peng*,
Yinghao Xu*,
Andreas Geiger,
Yiyi Liao,
Yujun Shen
arXiv 2022  
Paper /
Github
|
|
Improving 3D-aware Image Synthesis with A Geometry-aware Discriminator
Zifan Shi,
Yinghao Xu,
Yujun Shen,
Deli Zhao,
Qifeng Chen,
Dit-Yan Yeung
NeurIPS 2022 (Spotlight Presentation)  
Paper /
Project Page /
Code /
Demo
|
|
3D-Aware Indoor Scene Synthesis with Depth Priors
Zifan Shi,
Yujun Shen,
Jiapeng Zhu,
Dit-Yan Yeung,
Qifeng Chen
ECCV 2022 (Oral Presentation)  
Paper /
Project Page /
Code /
Demo
|
|
Stereo Waterdrop Removal with Row-wise Dilated Attention
Zifan Shi,
Na Fan,
Dit-Yan Yeung,
Qifeng Chen
IROS 2021  
Paper /
Code
|
|
Neural Camera Simulators
Ouyang Hao *,
Zifan Shi *,
Chenyang Lei,
Ka Lung Law,
Qifeng Chen
CVPR 2021  
Paper /
Code
|
Experiences
|
Visiting Researcher, Stanford University
Host by Prof. Gordon Wetzstein
Oct 2023 - Mar 2024
|
|
Research Scientist Intern, Adobe
Host by Dr. Zhixin Shu
May 2023 - Aug 2023
|
|
Research Intern, Ant Research
Host by Dr. Yujun Shen
Jun. 2022 - Apr. 2023
|
|
Research Intern, Bytedance
Host by Dr. Yujun Shen
Sep. 2021 - May 2022
|
Selected Awards
- NeurIPS Travel Award, 2022
- Hong Kong PhD Fellowship, 2019-2023
- Dong-Liang Special Scholarship, Nanjing University, 2018
- First Prize of the National Elite Program Scholarship, 2017
- National Scholarship, 2016
|
Thank Dr. Jon Barron for sharing the source code of his personal page.
|
|