Zicong Fan

Zicong Fan (Alex)

Epic Games, Digital Human Research

Biography

The hand is where intention meets the physical world. Understanding how humans grasp, manipulate, and interact with objects is not just a perception problem — it is a blueprint for how intelligent systems should act. I reconstruct and synthesize these interactions to close the gap between vision and embodied intelligence.

I received my PhD from ETH Zürich, advised by Michael J. Black, Otmar Hilliges, and Marc Pollefeys. Before that, I completed my BSc (2018) and MSc (2020) in Computer Science at the University of British Columbia — working with Ian M. Mitchell on robotics, and with Leonid Sigal and Jim Little on vision and language. I have also spent wonderful time at Max Planck Institute for Intelligent Systems and Meta Reality Labs.

My research centers on hands in action: 3D hand pose estimation, human/hand-object reconstruction, and generative synthesis of interaction. I am drawn to problems where geometric structure, physical plausibility, and learning meet — and I seek methods that are both principled and practically useful. I co-organize the HANDS workshop series at ICCV/ECCV (2023–2025), a leading venue for hand perception and interaction in computer vision.

🔎
Looking for Research Interns
Research interns with publications at CVPR/ICCV/ECCV/NeurIPS and interest in human-object interaction (reconstruction, generation in 2D/3D/video/RL). Reach out.

News

Datasets

Large-scale multi-subject hand scans with MANO registrations and calibrated multiview RGB captures.
13k3D scans
263subjects
90kRGB images
3dMD scans RGB images MANO
Dexterous bimanual hand-object manipulation sequences captured with egocentric and allocentric views.
2.1Mimages
1egocentric
8exocentric
MoCap MANO SMPL-X Articulated Objects
Large-scale generated grasping motions for diverse objects across multiple dexterous hand models.
500k+objects & grasping motions
4hand models
Grasping motions Large-scale MANO

Research

MagicHOI
MagicHOI: Leveraging 3D Priors for Accurate Hand-object Reconstruction from Short Monocular Video Clips
Shibo Wang, Haonan He, Maria Parelli, Christoph Gebhardt, Zicong Fan, Jie Song. (♣ Project Lead)
ICCV 2025, Honolulu
GraspXL: Generating Grasping Motions for Diverse Objects at Scale
Hui Zhang, Sammy Christen, Zicong Fan, Otmar Hilliges, Jie Song.
ECCV 2024, Milan
Benchmarks
Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects
Zicong Fan*, Takehiko Ohkawa*, Linlin Yang*, Nie Lin, Zhishan Zhou, Shihao Zhou, Jiajun Liang, Zhong Gao, Xuanyang Zhang, Xue Zhang, Fei Li, Liu Zheng, Feng Lu, Karim Abou Zeid, Bastian Leibe, Jeongwan On, Seungryul Baek, Aditya Prakash, Saurabh Gupta, Kun He, Yoichi Sato, Otmar Hilliges, Hyung Jin Chang, Angela Yao. (* Equal Contribution)
ECCV 2024, Milan
ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulation
Hui Zhang, Sammy Christen, Zicong Fan, Luocheng Zheng, Jemin Hwangbo, Jie Song, Otmar Hilliges.
3DV 2024, Davos Spotlight Presentation
HMP
HMP: Hand Motion Priors for Pose and Shape Estimation from Video
Enes Duran, Muhammed Kocabas, Vasileios Choutas, Zicong Fan, Michael J. Black.
WACV 2024, Waikoloa
TempCLR
TempCLR: Reconstructing Hands via Time-Coherent Contrastive Learning
Andrea Ziani, Zicong Fan, Muhammed Kocabas, Sammy Christen, Otmar Hilliges. († Equal Contribution)
3DV 2022, Prague
DIGIT
Learning to Disambiguate Strongly Interacting Hands via Probabilistic Per-pixel Part Segmentation
Zicong Fan, Adrian Spurr, Muhammed Kocabas, Siyu Tang, Michael J. Black, Otmar Hilliges.
3DV 2021, Virtual Oral Presentation
HALO
A Skeleton-driven Neural Occupancy Representation for Articulated Hands
Korrawe Karunratanakul, Adrian Spurr, Zicong Fan, Otmar Hilliges, Siyu Tang.
3DV 2021, Virtual Oral Presentation

Code & Star History

Star History Chart
PALM hold arctic digit-interacting tempclr