**Zicong Fan (Alex)** ![ ](./assets/zfan.jpg width="50%") I am a doctoral student at ETH supervised by Professor [Otmar Hilliges](https://ait.ethz.ch/people/hilliges/) and MPI Director [Michael J. Black](https://ps.is.mpg.de/~black). My main research interests lie in computer vision and machine learning. These include topics such as hand pose estimation and modelling the interaction of human-objects and human-scene. I am also interested in egocentric computer vision. Before starting my Ph.D., I finished my B.Sc. (2018) and M.Sc. (2020) in Computer Science at The University of British Columbia, Vancouver, Canada. In my bachelor, I worked with Professor [Ian M. Mitchell](https://www.cs.ubc.ca/~mitchell/) in robotics. In my Masters, I worked in vision + language problems with Professor [Leonid Sigal](https://www.cs.ubc.ca/~lsigal/) and Professor [Jim Little](https://www.cs.ubc.ca/~little/).
## News - 2024/03: HOLD is accepted for CVPR 2024! - 2024/02: I am joining Meta Reality Labs as Research Scientist Intern in Summer - 2023/04: Organizing [HANDS workshop](https://sites.google.com/view/hands2023/home) at ICCV 2023 - 2023/04: Finished one-year exchange at [Perceiving Systems](https://ps.is.mpg.de), Max Planck Institute for Intelligent Systems - 2020/08: I began my Ph.D. in Zürich at [Advanced Interactive Technologies](https://ait.ethz.ch/) and [Perceiving Systems](https://ps.is.mpg.de/) - 2020/08: I finished my masters degree at the [UBC Vision Lab](https://vision.cs.ubc.ca/), Vancouver ## Research
**GraspXL: Generating Grasping Motions for Diverse Objects at Scale**
Hui Zhang, Sammy Christen, Zicong Fan, Otmar Hilliges, Jie Song.
*ArXiv 2024.*
[[Project Page](https://eth-ait.github.io/graspxl)] [[Paper](https://arxiv.org/abs/2403.19649)] [[Video](https://youtu.be/0-dRbxmX2PI)] [[Code](https://github.com/zdchan/graspxl)] [[Bibtex](./bibs/zhang2024graspxl.html)]
**Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects**
Zicong Fan♣, Takehiko Ohkawa♣, Linlin Yang♣, Nie Lin, Zhishan Zhou, Shihao Zhou, Jiajun Liang, Zhong Gao, Xuanyang Zhang, Xue Zhang, Fei Li, Liu Zheng, Feng Lu, Karim Abou Zeid, Bastian Leibe, Jeongwan On, Seungryul Baek, Aditya Prakash, Saurabh Gupta, Kun He, Yoichi Sato, Otmar Hilliges, Hyung Jin Chang, Angela Yao. (♣ Equal Contribution)
*ArXiv 2024.*
[[Paper](https://arxiv.org/abs/2403.16428)] [[Bibtex](./bibs/fan2024benchmarks.html)]
**HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Video**
Zicong Fan, Maria Parelli, Maria Eleni Kadoglou, Muhammed Kocabas, Xu Chen, Michael J. Black, Otmar Hilliges.
*In Proceedings of Computer Vision and Pattern Recognition (CVPR), 2024, Seattle, United States.*
Accepted as Highlight (Top 11.9%)
[[Project Page](https://zc-alexfan.github.io/hold)] [[Paper](https://download.is.tue.mpg.de/hold/paper.pdf)] [[Video](https://download.is.tue.mpg.de/hold/video.mp4)] [[Code](https://github.com/zc-alexfan/hold)] [[Bibtex](./bibs/fan2024hold.html)]
**ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulation**
Hui Zhang, Sammy Christen, Zicong Fan, Luocheng Zheng, Jemin Hwangbo, Jie Song, Otmar Hilliges.
*In Proceedings of the International Conference on 3D Vision (3DV), 2024, Davos, Switzerland.*
Accepted as Spotlight Presentation
[[Project Page](https://eth-ait.github.io/artigrasp)] [[Paper](https://arxiv.org/pdf/2309.03891.pdf)] [[Video](https://youtu.be/L9KJ57y2ThI)] [[Code](https://github.com/zdchan/artigrasp)] [[Bibtex](./bibs/zhang2024artigrasp.html)]
**ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation**
Zicong Fan, Omid Taheri, Dimitrios Tzionas, Muhammed Kocabas, Manuel Kaufmann, Michael J. Black, Otmar Hilliges.
*In Proceedings of Computer Vision and Pattern Recognition (CVPR), 2023, Vancouver, Canada.*
[[Project Page](https://github.com/zc-alexfan/arctic)] [[Paper](https://download.is.tue.mpg.de/arctic/arctic_april_24.pdf)] [[Video](https://www.youtube.com/watch?v=bvMm8gfFbZ8)] [[Code](https://github.com/zc-alexfan/arctic)] [[Data](https://arctic.is.tue.mpg.de/)] [[Bibtex](./bibs/fan2023arctic.html)]
**TempCLR: Reconstructing Hands via Time-Coherent Contrastive Learning**
Andrea Ziani♣, Zicong Fan♣, Muhammed Kocabas, Sammy Christen, Otmar Hilliges. (♣ Equal Contribution)
*In Proceedings of the International Conference on 3D Vision (3DV), 2022, Prague, Czechia.*
[[Project Page](https://eth-ait.github.io/tempclr)] [[Paper](http://arxiv.org/abs/2209.00489)] [[Code](https://github.com/eth-ait/tempclr)] [[Video](https://www.youtube.com/watch?v=VSsKx8SnFio)] [[Bibtex](./bibs/ziani2022tempclr.html)]
**Learning to Disambiguate Strongly Interacting Hands via Probabilistic Per-pixel Part Segmentation**
Zicong Fan, Adrian Spurr, Muhammed Kocabas, Siyu Tang, Michael J. Black, Otmar Hilliges.
*In Proceedings of the International Conference on 3D Vision (3DV), 2021, Virtual*
Accepted as Oral Presentation
[[Project Page](https://zc-alexfan.github.io/digit)] [[Paper](https://arxiv.org/abs/2107.00434)] [[Code](https://github.com/zc-alexfan/digit-interacting)] [[Video](https://www.youtube.com/watch?v=et3QQNKigzc)] [[Bibtex](./bibs/fan2021digit.html)]
**A Skeleton-driven Neural Occupancy Representation for Articulated Hands**
Korrawe Karunratanakul, Adrian Spurr, Zicong Fan, Otmar Hilliges, Siyu Tang.
*In Proceedings of the International Conference on 3D Vision (3DV), 2021, Virtual*
Accepted as Oral Presentation
[[Paper](https://arxiv.org/abs/2109.11399)] [[Bibtex](./bibs/karunratanakul2021halo.html)]
**Learning Motion Predictors for Smart Wheelchair using Autoregressive Sparse Gaussian Process**
Zicong Fan, Lili Meng, Tian Qi Chen, Jingchun Li, Ian M Mitchell.
*In Proceedings of the International Conference on Robotics and Automation (ICRA), 2018, Brisbane, Australia*
[[Paper](https://arxiv.org/abs/1710.11319)] [[Bibtex](./bibs/fan2018motion.html)]
## Code & star history ![Star History Chart](https://api.star-history.com/svg?repos=zc-alexfan/arctic,zc-alexfan/digit-interacting,zc-alexfan/hold,eth-ait/tempclr&type=Timeline) hold arctic digit-interacting tempclr ## Education - 2020 - Present: Ph.D. in Computer Science at ETH Zürich - 2018 - 2020: M.Sc. in Computer Science at The University of British Columbia - 2016 - 2018: B.Sc. in Computer Science at The University of British Columbia - 2014 - 2016: Associate of Science in Computer Science at Langara College ## Awards - 2019: Alexander Graham Bell: Canada Graduate Scholarship-Master's, issued by NSERC Canada - 2017: Undergraduate Student Research Awards, issued by NSERC Canada - 2016: the Governor General’s Collegiate Bronze Medal, issued by the Governor General of Canada ## Service Workshop organizer - HANDS at ICCV'23, Paris Reviewing - CVPR '23, '24 - ICCV '23 - ECCV '22, '24 - SIGGRAPH ASIA '23 - 3DV '23, '24 - RA-L '23 - ACCV '24