Xu Chen

I am a Research Scientist in the AR Perception group at Google. I am interested in 3D digital humans, including their animation, reconstruction and generation. I have been working on neural implicit representations and generative models to enable high-fidelity 3D human reconstruction and animation.

I received my PhD degree from the CLS program with ETH Zurich and Max Planck Institute for Intelligent Systems, where I was advised by Prof. Otmar Hilliges and co-supervised by Prof. Michael J. Black and Prof. Andreas Geiger. Prior to that, I received my master's degree in robotics from ETH Zurich, and my bachelor's degree in electrical engineering from University of Stuttgart and Wuhan University.

Email  /  GitHub  /  Google Scholar  /  LinkedIn  /  Twitter

profile photo

Publications

project image

AG3D: Learning to Generate 3D Avatars from 2D Image Collections


Zijian Dong*, Xu Chen*, Jinlong Yang, Michael Black, Otmar Hilliges, Andreas Geiger
International Conference on Computer Vision, 2023
paper / code / website /

project image

Fast-SNARF: A Fast Deformer for Articulated Neural Fields


Xu Chen*, Tianjian Jiang*, Jie Song, Max Rietmann, Andreas Geiger, Michael Black, Otmar Hilliges
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023
paper / code / website /

project image

Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decomposition


Chen Guo, Tianjian Jiang, Xu Chen, Jie Song, Otmar Hilliges
Computer Vision and Pattern Recognition (CVPR), 2023
paper / video / code / website /

project image

InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds


Tianjian Jiang*, Xu Chen*, Jie Song, Otmar Hilliges
Computer Vision and Pattern Recognition (CVPR), 2023
paper / video / code / website /

project image

PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequence


Zijian Dong*, Chen Guo*, Jie Song, Xu Chen, Andreas Geiger, Otmar Hilliges
Computer Vision and Pattern Recognition (CVPR), 2022
paper / video / website /

project image

gDNA: Towards Generative Detailed Neural Avatars


Xu Chen, Tianjian Jiang, Jie Song, Jinlong Yang, Michael Black, Andreas Geiger, Otmar Hilliges
Computer Vision and Pattern Recognition (CVPR), 2022
paper / video / code / website /

project image

IM Avatar: Implicit Morphable Head Avatars from Videos


Yufeng Zheng, Victoria Abrevaya, Marcel Buehler, Xu Chen, Michael Black, Otmar Hilliges
Computer Vision and Pattern Recognition (CVPR), 2022
paper / video / code /

project image

Human Performance Capture from Monocular Video in the Wild


Chen Guo, Xu Chen, Jie Song, Otmar Hilliges
International Conference on 3D Vision (3DV), 2021
paper / video / code /

project image

Render In-between: Motion Guided Video Synthesis for Action Interpolation


Hsuan-I Ho, Xu Chen, Jie Song, Otmar Hilliges
British Machine Vision Conference (BMVC), 2021
paper / video / code /

project image

SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapes


Xu Chen, Yufeng Zheng, Michael Black, Otmar Hilliges, Andreas Geiger
International Conference on Computer Vision (ICCV), 2021
paper / video / code / website /

project image

Shape-aware Multi-Person Pose Estimation from Multi-view Images


Zijian Dong, Jie Song, Xu Chen, Chen Guo, Otmar Hilliges
International Conference on Computer Vision (ICCV), 2021
paper / video / code /

project image

Category Level Object Pose Estimation via Neural Analysis-by-Synthesis


Xu Chen*, Zijian Dong*, Jie Song, Andreas Geiger, Otmar Hilliges
European Conference on Computer Vision (ECCV), 2020
paper / video / code /

project image

Human Body Model Fitting by Learned Gradient Descent


Jie Song*, Xu Chen*, Otmar Hilliges
European Conference on Computer Vision (ECCV), 2020
paper / video / code /

project image

Monocular Neural Image Based Rendering with Continuous View Control


Xu Chen*, Jie Song*, Otmar Hilliges
International Conference on Computer Vision (ICCV), 2019
paper / code /

project image

Unpaired Pose Guided Human Image Generation


Xu Chen, Jie Song, Otmar Hilliges
The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2019
paper / code /

project image

StreetMap - Mapping and Localization on Ground Planes using a Downward Facing Camera


Xu Chen, Anurag Vempati, Paul Beardsley
2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018
paper / video / website /





Acknowledgement: Design and source code from Jon Barron's website and Leonid Keselman's Jekyll fork