Xuhua Huang

I am an Applied Research Scientist at Meta Reality Labs, specializing in Computer Vision applications in AR/VR. My current focus is on the development and industrialization of Codec Avatar.

I was a graduate student at Robotics Institute of Carnegie Mellon University, advised by Prof. Kris Kitani and Prof. Deva Ramanan. I received my Bachelor's degree from Hong Kong University of Science and Technology (First Class Honors), where I worked with Prof. Chi Keung Tang, Prof. Qifeng Chen and Prof. Yu-Wing Tai. Previously, I interned on 3D Face Reconstruction at Meta Reality Labs, on image enhancement at SenseTime and on network pruning at Tencent YouTu Lab. My interests include image / video perception, 3D vision and computational photography.

Email  /  CV  /  Google Scholar  /  Linkedin

profile photo
(* indicates equal contribution)
Lidar Panoptic Segmentation and Tracking without Bells and Whistles
Abhinav Agarwalla, Xuhua Huang, Jason Ziglar, Francesco Ferroni, Laura Leal-Taixe, James Hays, Aljosa Osep, Deva Ramanan
IROS, 2023
project page / arXiv / code

Area: Panoptic Segmentation, Lidar Segmentation and Tracking

Multiface: A Dataset for Neural Face Rendering
Cheng-hsin Wuu*, Ningyuan Zheng*, Scott Ardisson, Rohan Bali, Danielle Belko, Eric Brockmeyer, Lucas Evans, Timothy Godisart, Hyowon Ha, Xuhua Huang, Alexander Hypes, Taylor Koska, Steven Krenn, Stephen Lombardi, Xiaomin Luo, Kevyn McPhail, Laura Millerschoen, Michal Perdoch, Mark Pitts, Alexander Richard, Jason Saragih, Junko Saragih, Takaaki Shiratori, Tomas Simon, Matt Stewart, Autumn Trimble, Xinshuo Weng, David Whitewolf, Chenglei Wu, Shoou-I Yu, Yaser Sheikh
CVPR Workshop, 2023
project page / arXiv / code (600+ stars in Github)

Area: Neural Face Rendering

Ego4D: Around the World in 3,000 Hours of Egocentric Video
Ego4D Team   (authors list here)
CVPR, 2022   (Oral, Best Paper Finalist)
project page / arXiv / code

Area: Egocentric Video Analysis

A Categorized Reflection Removal Dataset with Diverse Real-world Scenes
Chenyang Lei*, Xuhua Huang*, Chenyang Qi, Yankun Zhao, Wenxiu Sun, Qiong Yan, Qifeng Chen
CVPR Workshop, 2022
project page / arXiv / code

Area: Computational Photography, Physics-based Vision

EgoAugment: CMU-KLAB Submission to EPIC-Kitchens 2021 Challenge
Xuhua Huang, Ye Yuan, Xingyu Liu, Qichen Fu, Kris M. Kitani
CVPR Workshop, 2021
report / challenge report / challenge page

Area: Egocentric Video Analysis

Fast Video Object Segmentation with Temporal Aggregation Network and Dynamic Template Matching
Xuhua Huang*, Jiarui Xu*, Yu-Wing Tai, Chi Keung Tang
CVPR, 2020
project page / arXiv

Area: Segmentation, Motion and Tracking

Polarized Reflection Removal with Perfect Alignment in the Wild
Chenyang Lei, Xuhua Huang, Mengdi Zhang, Qiong Yan, Wenxiu Sun, Qifeng Chen
CVPR, 2020
project page / arXiv / code

Area: Computational Photography, Physics-based Vision, Deep Learning

Research & Work Experiences
Meta Platforms, Inc.
Applied Research Scientist in Menlo Park, CA

Aug 2022 - Present | Team: Meta Reality Labs
May 2021 - Aug 2021 | Team: Meta Reality Labs (R&D intern)

Topic: 3D Reconstruction, AR/VR Tech

Argo AI
Research Collaborator in Pittsburgh, PA

Aug 2021 - May 2022 | Advisor: Prof. Deva Ramanan

Topic: Lidar Panoptic Segmentation, Autonomous Driving

SenseTime Group Limited
Research Intern in Hong Kong

Feb 2020 - Dec 2020 | Advisor: Dr. Qiong Yan
Mar 2019 - Nov 2019 | Advisor: Prof. Qifeng Chen

Topic: Image Auto Cropping, Reflection Removal, Low-level Vision

Palo Alto Networks
SWE Intern in Mountain View, CA

Sep 2018 - Jun 2019 | Advisor: Dr. May Wang and Ran Xia

Topic: Big Data Analytics, Cloud Development

Tencent YouTu Lab
Research Intern in Shenzhen

May 2018 - Aug 2018 | Advisor: Prof. Yu-Wing Tai

Topic: Object Detection, Network Pruning

Microsoft Corporation
SWE Intern in Hong Kong

May 2017 - Aug 2017

Topic: Artificial Intelligence, SQL Database, Azure Development

HKUST Robotics Institute
Research Assistant in Hong Kong

Dec 2016 - Sep 2017 | Advisor: Prof. Kam Tim Woo

Topic: Intelligent Car Design and Development

Professional Activities

Reviewer: The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR)
Reviewer: The International Conference on Computer Vision (ICCV)
Reviewer: The European Conference on Computer Vision (ECCV)
Reviewer: Conference on Neural Information Processing Systems (NeurIPS)
Reviewer: The IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Reviewer: The International Conference on Learning Representations (ICLR)
Reviewer: The International Conference on Machine Learning (ICML)
Reviewer: Asian Conference on Computer Vision (ACCV)
Reviewer: IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
Reviewer: The International Journal of Computer Vision (IJCV)
Reviewer: IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
Reviewer: IEEE Transactions on Image Processing (TIP)
Reviewer: IEEE Transactions on Multimedia (TMM)
Reviewer: IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
Reviewer: Signal Processing (Elsevier)
Reviewer: Neural Networks (Elsevier)
Reviewer: IEEE Signal Processing Letters
Reviewer: IEEE Transactions on Big Data
Reviewer: Science China Information Sciences
Reviewer: Frontiers of Computer Science

Carnegie Mellon University

2020-2022 M.S. in Computer Vision (GPA: 4.0/4.0)

Hong Kong University of Science and Technology

2015-2020 B.Eng. in Computer Science (First Class Honors, Dean's List)

Washington University

2018 Exchange in Computer Science (Spring)

Tsinghua University

2017 Exchange in Computer Science (Summer)

Other Projects
Neural Architecture Search with Bayesian Optimization
Tech Report, 2018
project page / report / code

Advisor: Prof. Roman Garnett

Area: Bayesian Optimization, Machine Learning

Neural Network Pruning and Object Detection Model Optimization
Tech Report, 2018
project page / code

Advisor: Prof. Yu-Wing Tai

Area: Object Detection, Network Optimization

Sokoban Game Solver with Search Algorithms and Reinforcement Learning (Q-Learning)
Tech Report, 2017
project page / report / code

Advisor: Prof. Yangqiu Song

Area: Reinforcement Learning

This guy gives a great template.