Xuhua Huang

I am an Applied Research Scientist at Meta Reality Labs, where I focus on Computer Vision application in AR/VR.

I was a graduate student at Robotics Institute of Carnegie Mellon University, supervised by Prof. Kris Kitani and Prof. Deva Ramanan. I received my Bachelor's degree from Hong Kong University of Science and Technology (First Class Honors), where I worked with Prof. Chi Keung Tang, Prof. Qifeng Chen and Prof. Yu-Wing Tai. Previously, I interned on 3D Face Reconstruction at Meta Reality Labs, on image enhancement at SenseTime and on network pruning at Tencent YouTu Lab. My interests include image / video perception, 3D vision and computational photography.

Email  /  CV  /  Google Scholar  /  Linkedin

profile photo
(* indicates equal contribution)
Ego4D: Around the World in 3,000 Hours of Egocentric Video
Ego4D Team   (authors list here)
CVPR, 2022   (Oral, Best Paper Finalist)
project page / arXiv / code

Area: Egocentric Video Analysis

A Categorized Reflection Removal Dataset with Diverse Real-world Scenes
Chenyang Lei*, Xuhua Huang*, Chenyang Qi, Yankun Zhao, Wenxiu Sun, Qiong Yan, Qifeng Chen
CVPR Workshop, 2022
project page / arXiv / code

Area: Computational Photography, Physics-based Vision

EgoAugment: CMU-KLAB Submission to EPIC-Kitchens 2021 Challenge
Xuhua Huang, Ye Yuan, Xingyu Liu, Qichen Fu, Kris M. Kitani
CVPR Workshop, 2021
report / challenge report / challenge page

Area: Egocentric Video Analysis

Fast Video Object Segmentation with Temporal Aggregation Network and Dynamic Template Matching
Xuhua Huang*, Jiarui Xu*, Yu-Wing Tai, Chi Keung Tang
CVPR, 2020
project page / arXiv

Area: Segmentation, Motion and Tracking

Polarized Reflection Removal with Perfect Alignment in the Wild
Chenyang Lei, Xuhua Huang, Mengdi Zhang, Qiong Yan, Wenxiu Sun, Qifeng Chen
CVPR, 2020
project page / arXiv / code

Area: Computational Photography, Physics-based Vision, Deep Learning

Research & Work Experiences
Meta Platforms, Inc.
Applied Research Scientist in Menlo Park, CA

Aug 2022 - Present | Team: Meta Reality Labs
May 2021 - Aug 2021 | Team: Meta Reality Labs (R&D intern)

Topic: 3D Reconstruction, AR/VR Tech

Argo AI
Research Collaborator in Pittsburgh, PA

Aug 2021 - May 2022 | Advisor: Prof. Deva Ramanan   (A paper is in submission)

Topic: Lidar Panoptic Segmentation, Autonomous Driving

SenseTime Group Limited
Research Intern in Hong Kong

Feb 2020 - Dec 2020 | Advisor: Dr. Qiong Yan
Mar 2019 - Nov 2019 | Advisor: Prof. Qifeng Chen

Topic: Image Auto Cropping, Reflection Removal, Low-level Vision

Palo Alto Networks
SWE Intern in Mountain View, CA

Sep 2018 - Jun 2019 | Advisor: Dr. May Wang and Ran Xia

Topic: Big Data Analytics, Cloud Development

Tencent YouTu Lab
Research Intern in Shenzhen

May 2018 - Aug 2018 | Advisor: Prof. Yu-Wing Tai

Topic: Object Detection, Network Pruning

Microsoft Corporation
SWE Intern in Hong Kong

May 2017 - Aug 2017

Topic: Artificial Intelligence, SQL Database, Azure Development

HKUST Robotics Institute
Research Assistant in Hong Kong

Dec 2016 - Sep 2017 | Advisor: Prof. Kam Tim Woo

Topic: Intelligent Car Design and Development

Professional Activities

Reviewer: The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR)
Reviewer: The International Conference on Computer Vision (ICCV)
Reviewer: The European Conference on Computer Vision (ECCV)
Reviewer: The IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Reviewer: IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
Reviewer: IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
Reviewer: IEEE Transactions on Image Processing (TIP)
Reviewer: IEEE Transactions on Multimedia (TMM)
Reviewer: IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
Reviewer: Signal Processing (Elsevier)
Reviewer: Neural Networks (Elsevier)
Reviewer: IEEE Signal Processing Letters
Reviewer: IEEE Transactions on Big Data

Carnegie Mellon University

2020-2022 M.S. in Computer Vision (GPA: 4.0/4.0)

Hong Kong University of Science and Technology

2015-2020 B.Eng. in Computer Science (First Class Honors, Dean's List)

Washington University

2018 Exchange in Computer Science (Spring)

Tsinghua University

2017 Exchange in Computer Science (Summer)

Other Projects
Neural Architecture Search with Bayesian Optimization
Tech Report, 2018
project page / report / code

Advisor: Prof. Roman Garnett

Area: Bayesian Optimization, Machine Learning

Neural Network Pruning and Object Detection Model Optimization
Tech Report, 2018
project page / code

Advisor: Prof. Yu-Wing Tai

Area: Object Detection, Network Optimization

Sokoban Game Solver with Search Algorithms and Reinforcement Learning (Q-Learning)
Tech Report, 2017
project page / report / code

Advisor: Prof. Yangqiu Song

Area: Reinforcement Learning

This guy gives a great template.