Meta's Reality Labs (RL) is driving innovation in Augmented and Virtual Reality products. Our XR Tech organization develops machine perception technologies across Quest, Meta Glasses, and Family of Apps—spanning Avatars, AR/VR calling, AR Commerce, and more. In this role, you will research and apply computer vision and machine learning techniques for surface inputs and natural interactions, tackling challenges in hand tracking, micro-gestures, eye tracking, 3D reconstruction, and real-time image processing. You'll collaborate with researchers in Reality Labs Research (RLR) to translate discoveries into production-ready solutions that impact billions of people.

Responsibilities

Lead the productization of CVML models for Surface inputs, including Surface keyboard and Surface trackpad, from development through deployment
Design and execute large-scale experiments with vision models and datasets, defining evaluation protocols and driving research direction
Partner with cross-functional teams to ship ML models end-to-end, from prototype to production
Develop prototypes for future VR/AR/MR experiences and integrate robust solutions into products
Contribute to publications at top-tier venues such as CVPR, ICCV, ECCV, and NeurIPS
Define and scope projects for other engineers, providing technical direction and success criteria

Minimum Qualifications

Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
7+ years of industry experience in machine learning, computer vision, or related fields
Experience shipping ML models to production, including the full ML production cycle from development to deployment
Prototyping and engineering experience in at least one specialization: SLAM, State Estimation, Sensor Fusion, 3D reconstruction, object detection, segmentation and tracking, or scene understanding
Experience writing production-quality code in Python and deep learning frameworks such as PyTorch

Preferred Qualifications

Experience productizing and deploying ML models on edge devices
Publication track record at conferences such as CVPR, NIPS, ECCV, ICCV, ISMAR, ICML, or SIGGRAPH
Experience with real-time SLAM, 3D reconstruction, sensor fusion, object/body tracking, or depth estimation
PhD degree in Computer Science, Computer Vision, Machine Learning, Robotics, or related field
Experience developing CV/ML systems for edge devices (mobile phones, AR/VR headsets, custom hardware)

$184,000/year to $257,000/year + bonus + equity + benefits

Learn more about this Employer on their Career Site

AI Research Scientist - Surface Inputs AR/VR