Reality Labs Product Data Operations Program Manager - AI Data and Evaluation
Pay: Not specified
Posted: 2 weeks ago
Location: Redmond, WA (Onsite)
Last Updated: 2 days ago
Hours: Full-Time
Expires: 12/12/2026
Job Description
Meta is seeking a Reality Labs Product Data Operations Program Manager to drive human data annotation, AI-assisted quality, and model and data evaluation across Reality Labs, where capabilities like hand tracking, gesture recognition, and generative AI experiences depend on models trained and evaluated on high-quality human data. Our scope spans the full lifecycle of the data: designing the tasks that produce it, deploying AI and automation to scale how it is labeled and checked, and building the evaluation practices that decide whether the data and model outputs meet the bar. If you are energized by AI-driven workflows and measurement rigor, this role is for you. You will take ownership of an established set of operational tools and extend them as programs grow. You should be excited and comfortable using AI coding tools and owning the results.
Qualifications:
Currently has, or is in the process of obtaining a Bachelor's degree in a directly related field, or equivalent practical experience. Degree must be completed prior to joining Meta Bachelor's degree in a directly related field, or equivalent practical experience 4+ years of experience in program management, operations, or technical operations within an AI, ML, research, or data-driven organization Analytical experience using data to identify trends, diagnose operational issues, and influence program direction Experience building or deploying automation or AI solutions in production workflows Experience in communicating and influencing multiple cross-functional stakeholders and leadership Experience solving problems and breaking down ambiguous issues into component parts to develop solutions Familiarity with AI/ML concepts, applications, and industry trends sufficient to engage with technical teams and inform operational decisions Experience in AR/VR, wearables, or consumer electronics, or with perception data such as hand, body, or eye tracking Experience running human data annotation programs at scale, including task design, rater guidelines, and quality measures for tasks with no gold standard Experience using AI coding agents to build or maintain operational tooling, reports, or workflows Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements) Experience owning program budgets, cost forecasting, or per-unit cost tracking Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews) Experience designing evaluations for generative AI systems, including rubrics, human preference studies, or LLM-as-judge methods Working familiarity with how computer vision and machine learning models are trained and evaluated, including benchmark datasets, ground truth, accuracy, and agreement measurement, and a high-level understanding of model limitations Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies Experience in writing SQL to analyze large datasets
Benefits
Dental Insurance
Review key factors to help you decide if the role fits your goals.