The Product Data Operations team plays a critical role in product development at Meta. The team provides data and insights that power machine learning and AI at the core of all Meta products. The team partners closely with product and provides the human operational rigor required to develop some of the most advanced technology at Meta. As a Program Manager on the PDO team, you are responsible for managing data labeling and annotation programs end-to-end. You will also be responsible for driving data labeling automation via LLMs, and implementing a human-driven eval process to monitor LLM quality. Additionally, you are responsible for proactively surfacing insights and providing recommendations for product improvement, and actively engaging with colleagues and partners to enhance operational processes across the organization. You will be required to showcase demonstrated leadership, project management, problem solving, and communication skills to both internal and external colleagues at scale.

Responsibilities

Manage multiple data labeling and LLM eval projects end-to-end
Own project success metrics and timelines, including management of data quality
Directly manage the workflows and metrics of vendor and contractor teams responsible for data labeling and LLM evaluation
Work cross-functionally to build datasets that support Product and Engineering, while collecting and analyzing results
Help establish team goals and work with multiple stakeholders on strategies for executing, measuring progress, and reporting results
Engage in strategic discussions to identify problems while measuring and improving the quality of workflows
Identify opportunities to improve tooling and implement scalable solutions

Minimum Qualifications

Currently has, or is in the process of obtaining a Bachelor's degree in a directly related field, or equivalent practical experience. Degree must be completed prior to joining Meta
3+ years of industry experience in a consumer-oriented product environment, consulting, or operations role
Experience working independently and a track record of taking initiative
Communication, presentation, and project management reporting experience
Experience analyzing and solving problems
Experience with Excel or Google Sheets

Preferred Qualifications

Understanding of Facebook and Instagram products
Experience working with data sets
Experience with LLMs and evaluation techniques
Experience with SQL
Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies

$99,000/year to $144,000/year + bonus + equity + benefits

Learn more about this Employer on their Career Site

Product Data Operations Program Manager