Job Title

Summary: Product Content Engineering is a horizontal function supporting initiatives across Meta's Family of Apps. We partner closely with product and technical teams to solve problems by providing content-centered solutions, setting standards of quality, and building the frameworks that ensure AI-powered experiences actually work for people.We're looking for a people manager to lead a team within PCE's AI Content Understanding group. This team is responsible for executing evaluations and improving the quality of Meta's content understanding models u2014 the AI systems that understand what content is about and how it should be ranked, recommended, and moderated. The work spans content quality, AI evaluation, and the search and recommendation systems that power Meta's products u2014 building the frameworks, rubrics, and pipelines that hold AI outputs to a high standard. Your team assesses model behavior, identifies where it falls short, and works cross-functionally with engineering, product, research, and data science teams to make it better. Reporting to the AI CU lead, you'll manage a team of Content Engineers and contingent workers, owning the day-to-day execution of human evaluations, golden dataset creation, auto-eval calibration, and cross-functional delivery with engineering, data science, and product partners. You'll drive operational rigor while navigating a fast-moving environment where evaluation frameworks, model capabilities, and team processes are evolving simultaneously. Required Skills: Manager, Content Engineering u2014 AI Content Understanding Responsibilities: 1. Manage and develop a team of Content Engineers and contingent workers, setting clear goals, providing regular feedback, and supporting career growth 2. Own the execution of continuous CU model evaluations u2014 coordinating sprint planning, reviewer assignments, QA processes, and delivery timelines across multiple concurrent workstreams 3. Drive the creation and maintenance of golden datasets that serve as ground truth for model benchmarking and auto-eval calibration 4. Partner with engineering, data science, and product teams to translate evaluation insights into actionable recommendations for model improvement and prompt optimization 5. Lead the team's contribution to LLM-as-a-Judge (auto-eval) initiatives u2014 ensuring human evaluation data is used to calibrate, validate, and improve automated evaluation systems 6. Define and maintain evaluation guidelines, rubrics, and quality standards in partnership with Lead Content Engineers, ensuring consistency across reviewers and use cases 7. Build repeatable operational processes for evaluation sprints, including reviewer training, calibration sessions, and escalation workflows 8. Manage CW workforce planning u2014 hiring, onboarding, allocation across workstreams, and performance management 9. Synthesize evaluation results into structured reports and present findings to cross-functional leadership, including engineering leads and lead product stakeholders 10. Identify and mitigate operational risks u2014 staffing gaps, timeline conflicts, quality regressions u2014 before they impact delivery 11. If you have a proven experience of proactively identifying, scoping and implementing innovative solutions, demonstrated success in identifying issues and improving processes, to create impact and bring demonstrated experience in content judgment to AI evaluation, we encourage you to apply Minimum Qualifications: Minimum Qualifications: 12. 8+ years of experience in content strategy, content operations, AI evaluation, or a related field 13. 2+ years of people management experience, including hiring, developing, and performance-managing direct reports 14. Experience managing cross-functional programs with engineering, data science, and product partners in fast-paced environments 15. 1+ years working with generative AI products, AI evaluation, prompt engineering, annotation, and/or content labeling and analysis 16. Experience designing or operationalizing evaluation frameworks, annotation guidelines, or quality rubrics for AI/ML systems 17. Demonstrated ability to manage multiple concurrent workstreams with competing priorities and tight deadlines 18. Proven analytical skills with experience interpreting evaluation data and communicating findings to technical and non-technical audiences 19. Track record of building team operational processes and quality standards from the ground up or during periods of significant change Preferred Qualifications: Preferred Qualifications: 20. Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements) 21. Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews) 22. Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies 23. Familiarity with AI evaluation methods such as human eval, LLM-as-judge, model benchmarking, A/B testing, or red-teaming 24. Experience with Python, SQL, or other tools for data analysis and evaluation automation 25. Background in content understanding, search quality, recommendation systems, or trust and safety 26. Experience managing through organizational transitions, including shifts from manual to automated workflows Public Compensation: $162,000/year to $227,000/year + bonus + equity + benefits Industry: Internet Equal Opportunity: Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment. Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at .