Skip to main content
Tallo logoTallo logo

Find Jobs

Find Jobs Near You – Available Work in Your Location

Rainbow bridge illustration

Find your next move.

Your current job is just the starting point. See where workers like you actually went next.

Powered by real career transition data in the U.S. labor market over the past 20 years. How it works

Requires a free account

Skip to job details

Back to Results

Apply for this opportunity

To apply for this job, you'll continue to an external website or email application.

Meta

Product Content Engineer

Job Description

Product Content Engineering is a horizontal function supporting initiatives across Meta. We partner closely with product and technical teams to solve problems by providing model-centered solutions, setting standards of quality, and building the frameworks that ensure AI-powered experiences actually work for people. We're looking for a Content Engineer who will partner with Meta's agent tooling team to define model quality standards and target behaviors for Meta's internal AI assistant - an automated tool driving employee productivity across internal systems, data, and workflows. You'll work at the intersection of evaluation: building the frameworks, rubrics, and pipelines that hold AI outputs to a high standard. You'll assess model behavior and hardness, identify where it falls short, and work cross-functionally with engineering, product, research, and data science teams to make it better. If you're energized by building better AI experiences through rigorous evaluation, thrive in ambiguity, and bring strong editorial and analytical judgment, we encourage you to apply.
Qualifications:
Bachelor's degree in Computer Science, Data Science, Linguistics, or a related field, or equivalent practical experience 5+ years of experience working collaboratively with product, engineering, design, and user research teams 2+ years working with generative AI products, AI evaluation, prompt engineering, annotation, and/or labeling and analysis Experience designing and implementing evaluation frameworks, annotation guidelines, or quality rubrics for agentic systems Demonstrated data analysis skills, with experience exploring data, identifying patterns, and producing actionable insights Experience applying critical thinking to lead data-driven analyses that inform product or user experience decisions, and communicating findings to executive leadership Proven track record of cross-functional collaboration and delivering results in environments with evolving requirements and competing priorities Experience establishing ground truth for text-based agentic workflows (e.g., multi-step reasoning, tool use, end-to-end task completion), including the annotation guidelines and quality rubrics that make evaluations repeatable Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews) Familiarity with AI evaluation methods such as human eval, model-as-judge, A/B testing, or red-teaming Experience building dashboards, scripts, or workflows that codify evaluation metrics Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies Experience with Python, SQL, or other tools for data analysis and evaluation automation Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
Review key factors to help you decide if the role fits your goals.
Pay Growth
?
out of 5
Not enough data
Not enough info to score pay or growth
Job Security
?
out of 5
Not enough data
Calculating job security score...
Total Score
100
out of 100
Average of individual scores