MT/QE Evaluations Project Manager

A globally leading consumer device company headquartered in Cupertino, CA is looking for the MT/QE Evaluations Project Manager to join their team.

Job Responsibilities:

Support the design, execution, and analysis of evaluation frameworks for MT (Machine Translation) and QE (Quality Estimation) Models. Ensure statistically sound evaluations, high-quality datasets, and the generation of actionable insights. Run evaluations that assess MT and QE performance and risk, connecting linguistic quality frameworks with data analysis.

Qualifications:

Demonstrable experience in NLP/ML Evaluations, or Localization Analytics. Knowledge of evaluation design & statistical analysis, including determining statistically significant sample sizes. Experience with benchmarking against human judgments, and applying MT & QE evaluation metrics. Skilled in analyzing evaluation results, ensuring findings are reliable and actionable. Proficiency with data analysis and visualization tools (e.g. Python, Tableau). Highly organized, analytical, detail-oriented, and methodical. Ability to explain technical results in a clear and understandable manner. Strong eye for patterns, anomalies, and trends across large datasets.

Type:

Contract Duration:

6 months with extension

Work Location:

Cupertino, CA or Austin, TX (hybrid) Pay rate: $51.00 - $66.00 ph (Austin, TX) $58.00 - $73.00 ph (Cupertino, CA)