Find Jobs
Find Jobs Near You – Available Work in Your Location
Skip to job details
A
Apple
AIML - Machine Learning Manager, Red Teaming - Responsible AI and Safety
Career Insights for Safety Manager (General)
See where this job fits in the broader career landscape. Knowing your career path helps you see what's possible from here.
Scorecard
Based on California data
Review key factors to help you decide if this role fits your goals. How is this calculated?
What they do
A Safety Manager inspects work environments and procedures for health and safety concerns, and develops programs to reduce the risk of injury or illness. May specialize in a particular type of industry or in certain kind of safety and health risk, such as radiation, hazardous chemicals, or ergonomics. Works in offices, factories, or mines.
$96,309 / year median in California
+10% projected growth
Job Description
Apple's Responsible AI and Safety team focuses on innovative technologies, methodologies, and research to enable fantastic user experiences and to push the frontier of machine learning. Our team is looking to hire a leader with a strong track record in Applied Research, who is passionate about ML and foundation models with a focus on responsibility, fairness, and safety. In this role, you will lead the research and application of ML methods for technologies that power breakthrough user experiences while upholding Apple's values, privacy, and quality standards.
DescriptionThis role focuses on leading a team working on developing, carrying-out, interpreting, and communicating pre- and post-ship evaluations of the safety of Apple Intelligence features. This team is also responsible for producing safety evaluations that uphold Apple's Responsible AI values requires thoughtful data sampling, creation, and curation for evaluation datasets; high quality, detailed annotations and careful auto-grading to assess feature performance; and mindful analysis to understand what the evaluation means for the user experience.
Provide technical direction and expertise to team-wide initiatives in safety auto-grading.
Use and implement data pipelines, and collaborate cross-functionally to execute end-to-end safety evaluations.
Work with highly-sensitive content with exposure to offensive and controversial content.
Preferred QualificationsPublication record in relevant conferences (e.g., NeurIPS, ICML, ICLR, EMNLP, etc.)Experience working on Responsible AI and AI SafetyStrong organizational and operational skills working with large, multi-functional, and diverse teams.
Curiosity about fairness and bias in generative AI systems, and a strong desire to help make the technology more equitable.
Minimum QualificationsMS, or PhD in Computer Science, Machine Learning, Statistics, or related fields; or an equivalent qualification acquired through other avenues.
Experience working with generative models for evaluation and/or product development, and up-to-date knowledge of common challenges and failures.
Strong engineering skills and experience in writing production-quality code in Python.
Deep experience in foundation model-based AI programming (i.e.: using DSPy for optimizing foundation model prompts, for example) and a drive to innovate in this space.
Experience working with noisy, crowd-based data labels and human evaluations.
Pay & BenefitsThis posting is not for a specific job opening and by submitting your resume you are expressing interest in being contacted about this type of role at Apple in the future.
DescriptionThis role focuses on leading a team working on developing, carrying-out, interpreting, and communicating pre- and post-ship evaluations of the safety of Apple Intelligence features. This team is also responsible for producing safety evaluations that uphold Apple's Responsible AI values requires thoughtful data sampling, creation, and curation for evaluation datasets; high quality, detailed annotations and careful auto-grading to assess feature performance; and mindful analysis to understand what the evaluation means for the user experience.
Responsibilities:
Proven technical leadership with 5+ years of team management or leadership experienceDemonstrated expertise in ML production deployment lifecycle, datasets, identifying data needs, and working on creative solutions, scaling and expanding data coverage through human and synthetic generation methods.Provide technical direction and expertise to team-wide initiatives in safety auto-grading.
Use and implement data pipelines, and collaborate cross-functionally to execute end-to-end safety evaluations.
Work with highly-sensitive content with exposure to offensive and controversial content.
Preferred QualificationsPublication record in relevant conferences (e.g., NeurIPS, ICML, ICLR, EMNLP, etc.)Experience working on Responsible AI and AI SafetyStrong organizational and operational skills working with large, multi-functional, and diverse teams.
Curiosity about fairness and bias in generative AI systems, and a strong desire to help make the technology more equitable.
Minimum QualificationsMS, or PhD in Computer Science, Machine Learning, Statistics, or related fields; or an equivalent qualification acquired through other avenues.
Experience working with generative models for evaluation and/or product development, and up-to-date knowledge of common challenges and failures.
Strong engineering skills and experience in writing production-quality code in Python.
Deep experience in foundation model-based AI programming (i.e.: using DSPy for optimizing foundation model prompts, for example) and a drive to innovate in this space.
Experience working with noisy, crowd-based data labels and human evaluations.
Pay & BenefitsThis posting is not for a specific job opening and by submitting your resume you are expressing interest in being contacted about this type of role at Apple in the future.