Role at a glance
- Job function
-
Product, Strategy & Operations Program & Project Management
- Salary
- $144.6K – $263.8K/yr
- Location
- Cupertino, California, United States
- Experience
- 5+ years of program or project management experience in software development, machine learning, or a related field.
- Education
- BS/MS in Computer Science, Engineering, or a related field.
Spotted an issue?
We’ll check it against the original posting.
Role Summary
This Engineering Program Manager role leads the programs that build Siri's evaluation infrastructure, tooling, and automated evaluators. The role drives evaluation programs end to end and partners with Engineering, Quality Engineering, Design, and Product teams to define the evaluation roadmap.
What You'll Do
- Drive evaluation programs end to end, from requirements and system architecture through timelines, milestones, and risk management.
- Define the evaluation roadmap, align evaluation needs across Siri features, and scale pipelines to keep pace with model and product...
- Ensure evaluation results are reproducible, trustworthy, and actionable so teams can assess model quality and release readiness.
- Identify gaps in coverage, throughput, and turnaround time, and lead the work to close them.
- Provide timely, objective updates on program status, risks, critical issues, mitigations, plan changes, and requests for action.
- Bring teams together so the right discussions happen and the right decisions get made.
Generated from the employer's posting. Verify important details before applying.
View full postingQualifications
5+ years of program or project management experience with a BS/MS in a related field, plus strong ML evaluation and cross-functional skills.
Required
- 5+ years of program or project management experience in software development, machine learning, or a related field.
- BS/MS in Computer Science, Engineering, or a related field.
- Solid understanding of system architecture and design trade-offs, with thorough knowledge of testing, build, and release processes for...
- Experience driving and delivering critical project features that involve integration with multiple different teams.
- Familiarity with ML development workflows, including model evaluation, quality metrics, and data pipelines.
- Proven track record of leading and shipping multiple complex, cross-functional projects at the same time.
- Ability to navigate ambiguity, identify the most critical/urgent work, set priorities, and defend trade-offs.
- Excellent written and verbal communication, including concise status reports and issue summaries.
Preferred
- Experience working with voice assistant technologies.
- Experience with evaluation of large language models (LLMs) or agentic AI systems, such as benchmarks, human grading, or automated graders.
- Experience scaling evaluation or testing infrastructure, including distributed pipelines, compute planning, or tooling adoption.
Original job description
Content provided by the employer
Original job description
Content provided by the employer
Summary
Siri is becoming a truly personal, intelligent assistant. It understands your personal context, is aware of what's on your screen, and takes action in and across your apps, all with privacy at its core. Delivering these capabilities to Apple's standard of quality requires evaluation systems that are scalable, reliable, and built for the complexity of agentic AI. Evaluation signals inform every model and product decision before a Siri release ships.
As an Engineering Program Manager for Siri Evaluation, you will lead the programs that build Siri's evaluation infrastructure, tooling, and automated evaluators. If you thrive in helping drive clarity and focus across teams and helping build the foundation for the future of Siri and Apple Intelligence sounds exciting, we'd love to hear from you!
Description
You will drive evaluation programs end to end, from requirements and system architecture through timelines, milestones, and risk management. Partnering with Engineering, Quality Engineering, Design, and Product teams, you will define the evaluation roadmap, align evaluation needs across Siri features, and scale pipelines to keep pace with model and product development.
You will make sure evaluation results are reproducible, trustworthy, and actionable, so teams can assess model quality and release readiness with confidence. You will identify gaps in coverage, throughput, and turnaround time, and lead the work to close them.
Clear communication is essential. You will provide timely, objective updates on program status, risks, critical issues and mitigations, plan changes, and requests for action. You will also bring teams together so the right discussions happen and the right decisions get made.
Minimum Qualifications
5+ years of program or project management experience in software development, machine learning, or a related field.
BS/MS in Computer Science, Engineering, or a related field.
Solid understanding of system architecture and design trade-offs, with thorough knowledge of testing, build, and release processes for complex software.
Experience driving and delivering critical project features that involve integration with multiple different teams.
Familiarity with ML development workflows, including model evaluation, quality metrics, and data pipelines.
Proven track record of leading and shipping multiple complex, cross-functional projects at the same time.
Ability to navigate ambiguity, identify the most critical/urgent work, set priorities, and defend trade-offs.
Excellent written and verbal communication, including concise status reports and issue summaries.
Articulate and facilitative in meetings, demonstrating the ability to reshape messaging for each audience including at the executive level.
Experience working cross-functionally with people at all levels of seniority & leadership.
Preferred Qualifications
Experience working with voice assistant technologies.
Experience with evaluation of large language models (LLMs) or agentic AI systems, such as benchmarks, human grading, or automated graders.
Experience scaling evaluation or testing infrastructure, including distributed pipelines, compute planning, or tooling adoption.
Pay & Benefits — Cupertino, California, United States
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $144,600 and $263,800, and your base pay will depend on your skills, qualifications, experience, and location.Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
Application Deadline
Apple accepts applications to this posting on an ongoing basis.
About the company
Apple
Large Enterprise
Apple Inc. is a global technology company known for its innovative products and services, including the iPhone, iPad, Mac computers, and Apple Watch. Founded in 1976, Apple has continuously pushed the boundaries of design and functionality, earning a reputation for high-quality consumer electronics and software solutions like iOS and macOS. With a strong commitment to user experience and privacy, Apple also leads in digital services, offering platforms such as the App Store, Apple Music, and iCloud. The company's focus on sustainability and corporate responsibility further enhances its standing as a leader in the technology sector.