Role at a glance
- Job function
-
AI & Data Machine Learning Engineering
- Salary
- Not Disclosed
- Location
- Cupertino, California, United States
- Experience
- 5+ years of hands on ML engineering experiences, with at least 1+ years working directly on large language models or generative AI.
- Education
- Bachelor’s, Master’s, or PhD in Computer Science, Machine Learning, or a related technical field — or equivalent practical experience.
Spotted an issue?
We’ll check it against the original posting.
Role Summary
This Machine Learning Engineer role focuses on evaluating foundation models that power Apple Intelligence features. The work supports model-shipping decisions and collaborates with machine learning researchers to improve model performance and evaluation methods.
What You'll Do
- Ensure the stability, reliability, and performance of the foundation model evaluation system.
- Design and implement evaluation methodologies.
- Develop tooling for metrics generation, ingestion, and reporting.
- Use agentic LLM systems to facilitate and improve model evaluations.
Generated from the employer's posting. Verify important details before applying.
View full postingQualifications
5+ years of hands-on ML engineering experience, including at least 1+ years working directly on large language models or generative AI. Requires a Bachelor’s, Master’s, or PhD in Computer Science, Machine Learning, or a related technical field, or equivalent practical experience. Strong software engineering fundamentals in debugging, testing, code reviews, and production reliability and scalability. Hands-on experience with LLM training and/or evaluation workflows, including pre-training, post-training, online or offline evaluation, automated evaluation, or human evaluation.
Required
- Hands-on experience evaluating large language models at scale or designing large language model benchmarks.
- Strong communication skills; able to clearly and concisely convey important information.
- Self-motivated and curious, with a drive to continually learn on the job.
- Creative and critical thinking, a drive to improve how things work, tolerance for ambiguity, and ability to identify important problems...
Preferred
- Hands-on experience evaluating large language models at scale or designing large language model benchmarks.
- Strong communication skills; able to clearly and concisely convey important information.
- Self-motivated and curious, with a drive to continually learn on the job.
- Creative and critical thinking, a drive to improve how things work, tolerance for ambiguity, and ability to identify important problems...
Original job description
Content provided by the employer
Original job description
Content provided by the employer
Summary
We are looking for talented machine learning engineers who are excited to tackle some of the most meaningful and technically challenging problems in building and deploying foundation model–based products for our customers.
As a Machine Learning Engineer focused on foundation model evaluation, you will play a critical role in assessing the capabilities of the models that power Apple Intelligence features.
You will work closely with machine learning researchers to translate evaluation insights into actionable improvements that advance future model performance.
Description
As a foundation model evaluation Machine Learning Engineer, you will be entrusted with ensuring that foundation model performance can be measured quickly and reliably, in order to support crucial model shipping decisions.
You will design, implement, and maintain crucial evaluation infrastructure.
You will collaborate extensively with ML researchers on both model hillclimbing and developing novel methodologies for measuring model performance.
Your responsibilities will span a number of high-impact parts of the Apple product and foundation model lifecycle.
Responsibilities
Ensure the stability, reliability, and performance of Apple's foundation model evaluation system.
Design and implement novel evaluation methodologies.
Help design and implement tooling to simplify metrics generation, ingestion, and reporting.
Leverage agentic LLM systems to facilitate and improve model evaluations.
Minimum Qualifications
5+ years of hands on ML engineering experiences, with at least 1+ years working directly on large language models or generative AI.
Bachelor’s, Master’s, or PhD in Computer Science, Machine Learning, or a related technical field — or equivalent practical experience.
Strong software engineering fundamentals: debugging, testing, code reviews, and production reliability / scalability.
Hands-on experience with LLM training and / or evaluation workflows, including any of the following: pre-training, post-training, online evaluation, offline evaluation, automated evaluation, human evaluation.
Preferred Qualifications
Hands on experience with evaluating large language models at scale or designing large language model benchmarks.
Strong communication skills, able to clearly and concisely convey important information.
Self-motivated and curious. Strive to continually learn on the job.
High level of creative and critical thinking skills with an innate drive to improve how things work. Have a high tolerance for ambiguity and the ability to identify the most important problems to solve.
Pay & Benefits — Cupertino, California, United States
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $150,400 and $277,600, and your base pay will depend on your skills, qualifications, experience, and location.Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
Application Deadline
Apple accepts applications to this posting on an ongoing basis.
About the company
Apple
Large Enterprise
Apple Inc. is a global technology company known for its innovative products and services, including the iPhone, iPad, Mac computers, and Apple Watch. Founded in 1976, Apple has continuously pushed the boundaries of design and functionality, earning a reputation for high-quality consumer electronics and software solutions like iOS and macOS. With a strong commitment to user experience and privacy, Apple also leads in digital services, offering platforms such as the App Store, Apple Music, and iCloud. The company's focus on sustainability and corporate responsibility further enhances its standing as a leader in the technology sector.