Role at a glance
- Salary
- $206.2K – $356.4K/yr
- Location
- Cupertino, California, United States
- Experience
- 5+ years of relevant industry experience 2+ years leading and managing an engineering team, with a track record of growing engineers' skill sets and creating meaningful career growth
- Education
- BS, MS, or PhD in Computer Science / Electrical Engineering or equivalent
Spotted an issue?
We’ll check it against the original posting.
Role Summary
Lead a team of engineers who evaluate the algorithms and AI models behind the Sensing and Connectivity team's location context features, and who own the quality engineering that ships them, including test automation, software testing, and continuous integration.
What You'll Do
- Own the model evaluation strategy for ML models and other algorithms, including benchmarks, evaluation protocols, and validation of...
- Set technical direction for evaluating models and turn assessments of model outputs into prioritized algorithm improvements.
- Lead the team in building automation, continuous integration, analytics, and monitoring that qualify features, measure performance and...
- Identify KPIs, build the dashboards behind them, and represent team results in reviews and to engineering and executive audiences.
- Drive bug resolution across the broader software engineering organization and with partner teams across Apple.
- Hire, coach, mentor, and grow the team's engineers.
Generated from the employer's posting. Verify important details before applying.
View full postingQualifications
Required
- BS, MS, or PhD in Computer Science / Electrical Engineering or equivalent
- 5+ years of relevant industry experience
- 2+ years leading and managing an engineering team, with a track record of growing engineers' skill sets and creating meaningful career...
- Experience evaluating AI/ML models: crafting benchmarks and evaluation protocols, and performing statistical analysis
- Proficient in designing AI-assisted workflows, using GenAI to automate and accelerate testing, debugging, and metrics analysis
Preferred
- Hands-on engineering background, with enough software development experience to set technical direction and critically evaluate the...
- Experience evaluating foundation models or LLMs, for example building eval harnesses, golden datasets, LLM-as-judge pipelines, or...
- Experience with sensor, time-series, or on-device ML models, and with the data pipelines behind them
- Experience building or leading automation, test infrastructure, and CI systems
- Experience working at the intersection of hardware and software
- Ability to work in a dynamic environment with shifting priorities and schedules, with excellent analytical, problem-solving, and...
Original job description
Content provided by the employer
Original job description
Content provided by the employer
Summary
Join the Sensing and Connectivity - Location Context team that powers critical experiences in Apple products. Our team works on providing personalized insights from users' daily patterns through multimodal sensing and AI models. This team combines advanced machine learning, including integration, adaptation, and tuning of foundation models, with contextual sensing, bolstered by innovative study design, to derive user insights for Maps and Fitness applications, Journal — among many more.
As the leader of this team, you will have the rare and rewarding opportunity to shape upcoming products that will delight and inspire our customers. You and your team will own the quality of cutting-edge location intelligence features powered by ML models across various operating systems, including iOS and watchOS. We develop science-backed designs of AI/ML models that capture the complex interplay of human health and behavior, providing valuable insights directly to our customers. We foster innovation and embrace new technology to enhance our creative capabilities. We are seeking a manager who pairs a working understanding of ML with a track record of building and growing teams that validate these models and the supporting software.
If this is you, we would be delighted to hear from you.
Description
The Sensing and Connectivity team is looking for a manager to lead a talented group of engineers who evaluate the algorithms and AI models behind our location context features, and who also own the quality engineering that ships them: test automation, software testing, and continuous integration. We work in a fast-paced environment that depends on a tight relationship between evaluation and development. You'll evaluate probabilistic, on-device models, defining what "correct" means where ground truth is scarce and real-world behavior can't be fully simulated. In this role you will:
- Own the model evaluation strategy for our ML models and other algorithms, including benchmarks, evaluation protocols, and validation of training data, features, and labels, along with the quality strategy for the end-to-end experiences they power.
- Set the technical direction for how the team evaluates these models. That means challenging design and implementation, turning assessments of model outputs into prioritized algorithm improvements, and holding the team to the same rigor in its own analysis and conclusions.
- Lead the team in building the automation, continuous integration, analytics, and monitoring that qualify features, measure performance and system memory usage, and track quality across releases.
- Identify the KPIs that define project success, build the dashboards behind them, and represent the team's results in user study, code, and data reviews as well as to engineering and executive audiences.
- Drive bug resolution across the broader software engineering organization and with partner teams across Apple, escalating and negotiating as needed to hold the quality bar.
- Work closely with development, program management, and cross-functional partners, from upstream hardware to downstream apps, to drive excellent end-to-end quality aligned with release schedules.
- Set a vision for the team's future direction, identify new opportunities, and build stakeholder buy-in to pursue them.
- Hire, coach, mentor, and grow the team, building on individual strengths and creating meaningful career growth.
Minimum Qualifications
BS, MS, or PhD in Computer Science / Electrical Engineering or equivalent
5+ years of relevant industry experience
2+ years leading and managing an engineering team, with a track record of growing engineers' skill sets and creating meaningful career growth
Experience evaluating AI/ML models: crafting benchmarks and evaluation protocols, and performing statistical analysis
Proficient in designing AI-assisted workflows, using GenAI to automate and accelerate testing, debugging, and metrics analysis
Preferred Qualifications
Hands-on engineering background, with enough software development experience to set technical direction and critically evaluate the team's work
Experience evaluating foundation models or LLMs, for example building eval harnesses, golden datasets, LLM-as-judge pipelines, or human-in-the-loop evaluation
Experience with sensor, time-series, or on-device ML models, and with the data pipelines behind them
Experience building or leading automation, test infrastructure, and CI systems
Experience working at the intersection of hardware and software
Ability to work in a dynamic environment with shifting priorities and schedules, with excellent analytical, problem-solving, and communication skills
Pay & Benefits — Cupertino, California, United States
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $206,200 and $356,400, and your base pay will depend on your skills, qualifications, experience, and location.Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
Application Deadline
Apple accepts applications to this posting on an ongoing basis.
About the company
Apple
Large Enterprise
Apple Inc. is a global technology company known for its innovative products and services, including the iPhone, iPad, Mac computers, and Apple Watch. Founded in 1976, Apple has continuously pushed the boundaries of design and functionality, earning a reputation for high-quality consumer electronics and software solutions like iOS and macOS. With a strong commitment to user experience and privacy, Apple also leads in digital services, offering platforms such as the App Store, Apple Music, and iCloud. The company's focus on sustainability and corporate responsibility further enhances its standing as a leader in the technology sector.