Role at a glance
- Salary
- $165.6K – $296.4K/yr
- Location
- Redmond, Washington, United States
- Work arrangement
- On-site
- Employment
- Contract
- Education
- Bachelor's, Master's
Spotted an issue?
We’ll check it against the original posting.
Role Summary
The Principal Architect will lead architecture strategy for systems efficiency and cost-of-goods-sold improvements across the Copilot Tuning and Frontier Tuning stack. The role spans AI model and platform systems, including training, inference, serving, orchestration, evaluation, data pipelines, and infrastructure utilization, with the goal of delivering measurable efficiency gains at frontier AI scale.
What You'll Do
- Define and drive end-to-end architecture strategy for improving systems efficiency and reducing COGS.
- Lead cross-stack architectural investments across model training, post-training, inference, serving, orchestration, data movement,...
- Identify architectural simplifications, reusable platform capabilities, and systems optimizations that improve scalability, reliability,...
- Partner with research, engineering, product, finance, capacity, and infrastructure teams to make quantitative tradeoffs across cost,...
- Establish metrics, mechanisms, and governance for measuring efficiency gains, COGS impact, platform leverage, and operational...
- Drive technical direction across multiple teams and organizations, aligning stakeholders around architectural investments.
Generated from the employer's posting. Verify important details before applying.
View full postingQualifications
Bachelor's degree in Computer Science or a related technical field and technical engineering experience with coding in C, C++, C#, Java, JavaScript, or Python. Preferred qualifications include cloud-scale systems, AI/ML systems, large language models, distributed systems, infrastructure efficiency, and architectural leadership experience.
Required
- Bachelor's Degree in Computer Science or related technical field
- 8+ years technical engineering experience
- Coding in C, C++, C#, Java, JavaScript, or Python
- Ability to meet Microsoft, customer and/or government security screening requirements
- Microsoft Cloud Background Check
Preferred
- Master's Degree in Computer Science or related technical field
- 12+ years technical engineering experience with coding
- 15+ years technical engineering experience with coding with a bachelor's degree
- Experience designing, building, or operating cloud-scale systems
- Experience with AI/ML systems, large-scale data systems, model serving, inference platforms, training infrastructure, or distributed...
- Experience optimizing cost, latency, throughput, reliability, and infrastructure utilization
- Experience with large language models, generative AI, model training, post-training, fine-tuning, reinforcement learning, inference...
- Experience with GPU/accelerator-based systems, capacity planning, distributed training, high-throughput inference, or AI infrastructure...
Original job description
Content provided by the employer
Original job description
Content provided by the employer
Copilot Tuning is a new AI product that adapts based on tenant data, enabling customer-specific agents and solutions. We are a small, nimble team advancing the state of the art of models in M365 Copilot and helping transform the large language model experience in the enterprise.
The mission of the Copilot Tuning team is to ensure that AI can be easily adapted and tuned to enable critical, high-value applications, including entirely new productivity tools. Our work leverages novel training and post-training algorithms, AI architecture, agentic innovations, customer-specific data, and domain expert feedback to enable end-to-end fine-tuning and adaptation within the M365 Copilot platform.
We are seeking a Principal Architect to lead architecture strategy for systems efficiency and cost-of-goods-sold improvements across the Copilot Tuning and Frontier Tuning stack. This role will drive platform-wide efficiency across training, post-training, inference, serving, orchestration, evaluation, data pipelines, and infrastructure utilization. The ideal candidate is a deep systems thinker who can connect model architecture, platform design, infrastructure, product requirements, and business outcomes to deliver measurable efficiency gains at frontier AI scale.
This position is a part-time role - 3 days week, and based in Redmond, Washington and requires the employee be in the office a minimum of 3 days per week.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
Define and drive the end-to-end architecture strategy for improving systems efficiency and reducing COGS across Copilot Tuning and Frontier Tuning.
Lead cross-stack architectural investments spanning model training, post-training, inference, serving, orchestration, data movement, evaluation, capacity planning, and infrastructure utilization.
Identify architectural simplifications, reusable platform capabilities, and systems optimizations that improve scalability, reliability, performance, and cost efficiency.
Partner with research, engineering, product, finance, capacity, and infrastructure teams to make quantitative tradeoffs across cost, latency, quality, reliability, and customer impact.
Establish metrics, mechanisms, and governance for measuring efficiency gains, COGS impact, platform leverage, and operational sustainability.
Drive technical direction across multiple teams and organizations, influencing roadmap decisions and aligning stakeholders around durable architectural investments.
Translate ambiguous business and technical goals into clear architecture plans, execution milestones, and measurable outcomes.
Document and share architecture patterns, best practices, and efficiency mechanisms across the organization.
Mentor and grow senior technical talent; model technical excellence, inclusive collaboration, and high standards for system design.
Embody Microsoft’s culture and values.
Qualifications
Required Qualifications:
- Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications:
- Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR Bachelor's Degree in Computer Science or related technical field AND 15+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Experience designing, building, or operating cloud-scale systems with measurable impact on performance, reliability, scalability, or cost efficiency.
- Experience with AI/ML systems, large-scale data systems, model serving, inference platforms, training infrastructure, or distributed compute systems.
- Deep experience optimizing cost, latency, throughput, reliability, and infrastructure utilization in production systems.
- Experience with large language models, generative AI, model training, post-training, fine-tuning, reinforcement learning, inference optimization, or model serving.
- Experience with GPU/accelerator-based systems, capacity planning, distributed training, high-throughput inference, or AI infrastructure efficiency.
- Experience building platform capabilities that reduce operational burden and enable many teams or customers to scale efficiently.
- Demonstrated ability to reason quantitatively about architectural tradeoffs, including COGS, quality, performance, reliability, and customer value.
- Proven ability to influence senior technical leaders and align organizations around long-term architecture strategy.
- Experience working at the intersection of research, product, engineering, and infrastructure teams.
- Written and verbal communication skills, with the ability to explain complex architecture decisions to technical and non-technical stakeholders.
Software Engineering IC6 - The typical base pay range for this role across the U.S. is USD $165,600 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
About the company
Microsoft
Large Enterprise
Microsoft is a global technology leader that empowers individuals and organizations to achieve more through innovative software, services, and devices. Founded in 1975, the company is best known for its flagship products like the Windows operating system and Microsoft Office suite. In addition to personal computing, Microsoft is a leader in cloud computing with its Azure platform, providing a range of solutions for businesses to enhance productivity and efficiency. With a strong commitment to sustainability and accessibility, Microsoft continues to drive technological advancements that shape the future of work and learning.
Microsoft is a global technology leader that empowers individuals and organizations to achieve more through innovative software, services, and devices. Founded in 1975, the company is best known for its flagship products like the Windows operating system and Microsoft Office suite. In addition to personal computing, Microsoft is a leader in cloud computing with its Azure platform, providing a range of solutions for businesses to enhance productivity and efficiency. With a strong commitment to sustainability and accessibility, Microsoft continues to drive technological advancements that shape the future of work and learning.