Role at a glance
- Job function
-
AI & Data MLOps & ML Infrastructure
- Salary
- $160.2K – $261K/yr
- Location
- Redmond, Washington, United States
- Work arrangement
- On-site
- Employment
- Full-time
- Experience
- Senior Level
Spotted an issue?
We’ll check it against the original posting.
Role Summary
Design, build, and operate services that route and prioritize AI requests and match them with available computing capacity. The role includes owning platform design, coordinating with partner teams, and supporting service reliability in production.
What You'll Do
- Design platform components for routing AI traffic and managing computing capacity, balancing speed, reliability, scale, and cost.
- Write secure, tested code and provide code reviews.
- Plan and deliver work in milestones, using feature flags and gradual rollouts to test changes and support rollbacks.
- Participate in the on-call rotation and improve monitoring, dashboards, troubleshooting guidance, and incident prevention.
- Work with product managers and partner teams to turn customer needs into technical requirements and deliver new AI models and capabilities.
- Build security, privacy, and compliance into development and deployment, automate testing and releases, and use AI tools across the...
Generated from the employer's posting. Verify important details before applying.
View full postingQualifications
Bachelor's Degree in Computer Science or a related technical field and 4+ years of technical engineering experience building distributed systems with coding in languages including C#, Java, or Go, or equivalent experience.
Preferred
- Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience building distributed...
- 3+ years of experience running distributed services on public cloud platforms such as Microsoft Azure, Amazon Web Services (AWS), or...
- 2+ years of experience with systems that route or schedule traffic, or that allocate computing resources.
- Experience with Python, Docker, and Kubernetes.
- Experience with AI or machine learning (ML) infrastructure, such as serving models in production or managing GPU fleets.
- Experience delivering projects with partner teams, from design through launch and operation.
- Experience being on call for highly available services and improving monitoring to reduce incidents.
Original job description
Content provided by the employer
Original job description
Content provided by the employer
Responsibilities
- Design - Own the design of key parts of our platform for routing AI traffic and managing computing capacity. Write design proposals, compare options, and make sure designs meet goals for speed, reliability, scale, and cost.
- Coding - Write clear, secure, well-tested code and set a good example for the team. Give thoughtful, timely code reviews that help others grow.
- Implement - Break work into clear, dependable milestones with program managers. Use feature flags and gradual rollouts to test changes safely, measure their impact, and roll back quickly when needed.
- Reliability and Supportability - Take part in the on-call rotation as a designated responsible individual (DRI). Add monitoring and dashboards, improve troubleshooting guides, and help reduce how often incidents happen.
- Understand User Requirements - Work with product managers and partner teams to understand what customers need and turn those needs into clear technical requirements.
- Engineering Excellence - Build security, privacy, and compliance into every stage of your work, from design to deployment. Automate testing and releases, and share what you learn with the team.
- AI-Native Development - Use artificial intelligence (AI) tools across the software development lifecycle (SDLC), from writing code and tests to investigating live issues. Take responsibility for AI-generated work and help teammates do the same.
- Embody our Culture and Values
Qualifications
Required Qualifications:
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience building distributed systems with coding in languages including, but not limited to, C#, Java, or Go
- OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
- Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience building distributed systems with coding in languages including, but not limited to, C#, Java, or Go
- OR Bachelor's Degree in Computer Science or related technical field
- AND 8+ years technical engineering experience building distributed systems with coding in languages including, but not limited to, C#, Java, or Go
- OR equivalent experience.
- OR Bachelor's Degree in Computer Science or related technical field
- 3+ years of experience running distributed services on public cloud platforms such as Microsoft Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP).
- 2+ years of experience with systems that route or schedule traffic, or that allocate computing resources.
- Experience with Python, Docker, and Kubernetes.
- Experience with AI or machine learning (ML) infrastructure, such as serving models in production or managing GPU fleets.
- Experience delivering projects with partner teams, from design through launch and operation.
- Experience being on call for highly available services and improving monitoring to reduce incidents.
#AIINFRA
Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
About the company
Microsoft
Large Enterprise
Microsoft is a global technology leader that empowers individuals and organizations to achieve more through innovative software, services, and devices. Founded in 1975, the company is best known for its flagship products like the Windows operating system and Microsoft Office suite. In addition to personal computing, Microsoft is a leader in cloud computing with its Azure platform, providing a range of solutions for businesses to enhance productivity and efficiency. With a strong commitment to sustainability and accessibility, Microsoft continues to drive technological advancements that shape the future of work and learning.