Role at a glance
- Job function
-
Software Engineering & IT Software Engineering
- Salary
- Not yet verified Check the description for pay details; an amount or pay period has not been verified.
- Location
- Santa Clara, California, United States
- Work arrangement
- Hybrid
- Employment
- Full-time
- Experience
- Senior Level Over 8 years of solid software engineering experience working with production compute infrastructure, distributed systems, large-scale build and test systems, or comparable systems software.
- Education
- A degree in computer science, computer engineering, or a related field, or equivalent experience.
Spotted an issue?
We’ll check it against the original posting.
Role Summary
The Senior Systems Software Engineer helps engineering teams run build, simulation, and validation workloads efficiently and reliably. The role develops self-service infrastructure workflows and diagnostics, investigates performance and reliability across system boundaries, and validates improvements with the teams responsible for underlying components.
What You'll Do
- Build self-service and validation mechanisms for configuring and using supported infrastructure workflows.
- Provide diagnostic views across application, submission, remote-execution, and host or target layers to help locate failures and slowdowns.
- Benchmark representative workloads and use profiling, metrics, traces, and controlled experiments to identify effective changes.
- Evaluate and improve compute and GPU selection, scheduling and placement, concurrency, worker configuration, resource sharing, caching,...
- Make retry causes, recovery outcomes, and wasted execution capacity visible, and work with component owners to reduce recurring failures...
- Implement and validate infrastructure changes with application, build and CI, remote-execution, and infrastructure teams; measure...
Generated from the employer's posting. Verify important details before applying.
View full postingQualifications
Production systems software experience, including debugging performance or reliability issues across software and hardware boundaries with logs, metrics, traces, profiling, and experiments. Proficiency in a systems programming or automation language; experience delivering tested changes into production infrastructure; in-depth Linux experience and proficiency in at least one of GPU systems and drivers, scheduling and resource management, remote execution or CI infrastructure, storage and data paths, or host and container infrastructure. Ability to collaborate across teams, develop a technical plan from ambiguous symptoms, and explain results to engineering customers. A degree in computer science, computer engineering, or a related field, or equivalent experience.
Required
- Over 8 years of solid software engineering experience working with production compute infrastructure, distributed systems, large-scale...
Preferred
- Experience with GPU sharing and isolation, CUDA execution behavior, MIG or MPS or equivalent experience, GPU driver diagnostics, or...
- Experience with workload placement, CPU and GPU concurrency, NUMA, cloud-instance benchmarking, or cost and performance tradeoffs.
- Familiarity with Bazel, remote execution, build front ends, simulation or replay workloads, and hardware-in-the-loop validation.
- Experience improving file-system, caching, networking, or high-throughput data paths under concurrent workloads.
- A record of building customer self-service or observability tools and using incident and retry data to drive verified reliability...
Original job description
Content provided by the employer
Original job description
Content provided by the employer
NVIDIA is seeking a senior systems software engineer to help engineering teams run demanding build, simulation, and validation workloads efficiently and reliably. Our Workload Systems Engineering team connects customer workflows with the infrastructure that performs them. We develop self-service mechanisms and clear diagnostics, investigate performance and reliability across system boundaries, and deliver measured infrastructure improvements with the teams that own the underlying components.
Your responsibilities include enabling application configuration, remote execution, workers, hosts, GPU and CPU resources, storage, data paths, and on-target systems. The position requires direct system evaluation: diagnosing causes of slow or failing workloads, trying alternatives in representative scenarios, applying improvements with others, and verifying customer advantages.
What you'll be doing:
- Build shared self-service and validation mechanisms that let engineering teams configure and use supported infrastructure workflows with less manual assistance.
- Give customers and on-call teams useful diagnostic views across application, submission, remote-execution, and host or target layers so they can identify where failures and slowdowns originate.
- Set performance and reliability benchmarks for representative workloads. Apply profiling, metrics, traces, and controlled experiments to pinpoint the changes that make a difference.
- Evaluate and improve compute and GPU selection, scheduling and placement, concurrency, worker and runner configuration, resource sharing, caching, and input/output paths.
- Make retry causes, recovery outcomes, and wasted execution capacity visible. Work with component owners to eliminate recurring failures and unnecessary re-execution.
- Implement and validate infrastructure-level changes with application, build and CI, remote-execution, and infrastructure teams. Measure the effect on turnaround, successful efficiency, stability, usable capacity, and cost.
- Turn successful investigations into supported workflows, diagnostics, documentation, and clear customer handoffs.
What we need to see:
- Over 8 years of solid software engineering experience working with production compute infrastructure, distributed systems, large-scale build and test systems, or comparable systems software.
- Hands-on experience debugging complex performance or reliability issues across software and hardware boundaries using logs, metrics, traces, profiling, and experiments.
- Proficiency in a systems programming or automation language and experience delivering tested changes into production infrastructure.
- In-depth experience with Linux and proficiency in one or more of these fields: GPU systems and drivers, scheduling and resource management, remote execution or CI infrastructure, storage and data paths, or host and container infrastructure.
- Ability to work across teams with different component ownership, turn ambiguous symptoms into a clear technical plan, and explain results to engineering customers.
- A degree in computer science, computer engineering, or a related field, or equivalent experience.
Ways to stand out from the crowd:
- Experience with GPU sharing and isolation, CUDA execution behavior, MIG or MPS or equivalent experience, GPU driver diagnostics, or high-performance computing workloads.
- Experience with workload placement, CPU and GPU concurrency, NUMA, cloud-instance benchmarking, or cost and performance tradeoffs.
- Familiarity with Bazel, remote execution, build front ends, simulation or replay workloads, and hardware-in-the-loop validation.
- Experience improving file-system, caching, networking, or high-throughput data paths under concurrent workloads.
- A record of building customer self-service or observability tools and using incident and retry data to drive verified reliability improvements.
Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/
#LI-Hybrid
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.About the company
NVIDIA
Large Enterprise
NVIDIA is a leading technology company renowned for its graphics processing units (GPUs) and innovative computing solutions that enhance visual experiences across multiple platforms, including gaming, scientific research, and artificial intelligence. Founded in 1993, the company has expanded its offerings to include powerful AI frameworks and deep learning platforms, making significant contributions to industries such as gaming, data centers, automotive, and healthcare. NVIDIA's commitment to pushing the boundaries of visual computing continues to drive advancements in both hardware and software, positioning the company at the forefront of emerging technologies and digital transformation.