Role at a glance
- Salary
- Not Disclosed
- Location
- Santa Clara, California, United States
- Work arrangement
- On-site
- Employment
- Full-time
- Education
- Master's
Spotted an issue?
We’ll check it against the original posting.
Qualifications
A master’s degree or equivalent experience in Computer Science, Electrical Engineering, or a related field; over 12 years of industry experience, including at least 8 years in deep learning model optimization, inference engineering, or neural network compilation, and over 5 years in embedded/edge software. Required expertise includes modern deep learning architectures; GPU fundamentals, CUDA, low-level heterogeneous performance optimization, and TensorRT, compiler IRs, or equivalent toolchains; QNX/Linux internals, memory management, C/C++, parallel programming, and memory hierarchies. The role also requires experience delivering production inference in power-limited, latency-sensitive environments and working directly with external customers and partners on technical workload issues.
Required
- Experience reviewing model architectures at the operator/kernel level.
- Knowledge of contemporary architectures including transformers, attention variants, ViT vision encoders, multimodal/vision-language...
- Expert knowledge of GPU architecture fundamentals, CUDA, and low-level performance optimization using heterogeneous computing;...
- Understanding of QNX/Linux internals, memory management, C/C++, embedded/system software, parallel programming such as CUDA or OpenMP,...
- Production inference delivery in power-limited, latency-sensitive environments, and demonstrated direct technical collaboration with...
Preferred
- Experience with ML compiler frameworks such as TVM, MLIR, XLA, or Triton, or inference runtime development.
- Production deployment experience with autonomous vehicle perception or planning stacks, from sensor input through trajectory output.
- Familiarity with VLM plus action-expert architectures, end-to-end driving models, or robot foundation models.
- Contributions to MLPerf benchmarks and large-scale industry performance optimization efforts.
- Experience with automotive safety standards such as ISO 26262 and SOTIF and their implications for inference system development.
About the role
Original posting provided by NVIDIA
NVIDIA is a global leader in physical AI, powering self-driving cars, humanoid robots, intelligent environments, and medical devices. Our software platforms are central to this mission. We help innovators build products that save lives, enhance working conditions, and improve living standards globally!
We are hiring a Senior Systems Software Engineer to join our team as a technical expert focused on optimizing deep learning inference for autonomous vehicles and robotics on edge devices. This role requires a hands-on specialist who can examine model architectures at the operator level. They will locate performance issues through kernel trace analysis and evaluate modern architectures (transformers, vision-language models, diffusion/flow matching, state space models) on GPU and SOC. This work directly enhances autonomous vehicles’ and robots’ ability to perceive and respond in real time, yielding immediate benefits. The group works on some of the hardest optimization challenges in the industry, positioned at the convergence of model frameworks, compiler technology, and embedded hardware. We maintain strong collaboration with automotive OEMs, robotics colleagues, and internal hardware teams to extend edge device capabilities.
What you'll be doing:
Address customer and partner optimization challenges: Engage directly with prominent automotive OEMs and robotics associates to analyze, debug, and improve their deep learning models on NVIDIA platforms. We emphasize delivering solutions rather than just recommendations.
Own performance benchmarking: Drive efforts to achieve leading results on MLPerf Edge and industry benchmarks, as well as closed-source engagements with key partners. Define methodology, ensure reproducibility, and turn results into actionable optimization priorities.
Evaluate emerging model architectures: Investigate new DL architectures, including vision encoders, multi-modal VLMs, hybrid SSM-Transformer backbones, diffusion/flow matching decoders, and multi-camera tokenizers, regarding compilation feasibility, memory footprint, and latency on target SOCs.
Collaborate across teams: Work alongside our compiler, runtime, and hardware groups to link model-level insight with platform capabilities.
Contribute to build reviews and help develop internal roadmap priorities based on real customer workload patterns.
Represent NVIDIA externally: Share our deep learning optimization expertise at conferences, webinars, and partner events. Help elevate the broader team by bringing back insights and establishing guidelines.
Deliver TensorRT and compiler-stack solutions for edge: Build and deploy inference solutions on Jetson, DRIVE, and GPU + ARM platforms for AV and robotics workloads. Develop Proofs of Readiness (PORs) and collaborate closely with our compiler team on Torch-TRT, MLIR-TRT, and related frameworks to bridge performance gaps.
What we need to see:
Master’s degree or equivalent experience in Computer Science, Electrical Engineering, or a related field.
Over 12 years working in the industry, including at least 8 years specializing in deep learning model optimization, inference engineering, or neural network compilation. Proficiency in understanding and reviewing model architectures at the operator/kernel level, not merely handling their operation, is required.
Over 5 years of validated expertise in embedded/edge software, with experience delivering production inference solutions within power-limited, latency-sensitive deployment environments.
Comprehensive knowledge of contemporary DL architectures: transformers, attention variants, vision encoders (ViT), multi-modal/vision-language model frameworks, as well as experience with diffusion models and/or state space models.
Expert knowledge of GPU architecture fundamentals, CUDA, and low-level performance optimization using heterogeneous computing. Experience with TensorRT, compiler IRs, or equivalent inference optimization toolchains.
Solid understanding of embedded operating system internals (QNX/Linux), memory management, C/C++, and embedded/system software concepts.
Background in parallel programming (e.g., CUDA, OpenMP) and experience reasoning about memory hierarchies, data movement, and compute utilization.
Demonstrated capability to collaborate directly with external partners and customers in a deep technical role. You solve their workload issues, identify performance problems, and provide solutions within production limitations.
Ways to Stand Out from the Crowd:
Experience with ML compiler frameworks (TVM, MLIR, XLA, Triton) or contributing to inference runtime development.
Production deployment experience with autonomous vehicle perception or planning stacks, understanding the full pipeline from sensor input through trajectory output.
Familiarity with the Physical AI model landscape: VLM + action expert architectures, end-to-end driving models, or robot foundation models.
Contributions to MLPerf benchmarks and large-scale industry performance optimization efforts.
Experience with automotive safety standards (ISO 26262, SOTIF) and their implications for inference system development.
You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.About the company
NVIDIA
Large Enterprise
NVIDIA is a leading technology company renowned for its graphics processing units (GPUs) and innovative computing solutions that enhance visual experiences across multiple platforms, including gaming, scientific research, and artificial intelligence. Founded in 1993, the company has expanded its offerings to include powerful AI frameworks and deep learning platforms, making significant contributions to industries such as gaming, data centers, automotive, and healthcare. NVIDIA's commitment to pushing the boundaries of visual computing continues to drive advancements in both hardware and software, positioning the company at the forefront of emerging technologies and digital transformation.