Role at a glance
- Job function
-
AI & Data Machine Learning Engineering
- Salary
- $184K – $356.5K/yr
- Location
- Santa Clara, California, United States
- Work arrangement
- On-site
- Employment
- Full-time
- Experience
- PhD with 4+ years, MS with 6+ years, or BS (or equivalent experience) with 8+ years of relevant experience
- Education
- Computer Science, Computer Engineering, or a related technical field
Spotted an issue?
We’ll check it against the original posting.
Role Summary
The Senior Perception Engineer will develop and productize NVIDIA’s autonomous driving perception solutions. The role focuses on traffic signal understanding, including traffic lights, traffic signs, road markings, construction objects, and other signals, with emphasis on robustness, accuracy, efficiency, and operation without reliance on HD maps.
What You'll Do
- Design end-to-end perception and autonomous vehicle stack solutions for traffic signal detection across diverse driving environments
- Research and develop deep learning models for traffic light, traffic sign, road marking, construction object, text recognition, and...
- Develop generalizable approaches to support diverse operational design domains and country or region expansion
- Work with data collection and labeling teams on data prioritization, labeling prioritization, and labeling efficiency optimization
- Use data simulation and augmentation to address extreme scenarios
- Productize perception solutions to meet safety, latency, and software robustness requirements
Generated from the employer's posting. Verify important details before applying.
View full postingQualifications
Hands-on work experience in developing deep learning and algorithms to solve sophisticated real world problems; proficiency in using deep learning frameworks (e.g., PyTorch); experience in data-driven development and collaboration with data and ground truth teams; strong programming skills in python and/or C++; outstanding communication and teamwork skills.
Required
- Deep learning and algorithm development for sophisticated real world problems
- Proficiency in deep learning frameworks such as PyTorch
- Data-driven development and collaboration with data and ground truth teams
- Strong programming skills in Python and/or C++
- Communication and teamwork skills
Preferred
- Technical leadership demonstrating high technical and organizational complexity
- Generalizable perception solutions for autonomous driving or robotics using deep learning with cameras
- Developing and deploying DNN-based solutions to embedded platforms for real time applications
- Technical publications in leading conferences/journals
- Visual Language Models, Transformers, BEV architectures, and modern traffic signal perception techniques
- Complex object detection and recognition problems
Original job description
Content provided by the employer
Original job description
Content provided by the employer
Intelligent machines powered by Artificial Intelligence computers that can learn, reason and interact with people are no longer science fiction. GPU Deep Learning has provided the foundation for machines to learn, perceive, reason and solve problems. Now, NVIDIA’s GPU runs Deep Learning algorithms, simulating human intelligence, and acts as the brain of computers, robots and self-driving cars that can perceive and understand the world.
We are now looking for an extraordinary Senior Perception Engineer to develop and productize NVIDIA’s autonomous driving solutions. As a member of our perception team, you will be driving E2E solutions for perception modules that are responsible for traffic signal understanding — including traffic lights, traffic signs, road markings, construction objects, and other traffic signals critical for driving without reliance on HD maps. You will be challenged to improve robustness and accuracy as well as efficiency of the solutions to fully enable autonomous driving anywhere and anytime.
What You’ll Be Doing:
Designing end2end solutions for Perception and AV stack to enable traffic signal detections across various driving environments from complex intersections to rural roads to highways.
Applied research and development of innovative deep learning models for traffic light detection, traffic sign recognition, road marking detection, construction object detection, text recognition, and other traffic signal tasks.
Develop generalizable approaches to support diverse ODDs and Country/region expansion
Drive and prioritize data-driven development by working with large data collection and labeling teams to bring in high value data to improve perception system accuracy. Efforts will include data collection prioritization and planning, labeling prioritization, labeling efficiency optimization, so that value of data is maximized
Leverage data simulation and augmentation for solving extreme scenarios
Productize the developed perception solutions by meeting product requirements for safety, latency, and SW robustness.
What We Need to See:
Minimum Requirement: PhD with 4+ years, MS with 6+ years, or BS (or equivalent experience) with 8+ years of relevant experience in Computer Science, Computer Engineering, or a related technical field.
2+ years of technical leadership demonstrating high technical and organizational complexity is a big plus.
Hands-on work experience in developing deep learning and algorithms to solve sophisticated real world problems, and proficiency in using deep learning frameworks (e.g., PyTorch).
Experience in data-driven development and collaboration with data and ground truth teams.
Strong programming skills in python and/or C++.
Outstanding communication and teamwork skills as we work as a tightly-knit team, always discussing and learning from each other.
Ways to Stand Out from the Crowd:
Proven expertise in developing generalizable perception solutions for autonomous driving or robotics using deep learning with cameras.
Hands-on experience in developing and deploying DNN-based solutions to embedded platforms for real time applications.
Proven expertise in deep learning backed up by technical publications in leading conferences/journals.
Expertise with Visual Language Models, Transformers, BEV architectures, and modern traffic signal perception techniques. Experience in working on complex object detection and recognition problems is a big plus.
Intelligent machines powered by AI are no longer science fiction. GPU Deep Learning has made it possible for self-driving cars to learn, perceive, and reason about the world. NVIDIA GPUs power the algorithms that enable both traffic element understanding and scalable perception across global road systems. Join us and help define the future of reliable, data-driven autonomous driving.
#AutonomousVehicles
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.About the company
NVIDIA
Large Enterprise
NVIDIA is a leading technology company renowned for its graphics processing units (GPUs) and innovative computing solutions that enhance visual experiences across multiple platforms, including gaming, scientific research, and artificial intelligence. Founded in 1993, the company has expanded its offerings to include powerful AI frameworks and deep learning platforms, making significant contributions to industries such as gaming, data centers, automotive, and healthcare. NVIDIA's commitment to pushing the boundaries of visual computing continues to drive advancements in both hardware and software, positioning the company at the forefront of emerging technologies and digital transformation.