Role at a glance
- Salary
- $184K – $356.5K/yr
- Location
- Santa Clara, California, United States
- Work arrangement
- On-site
- Employment
- Full-time
- Education
- BS/MS/PhD in computer science or a related field (or equivalent experience)
Spotted an issue?
We’ll check it against the original posting.
Role Summary
NVIDIA is seeking a Senior Systems Software Engineer for its Apache Spark Acceleration group. The role develops an open source plugin that accelerates Apache Spark applications on GPUs without code changes, supporting large-scale data processing and batch ETL workloads.
What You'll Do
- Enable C++ native execution of Spark operations on CUDA
- Develop CUDA/C++ libraries to accelerate DataFrames and I/O operations for Parquet, ORC, and JSON
- Collaborate with distributed systems teams on distributed processing challenges at large scale
- Contribute to open source libraries such as RAPIDS, CCCL, and UCX through technical discussion and code contributions
- Provide recommendations on infrastructure, continuous integration, and testing strategy
- Build, test, and optimize across different platforms
Generated from the employer's posting. Verify important details before applying.
View full postingQualifications
Proficiency in C++, Java, and Scala; experience supporting enterprise customers; experience using AI tools in software development.
Required
- Proficiency in C++, Java, Scala
- Experience supporting enterprise customers
- Experience using AI tools in software development
Preferred
- Familiarity with the open source data platform ecosystem, including Apache Spark, Velox, Presto, Apache Arrow, and Apache DataFusion
Original job description
Content provided by the employer
Original job description
Content provided by the employer
NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.
NVIDIA is seeking a Sr. Systems Software Engineer for the Apache Spark Acceleration group. Over the past five years GPU accelerated data processing has moved from proof of concept to production deployments. Many enterprises recognize accelerated computing is vital to handle their large data processing needs. Multi-node GPU deployments will reduce cloud computing costs and lower latency in batch ETL workloads. Apache Spark is the most popular data processing engine in data centers. At NVIDIA, we are developing an open source plugin to accelerate Spark applications on GPUs without any code changes.
What you'll be doing:
Enable C++ native execution of Spark operations on CUDA
Develop CUDA/C++ libraries to accelerate DataFrames and I/O operations on common file formats such as Parquet, ORC and JSON
Collaborate with distributed systems teams to craft solutions to distributed processing problems challenges at large scale
Work with open source communities to enhance libraries like RAPIDS, CCCL and UCX through technical discussion and code contributions
Provide recommendations and feedback to teams regarding decisions surrounding topics such as infrastructure, continuous integration and testing strategy
Build, test and optimize across different platforms
What we need to see:
9+ years of experience in software development
5+ years hands on experience with data platform development
BS/MS/PhD in computer science or a related field (or equivalent experience)
Proficiency in C++, Java, Scala
Experience supporting enterprise customers
Familiarity with the open source data platform ecosystem is a plus (Apache Spark, Velox, Presto, Apache Arrow, Apache DataFusion, etc.)
Experience using AI tools in software development
You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.About the company
NVIDIA
Large Enterprise
NVIDIA is a leading technology company renowned for its graphics processing units (GPUs) and innovative computing solutions that enhance visual experiences across multiple platforms, including gaming, scientific research, and artificial intelligence. Founded in 1993, the company has expanded its offerings to include powerful AI frameworks and deep learning platforms, making significant contributions to industries such as gaming, data centers, automotive, and healthcare. NVIDIA's commitment to pushing the boundaries of visual computing continues to drive advancements in both hardware and software, positioning the company at the forefront of emerging technologies and digital transformation.
NVIDIA is a leading technology company renowned for its graphics processing units (GPUs) and innovative computing solutions that enhance visual experiences across multiple platforms, including gaming, scientific research, and artificial intelligence. Founded in 1993, the company has expanded its offerings to include powerful AI frameworks and deep learning platforms, making significant contributions to industries such as gaming, data centers, automotive, and healthcare. NVIDIA's commitment to pushing the boundaries of visual computing continues to drive advancements in both hardware and software, positioning the company at the forefront of emerging technologies and digital transformation.