Role at a glance
- Job function
-
Software Engineering & IT Software Engineering
- Salary
- Not Disclosed
- Location
- Pune
- Employment
- Full-time
- Experience
- Minimum 12 year(s) of experience is required
- Education
- Educational Qualification : 15 years full time education
Spotted an issue?
We’ll check it against the original posting.
Role Summary
This role centers on designing and delivering scalable data engineering and real-time streaming solutions using Apache Kafka and Databricks. The engineer will also support cloud-native implementations on Azure and provide technical leadership to team members.
What You'll Do
- Design and develop scalable data engineering solutions using Databricks, PySpark, and Spark SQL.
- Build and support real-time data streaming solutions using Apache Kafka.
- Develop and maintain Kafka producers, consumers, Kafka Streams, and integration frameworks.
- Design and implement batch and streaming data pipelines for large-scale data processing.
- Optimize data ingestion, transformation, and processing workloads for performance and scalability.
- Provide technical leadership, mentor team members, and drive solution best practices.
Generated from the employer's posting. Verify important details before applying.
View full postingQualifications
A custom software engineer with at least 12 years of experience, core Apache Kafka skills, and Databricks and Azure data engineering experience.
Required
- Minimum 12 year(s) of experience
- Apache Kafka
- Kafka Streams
- Kafka Connect
- Databricks, PySpark, Spark SQL
- Delta Lake and Lakehouse Architecture
- Real-Time Data Processing and Event-Driven Architecture
- Data Modeling and Data Warehousing Concepts
Preferred
- Data Engineering
- Microsoft Azure Databricks
- Databricks Unified Data Analytics Platform
Original job description
Content provided by the employer
Original job description
Content provided by the employer
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills : Apache Kafka
Good to have skills : Data Engineering, Microsoft Azure Databricks, Databricks Unified Data Analytics Platform
Minimum 12 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
As a Custom Software Engineer, a typical day involves designing, building, and configuring applications that align with specific business processes and application requirements. This role requires continuous engagement with evolving project needs, ensuring that solutions are tailored effectively to support organizational goals. The workday often includes collaborating with various stakeholders to understand requirements, iterating on application designs, and refining configurations to optimize performance and usability. Attention to detail and adaptability are essential as the engineer navigates complex challenges to deliver robust software solutions that drive business success.
Job Description
We are looking for experienced Data Engineers/Technical Leads with strong expertise in Kafka and Databricks to support the design and delivery of modern data and event-driven platforms.
Key Responsibilities:
Design and develop scalable data engineering solutions using Databricks, PySpark, and Spark SQL.
Build and support real-time data streaming solutions using Apache Kafka.
Develop and maintain Kafka producers, consumers, Kafka Streams, and integration frameworks.
Design and implement batch and streaming data pipelines for large-scale data processing.
Work with Delta Lake, Lakehouse architecture, and enterprise data platforms.
Optimize data ingestion, transformation, and processing workloads for performance and scalability.
Collaborate with architects, business stakeholders, and development teams to deliver end-to-end data solutions.
Support cloud-native implementations on Azure and participate in CI/CD and DevOps practices.
Ensure data quality, security, monitoring, and operational excellence across data platforms.
Provide technical leadership, mentor team members, and drive solution best practices.
Required Skills:
Apache Kafka, Kafka Streams, Kafka Connect
Databricks, PySpark, Spark SQL
Delta Lake and Lakehouse Architecture
Real-Time Data Processing and Event-Driven Architecture
Data Modeling and Data Warehousing Concepts
Azure Cloud Services
CI/CD, Git, and DevOps Practices
Strong analytical, troubleshooting, and stakeholder management skills
15 years full time education
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.Visit us at www.accenture.com
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
About the company
Accenture
Large Enterprise
Accenture is a global professional services company that specializes in providing consulting, technology, and outsourcing services. With a diverse range of industries served, including financial services, healthcare, and telecommunications, Accenture leverages advanced technologies and data analytics to help organizations improve their performance and drive innovation. Committed to sustainable progress, the company emphasizes its dedication to inclusivity, digital transformation, and building a more sustainable future for its clients and communities. With a presence in over 120 countries, Accenture is known for its expertise in integrating cutting-edge solutions that address complex business challenges.