Role at a glance
- Job function
-
Software Engineering & IT Software Engineering
- Salary
- Not Disclosed
- Location
- Bengaluru
- Employment
- Full-time
Spotted an issue?
We’ll check it against the original posting.
Role Summary
Develops custom software solutions focused on data engineering and AWS Glue-based pipelines. The work includes building data workflows, managing S3 data lakes, and supporting security, deployment, and data quality needs.
What You'll Do
- Develop and maintain ETL/ELT workflows using Python and AWS Glue, with Lambda and Step Functions where applicable.
- Design and optimize S3-based data lakes and metadata strategies using AWS Glue Data Catalog.
- Implement IAM policies and access controls, KMS-based encryption, and audit-ready logging.
- Package and deploy data jobs and functions, maintain automated tests, and set up CI/CD pipelines.
- Build event-driven data processing using S3 events and Lambda, optimizing for cost, concurrency, and resilience.
- Implement pipeline validation, schema enforcement, monitoring, and alerting, and collaborate with data platform, analytics, and...
Generated from the employer's posting. Verify important details before applying.
View full postingQualifications
AWS Glue is identified as a required skill. Python and PySpark are listed both as “Good to have” and as “Must Have”; other stated qualifications include data integration and ETL knowledge, cloud computing services and architecture, and familiarity with agile methodologies and the software development life cycle.
Required
- AWS Glue
- Python (Programming Language)
- PySpark
- Strong understanding of data integration and ETL processes
- Experience with cloud computing services and architecture
- Familiarity with agile methodologies and software development life cycle
Preferred
- Python (Programming Language)
- PySpark
Original job description
Content provided by the employer
Original job description
Content provided by the employer
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills : AWS Glue
Good to have skills : Python (Programming Language), PySpark
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
As a Custom Software Engineer, you will engage in the development of custom software solutions that are designed to meet specific business needs. Your typical day will involve collaborating with cross-functional teams to design, code, and enhance various components across systems or applications. You will utilize modern frameworks and agile practices to ensure the delivery of scalable and high-performing solutions, while also addressing any challenges that arise during the development process. Your role will require a proactive approach to problem-solving and a commitment to continuous improvement in software development practices.
Roles & Responsibilities:
Build & Maintain Data Pipelines: Develop scalable, reliable ETL/ELT workflows using Python and AWS Glue (Jobs/Workflows), Lambda, and Step Functions where applicable.
Data Lake Engineering: Design and optimize S3-based data lakes (partitioning, lifecycle policies, storage classes) with robust metadata strategies using AWS Glue Data Catalog.
Security & Governance: Implement AWS IAM policies/roles, fine-grained access controls for S3, KMS-based encryption, and audit-ready logging (CloudTrail/CloudWatch).
Automation & CI/CD: Familiarity with Git, code reviews, and automated testing for data code. Package and deploy jobs/functions, maintain unit/integration tests, and set up CI/CD pipelines.
Serverless & Event-Driven: Build event-driven data processing with S3 events, Lambda triggers optimize for cost, concurrency, and resilience.
Data Quality & Observability: Implement validation, schema enforcement (e.g., Glue schemas), logging/monitoring, and alerting for pipelines and jobs.
Collaboration: Work closely with data platform, analytics, and governance teams to ensure reliability, scalability, and compliance.
(If Databricks): Develop notebooks/jobs, Delta Lake optimization (Z-ordering, OPTIMIZE/VACUUM), cluster/pool usage, and job orchestration.
Professional & Technical Skills:
- Must Have Skills: Proficiency in AWS Glue, Python (Programming Language), PySpark.
- Strong understanding of data integration and ETL processes.
- Experience with cloud computing services and architecture.
- Familiarity with agile methodologies and software development life cycle.
Additional Information:
- The candidate should have minimum 7.5 years of experience in AWS Glue, Python (Programming Language), PySpark.
- This position is based at our Bengaluru office.
- A 15 years full time education is required.15 years full time education
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.Visit us at www.accenture.com
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
About the company
Accenture
Large Enterprise
Accenture is a global professional services company that specializes in providing consulting, technology, and outsourcing services. With a diverse range of industries served, including financial services, healthcare, and telecommunications, Accenture leverages advanced technologies and data analytics to help organizations improve their performance and drive innovation. Committed to sustainable progress, the company emphasizes its dedication to inclusivity, digital transformation, and building a more sustainable future for its clients and communities. With a presence in over 120 countries, Accenture is known for its expertise in integrating cutting-edge solutions that address complex business challenges.