Python Big Data Developer

Job Description
We are seeking a highly motivated professional with strong expertise in Python development, test automation, and Big Data technologies within the Banking and Financial Services domain. The candidate will be responsible for designing and developing automation frameworks, building data validation solutions, developing test utilities, and working on large-scale data processing platforms.
The ideal candidate should have hands-on experience in Python programming, Unix Shell scripting, SQL, and Big Data technologies such as Hive, Hadoop, and PySpark. Experience with ETL platforms, data quality validation, and automated testing frameworks will be highly desirable.
Key Responsibilities
• Design, develop, and maintain automation frameworks using Python.
• Develop automated testing solutions for data-intensive applications and ETL pipelines.
• Build reusable test utilities, libraries, and validation frameworks.
• Work with Big Data platforms including Hive, Hadoop, and PySpark for data processing and validation.
• Develop Python-based tools for data reconciliation, quality checks, and data integrity verification.
• Perform SQL-based data analysis, validation, and reporting.
• Create and execute functional, integration, regression, and data validation test cases.
• Develop automated test suites and integrate them into CI/CD pipelines.
• Collaborate with development and business teams to understand requirements and ensure solution quality.
• Create and maintain technical documentation, test strategies, and automation standards.
• Use JIRA and Zephyr for test management, defect tracking, and Agile delivery processes.
• Contribute to continuous improvement of automation frameworks and quality engineering practices.
Mandatory Skills
• Strong hands-on experience in Python programming and automation development.
• Strong Unix/Linux and Shell Scripting skills.
• Strong SQL and Oracle database knowledge.
• Hands-on experience with Hive, Hadoop, and PySpark.
• Experience in test automation framework development.
• Experience in data validation, reconciliation, and quality assurance processes.
• Experience using JIRA and Zephyr.
• Strong analytical and problem-solving skills.
• Banking / Financial Services domain experience.
• Understanding of SDLC, STLC, and Agile methodologies.
Preferred Skills
• Experience with ETL testing and data pipeline validation.
• Experience with Ab Initio platform and/or Control Center.
• Experience working with automation testing tools and frameworks.
• Knowledge of CI/CD pipelines and DevOps practices.
• Experience with data warehousing concepts.
• Knowledge of API testing and automation.
• Exposure to cloud-based data platforms.
• Agile/Scrum development experience.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.