What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment! This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world.
At Cognizant, together with your colleagues from all around the world, you will collaborate on creating solutions for the world's leading companies and help them become more flexible, more innovative, and successful. Moreover, this is your chance to be part of the success story.
Position Summary
Data Engineer with 4+ years of experience with end-to-end Big Data Pipeline design, ETL pipeline build using Apache Spark, Hive, Py-Spark and having a hand-on experience in building of real-time data pipeline using HBase and Hadoop ecosystem. You will also work on mainly Agile methodology. You’ll be working for a service-based IT consultancies where you will be provided the opportunities to work for different clients all over the globe. This will expose you to different types of enterprise environments, which will help gain knowledge in terms of technology, people, process and delivery.
Mandatory Skills
- Apache Spark, MapReduce, Sqoop, Py-spark, Spark SQL
- Database: Hive, MySQL, Oracle
- Language and No-SQL : Python and HBase
- Build Tools: Expertise in setting up and managing continuous integration and continuous deployment pipelines in Bitbucket and Jenkins
- Job Scheduler: Familiarity with control-M scheduling tool for ordering the Job pipeline.
- Monitoring and Logging: Skills in using monitoring tools and analysing the root cause using Spark Logs
- Security and Compliance: Understanding of security best practices and compliance requirements
- Business Domain Knowledge: Banking (BFSI)
Roles And Responsibilities
- Being part of the Data Product team, building the data Transformation- more precisely on Dara Transform
- Built a data product which will be able to collect customer data from various sources from raw layer to create comprehensive customer profiles into different layers.
- Built an end-to-end Metadata driven data Quality Framework that can be utilized across different projects which consists of Metadata, Attribute and Process sheets.
- Involved in Building Python Scripts for temporary transformation tables using Py-spark and Spark SQL before populating the records into SCD Table
- Have good knowledge on SCD type 2 logics to maintain both history and active Records.
- Have worked on Analyzing the jobs and providing RCA if issues raised post sprint Release.
- Took part in Implementation and Design Walkthrough with various teams and worked on Production Deployment on change related Activities.
- Proven Experience in delivering projects successfully through effective planning, prioritizing, team building , task scheduling and tracking scheduled tasks .
- Utilize Atlassian tools, including Jira, confluence, and Bitbucket, for project management and team collaboration.
- Involved on doing the Tech PIV and testing the functionality of the tables as part of Production Implementation
Salary Range: $85,000-$95,000
Date of Posting: 3 April 2025
Next Steps: If you feel this opportunity suits you, or Cognizant is the type of organization you would like to join, we want to have a conversation with you! Please apply directly with us.
For a complete list of open opportunities with Cognizant, visit http://www.cognizant.com/careers. Cognizant is committed to providing Equal Employment Opportunities. Successful candidates will be required to undergo a background check.
The Cognizant community:
We are a high caliber team who appreciate and support one another. Our people uphold an energetic, collaborative and inclusive workplace where everyone can thrive.
- Cognizant is a global community with more than 300,000+ associates around the world.
- We don’t just dream of a better way – we make it happen.
- We take care of our people, clients, company, communities and climate by doing what’s right.
- We foster an innovative environment where you can build the career path that’s right for you.
About us:
Cognizant is one of the world's leading professional services companies, transforming clients' business, operating, and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build, and run more innovative and efficient businesses. Headquartered in the U.S., Cognizant (a member of the NASDAQ-100 and one of Forbes World’s Best Employers 2024) is consistently listed among the most admired companies in the world. Learn how Cognizant helps clients lead with digital at www.cognizant.com
Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.
If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email [email protected] with your request and contact information.
Disclaimer:
Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.