Data Engineer
We are looking for a skilled Data Engineer to join our team. The ideal candidate will have a strong background in data engineering and be proficient in JAVA/Kotlin, Apache Spark, Apache Hive, Apache Airflow, and SQL Server. Responsible for designing, developing, and maintaining our data infrastructure and pipelines.
Primary Skills:
Java/Kotlin : Proficient in writing clean, efficient, and maintainable code using Java/Kotlin, or other modern programming languages.
Apache Spark, Hadoop , Kafka : Experience with Spark for large-scale data processing and Proven experience in distributed data engineering environments.
Apache Hive: Knowledge of Hive for data warehousing solutions.
Apache Airflow: Proficiency in using Airflow for orchestrating complex data workflows.
SQL Server: Experience with SQL Server for database management and querying.
Software Testing Principles : Developed unit and integration tests for data transformation logic usingPyTest and JUnit, ensuring data accuracy and reliability across multiple pipeline stages.
Docker, Kubernetes - Hands-on experience with Docker, Kubernetes, and cloud-native development to deploy and manage data services.
CI/CD tools - Familiarity with CI/CD tools (e.g., Jenkins, GitHub Actions, GitLab CI)
Responsibilities:
Design, build, and maintain scalable data pipelines across distributed systems using modern orchestration tools.
Implement and manage data governance frameworks to ensure data quality, security, and compliance.
Optimize and troubleshoot data processing jobs to ensure performance, reliability, and fault tolerance.
Apply software testing principles (unit and integration testing) to validate data workflows and transformations.
Develop and maintain data warehousing solutions with Apache Hive.
Orchestrate data workflows using Apache Airflow.
Manage and query databases using SQL Server.
Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
Leverage containerization technologies (Docker, Kubernetes) to deploy and manage data services.
Implement CI/CD pipelines to automate testing, deployment, and monitoring of data applications.
Ensure data quality and integrity across all data pipelines.
Qualifications:
Proven experience as a Data Engineer or in a similar role.
Strong programming skills in Kotlin/Java.
Hands-on experience with Apache Spark, Apache Hive, Apache Airflow, and SQL Server.
Familiarity with cloud platforms (e.g., AWS, GCP, Azure) is a plus.
Excellent problem-solving skills and attention to detail.
Strong communication and teamwork abilities.
About Cognizant:
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, bridging the gap between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, drive tangible outcomes and keep global enterprises ahead in a fast-changing world. See how at cognizant.ai or @cognizant.
Additional employment information
Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.
Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.
If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email [email protected] with your request and contact information.
