Skill: Azure Databricks
Experience: 6 to 12 years
Location: AIA Bhubaneshwar
Job Summary
The Sr Developer will design and optimize scalable data solutions using Databricks SQL Databricks Workflows and PySpark for a global enterprise operating in a hybrid work model. The role focuses on building reliable analytics pipelines improving data quality and enabling data driven decisions that support business growth and positive impact on customers and communities.
Responsibilities
- Develop and maintain robust data pipelines using Databricks Workflows and PySpark to deliver reliable and timely data assets for analytics consumers within the organization.
- Design and optimize complex Databricks SQL queries that transform large scale datasets into efficient reusable views and tables aligned to business reporting needs.
- Implement modular PySpark code structures that promote reusability testability and performance while adhering to the organizations coding standards and guidelines.
- Build and schedule Databricks Workflows that orchestrate end to end data processing tasks including ingestion transformation validation and publishing to downstream systems.
- Optimize cluster configurations and job parameters in Databricks to balance performance cost efficiency and stability for critical production workloads.
- Develop robust data quality checks and validation routines in PySpark and Databricks SQL that detect anomalies and ensure high confidence in analytical outputs.
- Collaborate with data analysts and product stakeholders to understand functional requirements and translate them into scalable Databricks based technical solutions.
- Document data models transformation logic workflow dependencies and operational procedures in a clear and structured manner to support maintainability and knowledge sharing.
- Troubleshoot production incidents by analyzing logs investigating data issues and implementing sustainable fixes that enhance reliability of the data platform.
- Contribute to continuous improvement initiatives by identifying opportunities to simplify logic reduce processing time and eliminate manual interventions across workflows.
- Mentor less experienced developers by reviewing code sharing best practices in PySpark and Databricks usage and encouraging high quality engineering habits.
- Partner with enterprise technology teams to ensure that data solutions align with security governance and compliance expectations thereby protecting organizational and customer data.
- Drive innovation by exploring advanced features of the Databricks platform and applying them to create impactful solutions that enable better decisions and positive outcomes for society.
Qualifications
- Possess six to ten years of professional experience in data engineering or related development roles with a strong focus on building production grade data solutions.
- Demonstrate advanced proficiency in Databricks SQL including window functions complex joins performance tuning and the creation of reusable analytical datasets.
- Exhibit deep hands on experience with PySpark for developing scalable batch and streaming data pipelines that operate on large and diverse data sources.
- Show proven capability in configuring and managing Databricks Workflows for orchestrating multi step jobs handling dependencies and monitoring executions in production.
- Bring solid understanding of data warehousing concepts dimensional modeling and best practices for structuring analytics ready data in lakehouse environments.
- Apply strong skills in debugging unit testing and automated validation to ensure that data pipelines are resilient maintainable and easy to enhance.
- Demonstrate effective communication abilities to collaborate with cross functional teams in a hybrid work model and to explain technical concepts in accessible language.
- Display familiarity with version control practices and collaborative development workflows that support code review branching strategies and continuous integration.
- Value inclusive and ethical data practices ensuring that data solutions support responsible decision making and contribute to positive outcomes for customers and communities.
Certifications Required
À propos de Cognizant
Cognizant (NASDAQ : CTSH) est un AI Builder et une entreprise de services numériques (ESN) élaborant des solutions complètes d’IA maximisant les investissements pour des résultats concrets. Sa profonde expertise des métiers, des processus et des technologies lui permet d’intégrer dans les systèmes technologiques le contexte unique de chaque organisation de l’ingénierie à la production à l’échelle. Son objectif : améliorer l’efficacité des équipes, créer de la valeur et permettre aux grandes entreprises de rester performantes dans un monde qui évolue rapidement. Pour en savoir plus : cognizant.ai ou @cognizant.
Renseignments suppplémentaires sur l'emploi
Les informations relatives à la rémunération du poste à pourvoir dépendent de la date de publication de l’offre de poste. Cognizant se réserve le droit de modifier ces informations à tout moment, sous réserve des lois applicables.
Cognizant est un employeur soucieux de l'égalité des chances entre candidats. Votre candidature sera étudiée indépendamment de votre race, couleur, sexe, religion, croyances, orientation sexuelle, identité de genre, origine, handicap, informations génétiques, grossesse, statut d'ancien militaire ou de toute autre critère jugé discriminant par les lois européennes ou françaises.
Vous êtes porteur d'un handicap, vous pouvez-nous contacter par courriel [email protected] si vous souhaitez préciser les aménagements nécessaires pour le poste ou les entretiens à venir.
Les candidats peuvent être invités à participer à des entretiens en face à face ou par vidéoconférence. En outre, les candidats peuvent être amenés à présenter une carte d'identité valide lors de chaque entretien.
