Job Summary
Serve as a senior developer specializing in Spark in Scala and Azure Synapse to design build and optimize large scale data engineering solutions that power analytics and digital products. Collaborate in a hybrid work model with cross functional teams to deliver secure reliable and observable pipelines while leveraging Azure DevOps and cloud native services to support business value including media domain scenarios.
Responsibilities
- Design scalable batch and streaming data solutions using Spark in Scala and PySpark to support complex analytical workloads and reusable data products for enterprise stakeholders in a hybrid work environment.
- Develop robust Synapse Pipelines that orchestrate ingestion transformation and publishing of structured and semi structured data from diverse sources into optimized analytical data stores.
- Implement Structured Streaming jobs that process near real time data feeds to enable event driven analytics and timely business insights while maintaining reliability and consistency.
- Configure and optimize Azure Synapse Spark Pool and Serverless SQL Pool to deliver cost efficient query performance and responsive data exploration capabilities for data consumers.
- Write efficient SQL and Python code that adheres to coding standards while implementing reusable data transformation logic and ensuring maintainable modular solutions.
- Use Azure CLI and Azure PowerShell to automate environment provisioning configuration changes and deployment tasks that improve consistency and reduce manual effort.
- Set up and manage Azure Event Hub integrations that capture streaming events and route them into Synapse based processing pipelines with robust error handling and observability.
- Configure Azure Monitor alerts metrics and logs that track pipeline health performance and failures to support proactive detection and quick resolution of production issues.
- Implement secure secrets and credential management practices using Azure Key Vault to protect sensitive data while enabling safe automation and continuous delivery workflows.
- Use Azure DevOps to design and maintain continuous integration and continuous delivery pipelines that enforce quality gates testing and automated deployment of data solutions.
- Collaborate with architects data modelers and product partners to translate complex business requirements including media domain needs into scalable technical designs and implementation tasks.
- Document data flows transformation logic operational runbooks and support guidelines that help teams understand operate and extend the implemented solutions over time.
- Provide technical guidance and code reviews for peers by sharing best practices in Spark optimization Synapse development security and monitoring to uplift overall team capability.
- Drive continuous improvement initiatives that enhance data reliability performance and developer productivity by introducing new patterns tools and process refinements aligned with organizational goals.
Qualifications
- Possess eight to twelve years of professional experience in data engineering or software development with a primary focus on cloud based big data platforms and large scale analytics solutions.
- Demonstrate deep hands on expertise in Spark in Scala and PySpark including performance tuning partitioning strategies job optimization and troubleshooting of distributed processing workloads.
- Have strong practical experience building complex Synapse Pipelines and notebooks that integrate multiple Azure services and implement end to end data ingestion and transformation processes.
- Exhibit proficiency with Azure Synapse Spark Pool and Serverless SQL Pool including workspace configuration resource management and query optimization for analytical use cases.
- Show advanced skills in SQL and Python applied to data transformation data quality enforcement and analytical dataset preparation in large enterprise environments.
- Bring practical experience with Azure CLI and Azure PowerShell scripting to automate operational tasks infrastructure configuration and deployment of repeatable environments.
- Demonstrate familiarity with Azure Event Hub Structured Streaming and related technologies for implementing near real time and event driven data solutions.
- Show working knowledge of Azure Monitor and related observability tools for setting up dashboards alerts and diagnostics that support production grade monitoring of pipelines.
- Have solid experience with Azure DevOps including repositories pipelines and artifacts to implement continuous integration and continuous delivery for data projects.
- Demonstrate strong understanding of security practices using Azure Key Vault role based access controls and encryption to protect data and credentials across environments.
- Bring domain exposure in media or content centric industries where audience analytics streaming telemetry or digital engagement data are central to business decisions considered a plus.
- Communicate clearly with cross functional teams manage work in a hybrid model and adapt to evolving priorities while maintaining focus on quality reliability and business outcomes.
Over Cognizant
Cognizant (NASDAQ: CTSH) is een bouwer van AI-oplossingen en een leverancier van technologiediensten. Wij slaan de brug tussen AI-investeringen en ondernemingswaarde door het bouwen van full-stack AI-oplossingen voor onze klanten. Onze diepgaande kennis van sectoren, processen en engineering stelt ons in staat om de unieke context van een organisatie te verankeren in technologische systemen. Deze systemen versterken het menselijk potentieel, realiseren tastbare resultaten en geven wereldwijde ondernemingen een voorsprong in een snel veranderende wereld. Ontdek hoe op cognizant.ai of @cognizant.
Aanvullende arbeidsinformatie
De informatie over de beloning is correct op de datum van deze vacature. Cognizant behoudt zich het recht voor om deze informatie op elk moment te wijzigen, met inachtneming van de toepasselijke wetgeving.
Van sollicitanten kan worden verwacht dat zij gesprekken bijwonen, persoonlijk of via een videogesprek. Daarnaast kan van kandidaten worden gevraagd om tijdens elk gesprek een geldig, door de overheid uitgegeven identiteitsbewijs (zoals een identiteitskaart of paspoort) te tonen.
Cognizant is een werkgever die gelijke kansen biedt. Je sollicitatie en kandidatuur worden niet beoordeeld op basis van ras, huidskleur, geslacht, religie, levensovertuiging, seksuele geaardheid, genderidentiteit, nationale afkomst, handicap, genetische informatie, zwangerschap, veteranenstatus of enige andere eigenschap die wordt beschermd door federale, regionale of lokale wetgeving.
