Job Summary
Design and optimize large scale data processing solutions as a senior developer using Spark and AWS based services in a hybrid work arrangement. Apply advanced expertise in Spark optimization AWS Glue EMR Redshift S3 IAM and CloudWatch to build reliable data pipelines and analytical platforms. Collaborate with cross functional teams in day shifts to deliver secure efficient and business aligned data products that support strategic decision making.
Responsibilities
Design and implement scalable data processing pipelines using Apache Spark and AWS Glue to efficiently transform and prepare data for analytics and reporting across the organization.Optimize Spark jobs by tuning configurations improving partition strategies and refining data formats to consistently reduce runtime control resource consumption and improve overall reliability of data workflows.Build and manage AWS EMR clusters to run complex distributed data processing workloads while maintaining cost efficiency and ensuring high performance for critical business processes.Develop robust data ingestion and storage solutions using Amazon S3 as the central data lake enforcing folder structures and retention practices that support governance reusability and efficient querying.Create and maintain analytical data models in Amazon Redshift that enable fast and accurate reporting ensuring proper distribution keys sort keys and compression settings are applied for query performance optimization.Configure and maintain AWS CloudWatch monitoring for data pipelines and compute resources setting up detailed metrics and alarms that enable proactive detection and resolution of operational issues before they impact business stakeholders.Administer AWS IAM policies for data engineering components to ensure secure access control applying fine grained permissions that protect sensitive data while allowing teams to work efficiently within approved boundaries.Collaborate with product owners analysts and engineering peers during hybrid work days to gather requirements refine technical designs and deliver high quality data solutions that directly support strategic business initiatives.Review and refactor existing data processing code to improve readability performance and maintainability mentoring less experienced developers by sharing best practices in Spark optimization and cloud native development.Document data flows transformation logic and operational procedures in clear technical references that enable future enhancements onboarding of new team members and transparent communication with audit and compliance functions.Troubleshoot complex production incidents in day shift schedules by analyzing logs metrics and data anomalies applying structured problem solving to restore service quickly and prevent recurrence through targeted improvements.Contribute to continuous improvement of the data platform by evaluating new AWS features and data engineering techniques recommending adoption paths that increase reliability scalability and positive impact on business and society.Align daily development activities with the company purpose by building data solutions that support ethical decision making enable better customer experiences and improve operational efficiency in a sustainable manner.
Qualifications
Possess around ten to twelve years of professional experience as a data focused developer working on large scale distributed systems with a strong track record of delivering stable and performant solutions.Demonstrate deep hands on expertise in Apache Spark optimization including experience with partitioning strategies caching approaches broadcast joins and efficient use of data formats such as parquet.Show advanced practical knowledge of AWS Glue for building serverless data integration jobs including authoring scripts configuring crawlers and managing glue data catalogs for structured and semi structured data.Apply strong working experience with AWS EMR clusters for running Spark workloads including cluster sizing auto scaling configurations and integration with S3 based data lakes.Exhibit solid experience with Amazon Redshift for designing analytical schemas tuning queries and managing workload patterns to serve reporting and dashboarding needs quickly and reliably.Use Amazon S3 in depth for organizing data repositories applying lifecycle policies and supporting data governance and access patterns suitable for large enterprise environments.Implement secure and compliant solutions with AWS IAM by defining roles and policies that restrict access appropriately for data compute and monitoring resources in a complex cloud environment.Employ AWS CloudWatch proficiently for logging metrics and alerts creating actionable dashboards and notifications that help sustain high availability and timely response to anomalies.Communicate effectively with cross functional teams in a hybrid work setting demonstrating clear verbal and written skills that support collaborative design estimation and delivery of data solutions.Adapt quickly to evolving business requirements and technology advancements in the data engineering space showing curiosity and commitment to continuous learning and improvement.
À propos de Cognizant
Cognizant (NASDAQ : CTSH) est un AI Builder et une entreprise de services numériques (ESN) élaborant des solutions complètes d’IA maximisant les investissements pour des résultats concrets. Sa profonde expertise des métiers, des processus et des technologies lui permet d’intégrer dans les systèmes technologiques le contexte unique de chaque organisation de l’ingénierie à la production à l’échelle. Son objectif : améliorer l’efficacité des équipes, créer de la valeur et permettre aux grandes entreprises de rester performantes dans un monde qui évolue rapidement. Pour en savoir plus : cognizant.ai ou @cognizant.
Renseignments suppplémentaires sur l'emploi
Les informations sur la rémunération sont exactes à la date de publication. Cognizant se réserve le droit de modifier ces informations à tout moment, conformément aux lois applicables.
Les exigences linguistiques varient selon les postes, mais nous demandons à tous les candidats d’avoir une connaissance de base de l’anglais afin de faciliter les communications internes à l’échelle de l’entreprise. Pour les postes basés au Québec, une maîtrise de l’anglais est requise puisque vous fournirez des services et collaborerez avec des parties prenantes situées hors de la province, qui ne parlent pas nécessairement le français.
Cognizant est un employeur souscrivant au principe de l’égalité d’accès à l’emploi. Votre candidature et votre dossier ne seront pas examinés en fonction de la race, de la couleur, du sexe, de la religion, des croyances, de l'orientation sexuelle, de l'identité de genre, de l'origine nationale, du handicap, de l'information génétique, de la grossesse, du statut d'ancien combattant ou de toute autre caractéristique protégée telle que décrite par les lois fédérales, provinciales ou locales.
Si vous avez un handicap qui nécessite un aménagement raisonnable pour rechercher une offre d'emploi ou poser une candidature, envoyiez un courriel à [email protected] avec votre demande et vos coordonnées.
