Job Summary
The Lead AWS Data Engineer provides technical leadership and hands on execution for enterprise data platforms hosted on Amazon Web Services (AWS). This role leads the design migration modernization and operation of cloud native data architectures supporting mission critical financial advisor payout mobility and corporate analytics platforms.
Responsibilities
Role Summary
The Lead AWS Data Engineer provides technical leadership and hands on execution for enterprise data platforms hosted on Amazon Web Services (AWS). This role leads the design migration modernization and operation of cloud native data architectures supporting mission critical financial advisor payout mobility and corporate analytics platforms.
The Lead AWS Data Engineer owns end to end technical decision making for AWS data platforms including architecture security orchestration and production readiness. The role requires deep expertise in AWS data services Python and PySpark development workflow orchestration data lake design infrastructure as code and operational excellence along with the ability to mentor engineers and partner effectively with infrastructure IAM and database teams.
________________________________________
Key Responsibilities
Technical Leadership & Platform Ownership
Serve as the technical lead and design authority for AWS data engineering initiatives across multiple enterprise platforms.
Own architectural decisions related to scalability reliability security and cost optimization of AWS data platforms.
Define and enforce engineering standards coding patterns and operational best practices for cloud data pipelines.
Provide hands on technical guidance design reviews and code reviews for data engineers.
________________________________________
AWS Data Platform Engineering
Lead the design development and support of cloud native data pipelines using Amazon S3 AWS Glue (PySpark) MWAA (Apache Airflow) and AWS Step Functions.
Drive on premises to AWS data platform migrations including reverse engineering of legacy ETL workflows and re implementation using AWS native services.
Re architect legacy Oracle Data Integrator (ODI) based ETL processes into scalable PySpark based Glue jobs.
Optimize Spark workloads for performance memory usage and cost efficiency in AWS Glue environments.
________________________________________
Data Lake Iceberg & Architecture Design
Architect and implement enterprise AWS data lakes using Medallion architecture (Bronze Silver Gold).
Design and manage Apache Iceberg tables to support incremental processing schema evolution and efficient data lake operations.
Establish standardized ingestion transformation and consumption patterns across financial mobility and corporate datasets.
Ensure data quality reconciliation lineage and auditability across all layers of the data platform.
________________________________________
Workflow Orchestration & Automation
Lead orchestration strategy using MWAA (Managed Workflows for Apache Airflow).
Design and implement Airflow DAGs in Python to orchestrate end to end workflows including Glue jobs validations and downstream dependencies.
Implement scheduling retry logic monitoring and failure handling to ensure resilient and scalable pipelines.
Integrate orchestration workflows with AWS services such as S3 Glue Athena Iceberg based data lakes and downstream systems.
________________________________________
Security Infrastructure & AWS Networking
Drive implementation of AWS security best practices including IAM role design least privilege access encryption using AWS KMS and secrets management.
Lead configuration of AWS networking components such as VPC Endpoints (VPCE) to enable secure service to service communication.
Manage infrastructure provisioning using Terraform ensuring repeatable and auditable deployments across DEV QA and PROD environments.
Coordinate with IAM network DevOps and DBA teams to resolve access firewall and Oracle database connectivity challenges.
________________________________________
Production Readiness Operations & Support
Own production readiness for AWS data platforms including configuration secrets access controls and deployment planning.
Act as the escalation point for complex production issues performing root cause analysis and permanent fixes.
Implement logging metrics and alerting using Amazon CloudWatch to meet enterprise SLAs and availability targets.
Support parallel run and hybrid architectures during migration phases to ensure business continuity.
________________________________________
Automation Compliance & Regulatory Enablement
Design and oversee Python based automation solutions supporting operational efficiency and compliance initiatives (e.g. file retention and document processing).
Ensure pipeline designs meet regulatory audit and enterprise governance requirements including traceability and controlled data handling.
________________________________________
Collaboration & Stakeholder Engagement
Partner closely with data architects DevOps teams infrastructure teams and business stakeholders to deliver AWS data solutions aligned with enterprise strategy.
Translate business and platform requirements into scalable technical designs and execution plans.
Produce technical documentation and support knowledge transfer to enable long term platform sustainability.
________________________________________
Required Qualifications
Bachelor degree in Computer Science Engineering or related field (or equivalent practical experience).
Extensive hands on experience designing and leading AWS data engineering solutions.
Proven experience leading or owning on premises to AWS data platform migrations.
Advanced proficiency in Python and PySpark for data processing automation and orchestration.
Strong experience with AWS Glue Amazon S3 MWAA (Airflow) Step Functions CloudWatch and related services.
Experience with Infrastructure as Code preferably Terraform.
Strong understanding of data engineering principles including ETL design data modeling and pipeline optimization.
Demonstrated experience supporting enterprise production grade data platforms.
________________________________________
Preferred / Nice to Have Qualifications (Not Mandatory)
Experience with Apache Iceberg or similar data lake table formats.
Exposure to analytics or BI platforms (e.g. ThoughtSpot Tableau).
Exposure to Oracle databases or legacy ETL tools (e.g. ODI).
Experience in financial services or regulated enterprise environments.
Familiarity with CI/CD practices for data engineering workloads.
________________________________________
Acerca de Cognizant
Cognizant (Nasdaq: CTSH) es un creador de soluciones de IA y proveedor de servicios tecnológicos que conecta la inversión en IA con el valor empresarial mediante el desarrollo de soluciones de IA full‑stack para sus clientes. Su profundo conocimiento de la industria, junto con su experiencia en procesos e ingeniería, permite incorporar el contexto único de cada organización en sistemas tecnológicos que amplifican el potencial humano, generan resultados tangibles y mantienen a las empresas a la vanguardia en un entorno en constante cambio. Más información en cognizant.ai o @cognizant.
Información adicional sobre el empleo
La información sobre la compensación es exacta en la fecha de publicación de este anuncio. Cognizant se reserva el derecho de modificar esta información en cualquier momento, de conformidad con la legislación aplicable.
Es posible que se solicite a los solicitantes que asistan a entrevistas de forma presencial o mediante videoconferencia. Asimismo, durante cada entrevista, los candidatos podrán estar obligados a presentar un documento de identidad válido emitido por el estado o por el gobierno.
Cognizant es un empleador que ofrece igualdad de oportunidades. Su solicitud y candidatura no se evaluarán en función de la raza, el color, el sexo, la religión, el credo, la orientación sexual, la identidad de género, el origen nacional, la discapacidad, la información genética, el embarazo, la condición de veterano ni cualquier otra característica protegida por las leyes federales, estatales o locales.
