Principal AWS Data Engineer
Location : Bangalore
Experience : 9 - 12 years
Job Summary: In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the Data Engineering organisation to design and implement scalable data infrastructure and processes using technologies such as Python, PySpark, EMR Serverless, Iceberg, Glue and Glue Data Catalog. The main goal of this position is to ensure successful migration and establish robust data quality governance across the new platform, enabling reliable and efficient data processing. Success in this role requires deep technical expertise, exceptional problem-solving skills, and the ability to lead and mentor within an agile team.
Must Have Tech Skills:
· Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering a culture of continuous learning and innovation
· Extensive experience in software architecture and solution design, including microservices, distributed systems, and cloud-native architectures.
· Expert in Python and Spark, with a deep focus on ETL data processing and data engineering practices.
· Deep technical knowledge of AWS data services and engineering practices, with demonstrable experience of implementing data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena
· Experience of delivering Lakehouse solutions/architectures
Nice To Have Tech Skills:
· Knowledge of additional programming languages and development tools to provide flexibility and adaptability across varied data engineering projects
· A master’s degree or relevant certifications (e.g., AWS Certified Solutions Architect, Certified Data Analytics) is advantageous
Key Accountabilities:
- Lead complex projects autonomously, fostering an inclusive and open culture within development teams. Mentor team members and lead technical discussions.
- Provides strategic guidance on best practices in design, development, and implementation. Leads the development of high-quality, efficient code and develops necessary tools and applications to address complex business needs
- Collaborates closely with architects, Product Owners, and Dev team members to decompose solutions into Epics, leading the design and planning of these components.
- Drive the migration of existing data processing workflows to a Lakehouse architecture, leveraging Iceberg capabilities.
- Serves as an internal subject matter expert in software development, advising stakeholders on best practices in design, development, and implementation
Key Skills:
- Deep technical knowledge of data engineering solutions and practices. Expert in AWS services and cloud solutions, particularly as they pertain to data engineering practices
- Extensive experience in software architecture and solution design
- Specialized expertise in Python and Spark
- Ability to provide technical direction, set high standards for code quality and optimize performance in data-intensive environments.
- Skilled in leveraging automation tools and Continuous Integration/Continuous Deployment (CI/CD) pipelines to streamline development, testing, and deployment.
- Exceptional communicator who can translate complex technical concepts for diverse stakeholders, including engineers, product managers, and senior executives.
- Provides thought leadership within the engineering team, setting high standards for quality, efficiency, and collaboration. Experienced in mentoring engineers, guiding them in advanced coding practices, architecture, and strategic problem-solving to enhance team capabilities.
Educational Background:
- Bachelor’s degree in computer science, Software Engineering, or a related field is essential.
Bonus Skills:
- Financial Services expertise preferred, working with Equity and Fixed Income asset classes and a working knowledge of Indices.
コグニザントのコミュニティ
コグニザントは、クライアントのビジネス、運営、技術モデルをデジタル時代に合わせて変革する、世界有数のプロフェッショナルサービス企業の一つです。私たちの独自の業界ベースのコンサルティングアプローチは、クライアントがより革新的で効率的なビジネスを構想し、構築し、運営するのを支援します。米国に本社を置くコグニザント（NASDAQ-100のメンバーであり、Forbesの2024年世界最高の雇用者の一つ）は、常に世界で最も称賛される企業の一つに挙げられています。コグニザントがどのようにしてクライアントがデジタルでリードするのを支援しているかについては、www.cognizant.comをご覧ください。
- コグニザントは世界中に300,000+上の社員を擁するグローバルな会社会社です。
- 私たちはより良い方法を考えるだけでなく、それを実現していきます。
- 私たちは正しいことを行うことで、社員、顧客、会社、地域社会に貢献します。
- キャリアを築いていくことができる革新的な環境を育んでいきます。
コグニザントについて
コグニザント（Nasdaq-100: CTSH）は世界有数のプロフェッショナル・サービス企業であり、企業がテクノロジーの近代化、プロセスの再構築、エクスペリエンスの変革を実現し、変化の激しい世界で優位に立てるよう支援しています。
コグニザントは機会均等雇用を実践しています。応募および候補者としての選考は、人種、肌の色、性別、宗教、信条、性的指向、性自認、国籍、障がい、遺伝情報、妊娠、退役軍人としての地位、または連邦法、州法、もしくは地方自治体の法律で保護されているその他の特性に基づいて行われることはありません。
求人情報の検索や応募書類の提出に配慮を必要とする障害をお持ちの方は、[email protected] までご要望と連絡先をお知らせください。
免責事項
報酬情報は、この掲載日現在のものです。コグニザントは、適用される法律に従い、いつでもこの情報を修正する権利を有します。
応募者は面接に直接またはビデオ会議で出席する必要がある場合があります。また、各面接時に身分証明書の提示を求められる場合があります。