Data Platform Engineering Lead - AITDS

Data Platform Engineering Lead

Level: M / SA

Role Overview

A hands-on technical lead responsible for building AI-ready enterprise data platforms, including scalable pipelines, lakehouse architectures, and governed data foundations that enable model training, evaluation, and inference. The role extends to backend services and integration layers that expose curated datasets, feature stores, and data products for AI/ML and LLM-driven applications.

Key Responsibilities

1. Build & Deploy Data Platform Solutions

· Design and develop data pipelines for batch and streaming workloads using Python and Spark/PySpark

· Build and manage AI-ready datasets, feature pipelines, and training data foundations

· Develop backend services and APIs (Python – FastAPI or equivalent) to expose data products

· Implement microservices and event-driven architectures for data ingestion, processing, and serving

· Ensure the platform is scalable, performant, and maintainable

· Mentor engineers on data engineering patterns and best practices.

2. Enable AI/ML & LLM Integration

· Develop AI-ready pipelines for model training, evaluation, and inference

· Enable feature store capabilities and reproducible datasets

· Support integration with LLM/AI services (RAG, embeddings, inference APIs)

· Enable data-to-AI pipelines including vectorization and retrieval workflows.

3. Oversee Implementation on Cloud Infrastructure

· Collaborate with infra teams on Azure, AWS, or GCP

· Build and integrate data lakes, lake-houses, SQL/NoSQL systems

· Enable integration between data platforms and AI/ML systems

· Implement containerized and serverless architectures.

4. Implement Modern Software Engineering Practices

· Implement CI/CD pipelines and observability

· Define and enforce data quality frameworks

· Support metadata, lineage, and governance

· Optimize platform performance, reliability, and scalability.

Required Capabilities / Skills / Experience

· 8+ years in data engineering and backend development

· Strong Python, APIs, and microservices experience

· Deep experience in Spark/PySpark or equivalent

· Expertise in ETL/ELT pipelines and lakehouse architectures

· Experience with feature stores and AI-ready datasets

· Experience with Azure/AWS/GCP

· Familiarity with Docker, Kubernetes, CI/CD

· Familiarity with LLM/GenAI integration patterns

· Familiarity with metadata and governance tooling

· Strong system design and problem-solving skills.

关于高知特 (Cognizant)
高知特(Cognizant)（纳斯达克代码：CTSH）作为一家AI Builder和相关技术服务提供商，致力于通过打造全栈AI解决方案，帮助企业将人工智能投资转化为实际价值。公司凭借深厚的行业经验、流程优化和工程技术专长，将企业独特的业务场景融入科技系统，赋能组织释放人才潜能，推动切实成果，并帮助全球企业在瞬息万变的环境中保持领先。如需了解更多详情，敬请访问 cognizant.ai 或关注@cognizant。

补充雇佣信息
薪酬信息截至本职位发布之日为准。Cognizant 保留在适用法律允许的范围内随时修改该信息的权利。
申请人可能需要通过现场面试或视频会议的方式参加面试。此外，候选人在每次面试时可能需要出示其当前所在州或政府签发的有效身份证件。
Cognizant 是一家提供平等就业机会的雇主。在招聘过程中，您的申请和候选资格不会因种族、肤色、性别、宗教、信仰、性取向、性别认同、国籍、残疾、遗传信息、怀孕、退伍军人身份或任何其他受联邦、州或地方法律保护的特征而受到影响。