Job Summary
Key Responsibilities
- Design, build and maintain batch and real-time data pipelines.
- Develop data products using Databricks Lakeflow Declarative Pipelines, PySpark and SQL.
- Build streaming solutions using Spark Structured Streaming and Lakeflow declarative pipelines
- Optimise pipelines for scalability, reliability and performance.
- Develop automated tests and participate in code reviews.
- Contribute to CI/CD and engineering best practices.
- Monitor, troubleshoot and support production workloads.
- Use AI-assisted development tools to improve productivity while maintaining high engineering standards.
Essential Skills
- Databricks
- Lakeflow Declarative Pipelines and DXQ, DB Genie, MCP Server
- Apache Spark (PySpark)
- Spark Structured Streaming
- Auto Loader
- Unity Catalog
- Python
- SQL
- Delta Lake
- Azure Event Hubs or equivalent event streaming platforms
- Git and collaborative development workflows
- Unit testing
- CI/CD
- Strong analytical and problem-solving skills
Nice to Have
- Performance tuning and Spark optimisation
- Data modelling
- Azure DevOps
- AI coding assistants (GitHub Copilot, Cursor or similar)
- Experience working in Agile or SAFe environments
We're looking for an engineer who:
- Takes ownership from design through production support.
- Writes clean, maintainable and well-tested code.
- Builds reusable, production-ready solutions.
- Collaborates effectively with teammates and stakeholders.
- Continuously learns and embraces modern engineering practices.
关于高知特 (Cognizant)
高知特(Cognizant)（纳斯达克代码：CTSH）作为一家AI Builder和相关技术服务提供商，致力于通过打造全栈AI解决方案，帮助企业将人工智能投资转化为实际价值。公司凭借深厚的行业经验、流程优化和工程技术专长，将企业独特的业务场景融入科技系统，赋能组织释放人才潜能，推动切实成果，并帮助全球企业在瞬息万变的环境中保持领先。如需了解更多详情，敬请访问 cognizant.ai 或关注@cognizant。
补充雇佣信息
薪酬信息截至本职位发布之日为准。Cognizant 保留在适用法律允许的范围内随时修改该信息的权利。
申请人可能需要通过现场面试或视频会议的方式参加面试。此外，候选人在每次面试时可能需要出示其当前所在州或政府签发的有效身份证件。
Cognizant 是一家提供平等就业机会的雇主。在招聘过程中，您的申请和候选资格不会因种族、肤色、性别、宗教、信仰、性取向、性别认同、国籍、残疾、遗传信息、怀孕、退伍军人身份或任何其他受联邦、州或地方法律保护的特征而受到影响。
