Role: Data Engineer
Location: Sheffield (Hybrid - 3 days a week)
Employment: Fulltime
About the Role:
We are looking for an experienced Azure Data Engineer to support the design, development and delivery of modern data platform solutions, with a particular focus on Microsoft Fabric migration and implementation.
You will play a key role in delivering data engineering and migration activities, working closely with engineering teams and stakeholders to deliver high-quality, scalable and well-tested data solutions.
The role requires strong technical expertise across Azure data technologies, alongside the ability to provide technical guidance, communicate effectively and contribute to successful delivery.
Key Responsibilities:
Configure data ingestion processes and solutions.
Lead the execution of Microsoft Fabric migration activities.
Lead and guide migration engineers and QA resources.
Develop Python, PySpark and Spark SQL code for data validation and curation within notebooks.
Create data integration test cases and support testing activities.
Implement and amend data processing and worker pipelines.
Implement data validation and curation rules.
Translate data models and mappings into detailed technical data mappings.
Design and implement data integrations.
Support the implementation and execution of data migration activities.
Perform data analysis and profiling.
Configure Azure DevOps / GitHub environments and CI/CD processes for Azure Data Factory and Databricks code.
Essential Skills & Experience:
We are looking for candidates with:
Strong experience designing and delivering Azure-based data platform solutions.
Experience with technologies including: o Microsoft Fabric o Power Apps o Azure Synapse o Azure Data Factory (ADF) o Databricks o Azure Functions o Azure App Service o Logic Apps
o Azure Kubernetes Service (AKS) o Web Apps
Hands-on expertise in PySpark, SQL and Python.
Good knowledge of real-time streaming applications, preferably including Kafka, Azure Functions or Azure Service Bus.
Strong understanding of Spark processing and performance tuning.
Experience working with file formats and partitioning, including Parquet, JSON, XML and CSV.
Experience with Azure DevOps / GitHub and CI/CD.
Strong programming experience in Python, with knowledge of other programming languages beneficial.
Experience with both synchronous and asynchronous interface approaches.
Knowledge of data modelling, including 3NF, dimensional modelling and Data Vault 2.0.
Experience working within Agile delivery environments.
Ability to produce comprehensive technical documentation.
Ability to set and manage realistic expectations around timescales, costs, benefits and measures of success.
Power BI experience is desirable.
The role requires experience across the following skill areas:
Data Engineering
Software Design
Analytics
Data Management
Data Modelling and Design
Data Visualisation
Database Design
Release and Deployment
Nice to Have
Experience integrating and implementing data cataloguing tools such as Azure Purview / Collibra.
Experience implementing and integrating visualisation tools such as Power BI or Tableau.
Experience with C# application development, including ASP.NET MVC.
关于高知特 (Cognizant)
高知特(Cognizant)（纳斯达克代码：CTSH）作为一家AI Builder和相关技术服务提供商，致力于通过打造全栈AI解决方案，帮助企业将人工智能投资转化为实际价值。公司凭借深厚的行业经验、流程优化和工程技术专长，将企业独特的业务场景融入科技系统，赋能组织释放人才潜能，推动切实成果，并帮助全球企业在瞬息万变的环境中保持领先。如需了解更多详情，敬请访问 cognizant.ai 或关注@cognizant。
补充雇佣信息
薪酬信息截至本职位发布之日为准。Cognizant 保留在适用法律允许的范围内随时修改该信息的权利。
申请人可能需要通过现场面试或视频会议的方式参加面试。此外，候选人在每次面试时可能需要出示其当前所在州或政府签发的有效身份证件。
Cognizant 是一家提供平等就业机会的雇主。在招聘过程中，您的申请和候选资格不会因种族、肤色、性别、宗教、信仰、性取向、性别认同、国籍、残疾、遗传信息、怀孕、退伍军人身份或任何其他受联邦、州或地方法律保护的特征而受到影响。
