跳到主要內容

Databricks+spark

00069598791

Skill: Azure databricks

Experience: 6 to 12 years

Location: AIA Chennai

Job Summary

Architect role in a global organization focusing on end to end design and optimization of data platforms using Databricks SQL Databricks Workflows and PySpark. The architect will shape hybrid model solutions that support business analytics ensure scalable performance and drive efficient data engineering practices while mentoring teams and aligning platforms with enterprise standards.


Responsibilities

  • Design robust Databricks based data platform architectures that enable scalable analytics and reporting for complex enterprise use cases and align with long term business growth objectives.
  • Drive end to end solution design using Databricks SQL and PySpark to optimize data ingestion transformation and consumption flows that deliver consistent performance for diverse workloads.
  • Define standardized patterns and reusable components for Databricks Workflows that improve orchestration reliability simplify maintenance and reduce operational overhead across multiple projects.
  • Collaborate with data engineers analysts and product teams in a hybrid work environment to translate business needs into technical blueprints that ensure clear traceability from requirement to implementation.
  • Establish governance practices for data quality security and compliance on Databricks platforms that support responsible data usage and protect sensitive information across regions.
  • Optimize SQL queries PySpark jobs and cluster configurations to reduce processing time and cost while maintaining high availability and resilience for critical data applications.
  • Guide teams on best practices for version control environment management and deployment pipelines so that Databricks solutions are consistently delivered with predictable quality.
  • Review solution designs and technical deliverables for complex data initiatives to identify risks propose improvements and ensure alignment with architectural standards and organizational guidelines.
  • Coordinate with infrastructure and cloud operations stakeholders to ensure Databricks environments are correctly sized monitored and tuned for day shift usage patterns without requiring travel.
  • Promote data engineering excellence through documentation technical knowledge sharing and coaching that help colleagues build stronger skills in Databricks SQL Workflows and PySpark.
  • Engage with business sponsors to explain architectural decisions in clear terms demonstrating how the data platform improves decision making and contributes to broader societal value through better insights.
  • Assess new features and capabilities in the Databricks ecosystem and recommend pragmatic adoption strategies that balance innovation stability and regulatory considerations.
  • Monitor production platforms and incident trends to drive continuous improvement initiatives that enhance reliability reduce defects and protect the organization reputation.


Qualifications

  • Possess extensive experience of twelve to sixteen years in data architecture or advanced data engineering roles with a strong focus on modern cloud based analytic platforms.
  • Demonstrate expert level proficiency in Databricks SQL including complex query design performance tuning and implementation of data models for large scale analytical workloads.
  • Show deep hands on capability in PySpark for building scalable batch and streaming data pipelines that integrate disparate data sources into unified and well structured datasets.
  • Hold strong practical experience designing and managing Databricks Workflows including job orchestration scheduling dependency management and error handling for business critical processes.
  • Exhibit solid understanding of data warehousing lakehouse concepts and distributed computing principles that underpin resilient architectures for enterprise analytics.
  • Display experience working in hybrid work models with global teams using collaborative tools and structured communication practices that keep projects aligned and efficient.
  • Bring familiarity with cloud security data governance and regulatory considerations so that architecture decisions safeguard data assets and meet organizational policies.
  • Prefer exposure to adjacent tools such as data catalog solutions and mainstream visualization platforms that consume outputs produced from Databricks environments.
  • Value clear documentation architectural diagrams and concise technical narratives that improve knowledge transfer and reduce onboarding time for new project members.

关于高知特 (Cognizant)
高知特(Cognizant)(纳斯达克代码:CTSH)作为一家AI Builder和相关技术服务提供商,致力于通过打造全栈AI解决方案,帮助企业将人工智能投资转化为实际价值。公司凭借深厚的行业经验、流程优化和工程技术专长,将企业独特的业务场景融入科技系统,赋能组织释放人才潜能,推动切实成果,并帮助全球企业在瞬息万变的环境中保持领先。如需了解更多详情,敬请访问 cognizant.ai 或关注@cognizant。

补充雇佣信息
薪酬信息截至本职位发布之日为准。Cognizant 保留在适用法律允许的范围内随时修改该信息的权利。
申请人可能需要通过现场面试或视频会议的方式参加面试。此外,候选人在每次面试时可能需要出示其当前所在州或政府签发的有效身份证件。
Cognizant 是一家提供平等就业机会的雇主。在招聘过程中,您的申请和候选资格不会因种族、肤色、性别、宗教、信仰、性取向、性别认同、国籍、残疾、遗传信息、怀孕、退伍军人身份或任何其他受联邦、州或地方法律保护的特征而受到影响。

帮助您蓬勃发展与成长的福利

我们的福利计划以您为中心打造——帮助您享受充实、平衡且健康的生活。
有葉子的植物的藍色線條圖

财务健康

我们会定期审查市场数据,确保薪酬体现您所带来的价值。您的福利不仅限于薪资,还可能包括退休计划、财务教育等。

Stay Healthy Midnight Blue RGB

身心健康

我们通过带薪休假、在条件允许下的灵活工作安排、医疗保障计划、心理咨询、心理健康盟友计划等,赋能您将身心健康放在首位。

Build The Career You Want Midnight Blue RGB

您的职业发展,由您做主

在 Cognizant 提供的 35 万多个岗位中,您将有机会探索新的技术、行业和工作地点,并打造推动职业发展的关键技能。

Making A Meaningful Impact Midnight Blue RGB

现实世界的影响力

想想您所依赖的那些知名品牌。很可能,他们也依赖我们来帮助强化其业务。在这里,您将把大胆的想法转化为改善全球生活的解决方案。

还没有找到合适的机会吗?

获取为您量身定制的最新职位机会、招聘活动和公司新闻!

掌握最新动态