Job Summary
Serve as an architect for data and analytics solutions built on Databricks platforms designing scalable pipelines and frameworks that leverage Databricks SQL Databricks Workflows and PySpark. Apply extensive experience to optimize hybrid day shift delivery enable reliable insights for stakeholders and support innovation in insurance focused business environments.
Responsibilities
Design robust data architecture on Databricks platforms that aligns with enterprise standards and enables secure scalable analytics across hybrid work environmentsDevelop end to end data pipelines using PySpark and Databricks Workflows that transform complex raw data into curated datasets ready for business consumptionOptimize Databricks SQL queries and data models to improve performance reduce compute cost and ensure consistent response times for analytical workloadsCreate reusable frameworks and patterns for ingestion transformation and data quality that can be adopted by engineering teams across multiple initiativesCollaborate with product and business stakeholders to translate analytical and reporting needs into well defined data architecture and implementation plansIntegrate data from diverse source systems into unified models that support actuarial analysis financial reporting and operational monitoring for insurance focused solutionsDefine standards for coding testing and documentation of PySpark jobs and Databricks assets to promote maintainability and long term platform resilienceImplement monitoring and alerting strategies on Databricks Workflows to ensure timely detection of pipeline failures and to support reliable data delivery in day shift operationsPartner with security and compliance teams to embed data governance privacy controls and audit readiness into all Databricks based solutionsGuide teams on efficient use of Databricks clusters storage and caching options to balance performance objectives with infrastructure cost managementDocument architectural decisions data flows and dependency maps so that teams can easily understand solution design and support future enhancementsCoordinate with cross functional teams in a hybrid work model to plan releases manage dependencies and ensure smooth deployment of new data capabilities
Qualifications
Apply extensive experience in Databricks SQL to design analytical models reporting layers and interactive queries that support complex business insightsLeverage advanced proficiency in Databricks Workflows to orchestrate jobs manage dependencies and automate data operations with strong reliabilityUtilize deep PySpark expertise to implement scalable transformations handle large data volumes and enforce data quality rules across the pipeline lifecycleDraw on knowledge of life and annuities insurance to shape data models metrics and validations that reflect key policy claim and risk concepts when requiredDemonstrate proven ability gained from twelve to sixteen years of experience in data engineering and architecture to handle complex enterprise grade solutionsApply strong communication and collaboration capabilities to work effectively with business and technology partners in a hybrid non travel environmentUse experience with modern data platforms and cloud ecosystems to integrate Databricks solutions into broader enterprise architectures for long term value
Certifications Required
Preferred certifications include Databricks Certified Data Engineer Professional or Databricks Certified Data Engineer Associate.
About Cognizant:
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, bridging the gap between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, drive tangible outcomes and keep global enterprises ahead in a fast-changing world. See how at cognizant.ai or @cognizant.
Additional employment information
Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.
Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.
