Job Summary
Architect role requiring 10 to 14 years of experience in designing and governing Databricks based data platforms using Unity Catalog Python Databricks SQL Delta Lake Workflows and PySpark with a strong focus on Property and Casualty Insurance analytics operating in a hybrid work model during day shifts with no travel requirements while ensuring secure and scalable data solutions.
Responsibilities
Design and implement scalable Databricks platforms that support complex analytics and reporting needs for Property and Casualty Insurance portfolios to improve underwriting and claims insightsConfigure and administer Databricks Unity Catalog to provide consistent data governance access control and lineage across multiple workspaces and hybrid environmentsDevelop robust data ingestion and transformation pipelines using PySpark to integrate policy claims billing and external data sources into Delta Lake with high reliabilityAuthor optimized Databricks SQL queries and data models that support actuarial analysis risk scoring pricing optimization and operational reporting for insurance stakeholdersCreate and manage Databricks Workflows to orchestrate end to end batch and near real time data pipelines ensuring predictable execution and timely data availabilityBuild reusable Python utilities and frameworks for data validation monitoring error handling and performance tuning across the Databricks platform to enhance maintainabilityEstablish and document standards for Delta Lake design including table formats partitioning strategies schema evolution and data quality rules tailored to insurance data domainsCollaborate with cross functional teams including data engineers data scientists actuaries and product partners to translate insurance business requirements into technical Databricks solutionsImplement security and compliance controls in Databricks using Unity Catalog features to protect sensitive insurance data such as policyholder information and regulatory datasetsPerform performance optimization and cost management activities including cluster configuration job tuning and workload segregation to achieve efficient use of compute resourcesGuide peers on best practices for Databricks CLI usage to automate deployments configuration management and environment setup in controlled and auditable waysCreate clear architecture diagrams runbooks and technical documentation to support operations support teams and future enhancements of the Databricks platformDrive continuous improvement initiatives by analyzing platform metrics incident trends and user feedback to enhance reliability usability and business value of the data platform
Qualifications
Require extensive experience in Databricks Unity Catalog administration including access policies catalog structures and governance practices for enterprise environmentsRequire hands on proficiency with Databricks CLI Python and PySpark for building automated deployment scripts data pipelines and platform management utilitiesRequire strong experience with Databricks SQL and Delta Lake for designing high performance data models and queries that serve insurance analytics and reporting needsRequire proven background in Property and Casualty Insurance data domains covering policy claims exposure rating and regulatory reporting to ensure relevant solution designRequire experience operating in hybrid work environments and collaborating across distributed teams using modern communication and project tracking toolsNice to have familiarity with cloud native services related to storage networking and identity that integrate with Databricks platforms in large multinational organizationsNice to have exposure to data quality frameworks observability tools and metadata management solutions that complement Unity Catalog and enhance platform trust
Certifications Required
Good to have Databricks Certified Data Engineer Professional or equivalent Databricks Architect level certification is preferred
What we offer
- The chance to work with impact. Here, you’re empowered to bring your biggest thinking to help our company and clients improve everyday life.
- Ownership over your career. Stay at the top of your game through our award-winning learning and development ecosystem. And when your ambitions change or we offer new opportunities, we help you pivot by providing reskilling, on-the-job learning and guidance to find new roles that might be a better fit.
- The opportunity to thrive on a high caliber team with heart. We celebrate each other’s experiences and perspectives and promote a sense of belonging through our affinity groups and diversity and inclusion initiatives.
- A comprehensive total rewards package, including a competitive salary and a pension plan with matching contributions.
- Flexible health and financial benefits to support you and your eligible dependents—from day one.
- True work-life balance. Be at your best through paid time off, flexible work arrangements, volunteering opportunities, social events, and so much more.
About us
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, building the bridge between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, realize tangible returns and keep global enterprises ahead in a fast-changing world. See how at www.cognizant.com or @cognizant.
Other employment-related information
Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, provincial or local laws.
If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email [email protected] with your request and contact information.
Language requirements vary depending on roles, but we ask that all candidates have basic English proficiency for company-wide communications purposes. For roles based in Quebec, professional English proficiency is required, as you’ll deliver services to and collaborate with stakeholders outside the province who may not speak French.