Databricks + Pyspark

Job Summary

Sr Developer with ten to fourteen years of experience will design build and optimize data engineering solutions using Databricks Apache Spark and Palantir Foundry for complex Medicare and Medicaid claims processing in a hybrid work model. The role enables reliable analytics for care quality compliance and cost optimization in a day shift setting without travel requirements.

Responsibilities

• Design scalable data pipelines on Databricks to ingest transform and curate Medicare and Medicaid claims data so that downstream analytics and reporting systems operate with trusted and timely information
• Develop high performance Apache Spark jobs to process large volumes of structured and semi structured healthcare data and ensure that batch and near real time workloads meet strict service level objectives
• Build robust data models and assets in Palantir Foundry to support claims adjudication analysis payment integrity reviews and utilization management while aligning to enterprise data governance practices
• Optimize Spark and Databricks workloads by tuning storage formats cluster configurations and execution plans to reduce compute costs and improve throughput for critical actuarial and operational dashboards
• Implement data quality rules validation frameworks and automated monitoring for claims data to detect anomalies ensure regulatory compliance and provide reliable inputs for clinical and financial decision making
• Collaborate with product owners business analysts and claims operations teams to translate complex Medicare and Medicaid policy requirements into clear technical specifications and reusable data components
• Create reusable data engineering patterns and documentation for ingestion transformation and publishing layers so that other developers can rapidly extend capabilities across new claims programs and reporting initiatives
• Integrate security and privacy controls into all data solutions including role based access control encryption and audit logging to protect member information and support organizational compliance with healthcare regulations
• Coordinate with cloud infrastructure and platform teams to plan capacity manage environments and ensure that Databricks Apache Spark and Foundry solutions remain stable resilient and aligned with enterprise architecture standards
• Automate testing deployment and release processes using continuous integration and continuous delivery practices so that data products for claims analytics can be promoted across environments with minimal risk and downtime
• Provide advanced troubleshooting and root cause analysis for data incidents affecting claims feeds metrics or regulatory reports and implement corrective actions that prevent recurrence and strengthen platform reliability
• Guide junior developers through code reviews design discussions and knowledge sharing sessions focused on data engineering best practices in Databricks Spark and Foundry ensuring consistent delivery quality across the team
• Engage with stakeholders to present solution options explain technical tradeoffs and gather feedback so that data products for Medicare and Medicaid claims remain relevant useful and aligned with business objectives

Qualifications

• Demonstrate deep hands on expertise in Databricks including notebooks jobs clusters and workspace management to deliver complex data engineering solutions for healthcare claims processing
• Apply advanced Apache Spark knowledge in batch and streaming scenarios covering performance tuning data partitioning and error handling to support large scale Medicare and Medicaid analytics
• Use strong proficiency with Palantir Foundry including ontology design pipelines and data set management to create reliable analytical assets for claims operations and payment integrity functions
• Exhibit thorough understanding of Medicare and Medicaid claims structures coding guidelines and adjudication workflows to ensure that data models and transformations accurately reflect business realities
• Leverage solid experience in SQL and data warehousing concepts to design clear semantic layers and reporting views that simplify access to claims metrics for analytics and business users
• Utilize practical experience with cloud based data platforms and related ecosystem tools to integrate Databricks Spark and Foundry solutions into broader enterprise architectures for healthcare organizations
• Apply good knowledge of version control practices testing strategies and continuous integration pipelines so that data engineering artifacts remain maintainable traceable and easy to evolve over time

Things to know before you apply

• Work authorization: Cognizant will only consider applicants for this position who are legally authorized to work in Canada without requiring employer sponsorship, now or at any time in the future.
• Accommodations: If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email [email protected] with your request and contact information.
• AI in hiring: We use artificial intelligence (AI) tools to help us screen and assess applications more efficiently. Our team performs additional human review and ultimately decides who moves forward in our hiring process.
• Open position: Unless otherwise stated, this job posting is for an open position on our team.
• Language proficiency: We ask that all candidates have basic English proficiency for company-wide communications purposes. For roles based in Quebec, professional English proficiency is required, as you’ll deliver services to and collaborate with stakeholders outside the province who may not speak French.
• Inclusion: Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, provincial or local laws.

About Cognizant
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, bridging the gap between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, drive tangible outcomes and keep global enterprises ahead in a fast-changing world. See how at cognizant.ai or @cognizant.