Skip to main content

Databricks + Pyspark

00070508572

Title: AIA - Chennai - Weekend In person Drive.
Skill: Azure Databricks+Pyspark.
Experience: 6 to 11 years.
Location: Chennai.

Job Summary

Sr Developer with ten to fourteen years of experience will design build and optimize data engineering solutions using Databricks Apache Spark and Palantir Foundry for complex Medicare and Medicaid claims processing in a hybrid work model. The role enables reliable analytics for care quality compliance and cost optimization in a day shift setting without travel requirements.

Responsibilities

  • Design scalable data pipelines on Databricks to ingest transform and curate Medicare and Medicaid claims data so that downstream analytics and reporting systems operate with trusted and timely information
  • Develop high performance Apache Spark jobs to process large volumes of structured and semi structured healthcare data and ensure that batch and near real time workloads meet strict service level objectives
  • Build robust data models and assets in Palantir Foundry to support claims adjudication analysis payment integrity reviews and utilization management while aligning to enterprise data governance practices
  • Optimize Spark and Databricks workloads by tuning storage formats cluster configurations and execution plans to reduce compute costs and improve throughput for critical actuarial and operational dashboards
  • Implement data quality rules validation frameworks and automated monitoring for claims data to detect anomalies ensure regulatory compliance and provide reliable inputs for clinical and financial decision making
  • Collaborate with product owners business analysts and claims operations teams to translate complex Medicare and Medicaid policy requirements into clear technical specifications and reusable data components
  • Create reusable data engineering patterns and documentation for ingestion transformation and publishing layers so that other developers can rapidly extend capabilities across new claims programs and reporting initiatives
  • Integrate security and privacy controls into all data solutions including role based access control encryption and audit logging to protect member information and support organizational compliance with healthcare regulations
  • Coordinate with cloud infrastructure and platform teams to plan capacity manage environments and ensure that Databricks Apache Spark and Foundry solutions remain stable resilient and aligned with enterprise architecture standards
  • Automate testing deployment and release processes using continuous integration and continuous delivery practices so that data products for claims analytics can be promoted across environments with minimal risk and downtime
  • Provide advanced troubleshooting and root cause analysis for data incidents affecting claims feeds metrics or regulatory reports and implement corrective actions that prevent recurrence and strengthen platform reliability
  • Guide junior developers through code reviews design discussions and knowledge sharing sessions focused on data engineering best practices in Databricks Spark and Foundry ensuring consistent delivery quality across the team
  • Engage with stakeholders to present solution options explain technical tradeoffs and gather feedback so that data products for Medicare and Medicaid claims remain relevant useful and aligned with business objectives


Qualifications

  • Demonstrate deep hands on expertise in Databricks including notebooks jobs clusters and workspace management to deliver complex data engineering solutions for healthcare claims processing
  • Apply advanced Apache Spark knowledge in batch and streaming scenarios covering performance tuning data partitioning and error handling to support large scale Medicare and Medicaid analytics
  • Use strong proficiency with Palantir Foundry including ontology design pipelines and data set management to create reliable analytical assets for claims operations and payment integrity functions
  • Exhibit thorough understanding of Medicare and Medicaid claims structures coding guidelines and adjudication workflows to ensure that data models and transformations accurately reflect business realities
  • Leverage solid experience in SQL and data warehousing concepts to design clear semantic layers and reporting views that simplify access to claims metrics for analytics and business users
  • Utilize practical experience with cloud based data platforms and related ecosystem tools to integrate Databricks Spark and Foundry solutions into broader enterprise architectures for healthcare organizations
  • Apply good knowledge of version control practices testing strategies and continuous integration pipelines so that data engineering artifacts remain maintainable traceable and easy to evolve over time

About Cognizant: 
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, bridging the gap between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, drive tangible outcomes and keep global enterprises ahead in a fast-changing world. See how at cognizant.ai or @cognizant.

Additional employment information
Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.

Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.

If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email [email protected] for roles based in the Americas or [email protected] for roles based in India.

Benefits that help you thrive and grow

Our benefits program is built with you in mind—so you can enjoy a fulfilling, balanced and healthy life.

a blue line drawing of a plant with leaves

Financial wellbeing

We regularly review market data to ensure compensation reflects the value you bring. Your benefits extend beyond pay and may include retirement plans, financial education, etc.

Stay Healthy Midnight Blue RGB

Physical and mental health

We empower you to prioritize your wellbeing through paid time off, flexible working where possible, healthcare plans, counselling, our Mental Health Allyship program and more. 

Build The Career You Want Midnight Blue RGB

Your career, your way

With 350,000+ roles at Cognizant, you’ll have opportunities explore new technologies, industries and locations—and build the skills you need to grow your career.

Making A Meaningful Impact Midnight Blue RGB

Real-world impact

Think about the biggest brands you rely on. Chances are, they rely on us to help strengthen their business. Here, you’ll turn bold ideas into solutions that improve lives everywhere.

Haven't yet found the right opportunity?

Get the latest updates on job opportunities, recruitment events and company news—tailored just for you!

Be in the know