Overview
We are seeking a highly skilled Senior Data Engineer with strong expertise in PySpark, SQL, and Databricks to support the design, development, and optimization of large‑scale data pipelines. The ideal candidate will have hands‑on experience with medallion architecture, data quality frameworks, and Spark performance tuning. Healthcare domain knowledge is essential for success in this role.
Key Responsibilities
- Design, build, and maintain scalable data pipelines using PySpark based ETL, SQL, and Databricks.
- Implement and enhance medallion architecture (Bronze/Silver/Gold) for structured, governed data delivery.
- Develop and enforce data quality frameworks, validation rules, and monitoring processes.
- Optimize Spark jobs for performance, reliability, and cost efficiency.
- Collaborate with cross‑functional teams including data architects, analysts, and business stakeholders.
- Translate healthcare business requirements into robust technical solutions.
- Ensure compliance with healthcare data standards, privacy regulations, and governance practices.
- Claims ingestion and orchestration
- Data validation and transformation
- Supporting batch and event-driven workflows
- Feature engineering
Required Technical Skills
- Strong hands‑on experience with PySpark based ETL, SQL, and Databricks
- Deep understanding of medallion architecture and modern data lakehouse patterns.
- Experience implementing data quality frameworks and automated validation.
- Proficiency in Spark optimization techniques (partitioning, caching, AQE, cluster tuning).
- Familiarity with CI/CD, version control, and DevOps practices for data engineering.
Healthcare Domain Expertise
- Experience working with healthcare claims platforms such as Facets, QNXT, or Health Rules.
- Understanding of CPT, ICD‑10, HCPCS, and related healthcare coding standards.
- Knowledge of claims lifecycle, adjudication processes, and provider/member data structures.
- Ability to interpret healthcare data models and ensure accurate mapping, transformation, and enrichment.
Preferred Qualifications
- Experience in cloud environments (Azure preferred).
- Exposure to data governance, MDM, and metadata management.
- Strong analytical, communication, and problem‑solving skills.
- Ability to work independently and drive technical decisions.
Work model
We strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a remote position open to qualified applicants in the United States. Regardless of your working arrangement, we are here to support a healthy work-life balance though our various wellbeing programs.
The working arrangements for this role are accurate as of the date of posting. This may change based on the project you’re engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.
Salary and Other Compensation:
Applications will be accepted until March 30th 2026.
The annual salary for this position is between $ 100,000 K -$ 117,000 K depending on experience and other qualifications of the successful candidate.
This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans
Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:
Medical/Dental/Vision/Life Insurance
Paid holidays plus Paid Time Off
401(k) plan and contributions
Long-term/Short-term Disability
Paid Parental Leave
Employee Stock Purchase Plan
Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
About us
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, building the bridge between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, realize tangible returns and keep global enterprises ahead in a fast-changing world. See how at www.cognizant.com or @cognizant.
Additional employment information
Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.
Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.
If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email [email protected] for roles based in the Americas or [email protected] for roles based in India.
