Job Summary
Key Responsibilities
- Design, build and maintain batch and real-time data pipelines.
- Develop data products using Databricks Lakeflow Declarative Pipelines, PySpark and SQL.
- Build streaming solutions using Spark Structured Streaming and Lakeflow declarative pipelines
- Optimise pipelines for scalability, reliability and performance.
- Develop automated tests and participate in code reviews.
- Contribute to CI/CD and engineering best practices.
- Monitor, troubleshoot and support production workloads.
- Use AI-assisted development tools to improve productivity while maintaining high engineering standards.
Essential Skills
- Databricks
- Lakeflow Declarative Pipelines and DXQ, DB Genie, MCP Server
- Apache Spark (PySpark)
- Spark Structured Streaming
- Auto Loader
- Unity Catalog
- Python
- SQL
- Delta Lake
- Azure Event Hubs or equivalent event streaming platforms
- Git and collaborative development workflows
- Unit testing
- CI/CD
- Strong analytical and problem-solving skills
Nice to Have
- Performance tuning and Spark optimisation
- Data modelling
- Azure DevOps
- AI coding assistants (GitHub Copilot, Cursor or similar)
- Experience working in Agile or SAFe environments
We're looking for an engineer who:
- Takes ownership from design through production support.
- Writes clean, maintainable and well-tested code.
- Builds reusable, production-ready solutions.
- Collaborates effectively with teammates and stakeholders.
- Continuously learns and embraces modern engineering practices.
Additional employment information
Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.
Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.
Applicants must be currently authorized to work for any employer in the United States. The company is unable to provide employment-based immigration sponsorship for this position.
If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email [email protected] with your request and contact information.
About Cognizant:
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, bridging the gap between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, drive tangible outcomes and keep global enterprises ahead in a fast-changing world. See how at cognizant.ai or @cognizant.
