Job Title - DataBricks Data engineer
** Unfortunately no visa transfer /sponsorship available**
Job Description:
We are seeking a highly skilled Lead Data Engineer with deep expertise in Databricks SQL, PySpark, and modern cloud data platforms. The ideal candidate will have hands-on experience delivering cloud modernization and migration initiatives, along with the ability to design and optimize scalable data architectures that support analytics, data engineering, and enterprise-scale processing.
This role involves handling the Databricks to Pyspark Migration design, guiding engineering teams, and ensuring data solutions meet performance, security, and governance standards.
Key Responsibilities :
Design and implement scalable, high‑performance data migrations using Databricks Lakehouse, Delta Lake, and distributed processing frameworks.
Develop, optimize, and productionize Databricks SQL and PySpark pipelines supporting large-scale ETL, streaming, and advanced analytics workloads.
Lead end-to-end architecture for cloud modernization and migration projects, ensuring best practices in scalability, performance, governance, and cost efficiency.
Collaborate with business partners, product owners, and engineering teams to convert business requirements into robust technical solutions.
Provide technical leadership and mentorship to data engineers and developers, ensuring adherence to coding, design, and architectural standards.
Review and improve solution designs, ensuring alignment with enterprise governance, security, and compliance frameworks.
Support production deployments, troubleshooting, and performance tuning of data workflows running on Databricks and cloud-native platforms.
Drive continuous improvement and adoption of emerging technologies, tools, and best practices within the data engineering ecosystem.
Required Technical Skills:
Strong hands-on expertise with Databricks SQL
Advanced development experience with PySpark for ETL and data processing
good understanding of cloud-native data platforms (AWS, Azure, or GCP)
strong foundation in data modeling, performance optimization, and governance
Preferred Skills:
Experience with AWS data services (Glue, S3, Lambda, Lakehouse technologies)
Exposure to Iceberg/Delta Lake, data quality frameworks, and data cataloging
Strong communication skills and ability to work with global teams
The Cognizant community:
We are a high caliber team who appreciate and support one another. Our people uphold an energetic, collaborative and inclusive workplace where everyone can thrive.
- Cognizant is a global community with more than 300,000 associates around the world.
- We don’t just dream of a better way – we make it happen.
- We take care of our people, clients, company, communities and climate by doing what’s right.
- We foster an innovative environment where you can build the career path that’s right for you.
About us:
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, building the bridge between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, realize tangible returns and keep global enterprises ahead in a fast-changing world. See how at www.cognizant.com or @cognizant.
Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.
Disclaimer:
Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.
