Skip to main content

Azure Databricks with Pyspark

00068411212

Job Title: - Azure Databricks with Pyspark

Location: - AIA Kolkata

Experience: - 6 to 9 Years

An Azure Databricks Developer job description typically requires expertise in PySpark, Azure Data Factory (ADF), and Delta Lake architecture

Key Responsibilities

· Pipeline Development: Build and optimize scalable data pipelines and ETL processes using Azure Databricks and PySpark.

· Data Integration: Connect and manage data from Azure Data Lake Storage (ADLS Gen2) and various file formats (Parquet, Delta, JSON, CSV).

· Performance Tuning: Tune Spark SQL queries, optimize cluster configurations, and manage data partitioning strategies.

· CI/CD & Deployment: Implement version control via Git and deploy automated workflows using Azure DevOps or GitHub Actions.

Required Qualifications

· Experience: 4 to 8+ years of total IT experience, with at least 2–3 years of hands-on production experience in Azure Databricks.

· Tech Stack: Advanced proficiency in Python, PySpark, and complex SQL.

· Cloud Knowledge: Strong familiarity with core Azure services including ADF, ADLS Gen2, and Azure SQL.


About Cognizant: 
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, bridging the gap between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, drive tangible outcomes and keep global enterprises ahead in a fast-changing world. See how at cognizant.ai or @cognizant.

Additional employment information
Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.

Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.

If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email [email protected] with your request and contact information.

Benefits that help you thrive and grow

Our benefits program is built with you in mind—so you can enjoy a fulfilling, balanced and healthy life.

a blue line drawing of a plant with leaves

Financial wellbeing

We regularly review market data to ensure compensation reflects the value you bring. Your benefits extend beyond pay and may include retirement plans, financial education, etc.

Stay Healthy Midnight Blue RGB

Physical and mental health

We empower you to prioritize your wellbeing through paid time off, flexible working where possible, healthcare plans, counselling, our Mental Health Allyship program and more. 

Build The Career You Want Midnight Blue RGB

Your career, your way

With 350,000+ roles at Cognizant, you’ll have opportunities explore new technologies, industries and locations—and build the skills you need to grow your career.

Making A Meaningful Impact Midnight Blue RGB

Real-world impact

Think about the biggest brands you rely on. Chances are, they rely on us to help strengthen their business. Here, you’ll turn bold ideas into solutions that improve lives everywhere.

Haven't yet found the right opportunity?

Get the latest updates on job opportunities, recruitment events and company news—tailored just for you!

Be in the know