Skip to main content

Pyspark

JD 9


Job Summary

We are seeking a highly skilled Sr. Developer with 6 to 9 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. This role is based in our office and operates during day shifts. The candidate will play a crucial role in developing and optimizing data solutions to drive business success.


Responsibilities

  • Develop and maintain data solutions using Databricks SQL Databricks Delta Lake and Databricks Workflows.
  • Optimize and enhance existing data workflows to improve performance and efficiency.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
  • Implement data transformation and processing using PySpark to ensure data quality and integrity.
  • Provide technical guidance and support to junior developers and team members.
  • Conduct code reviews and ensure adherence to best practices and coding standards.
  • Troubleshoot and resolve issues related to data workflows and processing.
  • Monitor and maintain data pipelines to ensure smooth and reliable operation.
  • Participate in the design and architecture of data solutions to support business objectives.
  • Stay updated with the latest industry trends and technologies to continuously improve data solutions.
  • Document technical specifications and maintain comprehensive documentation for data solutions.
  • Ensure data security and compliance with relevant regulations and standards.
  • Collaborate with stakeholders to gather requirements and provide regular updates on project progress.

    • Qualifications

  • Possess strong expertise in Databricks SQL Databricks Delta Lake and Databricks Workflows.
  • Have extensive experience with PySpark for data transformation and processing.
  • Demonstrate excellent problem-solving skills and attention to detail.
  • Exhibit strong communication and collaboration skills to work effectively with cross-functional teams.
  • Show proficiency in optimizing and enhancing data workflows for performance and efficiency.
  • Have a solid understanding of data security and compliance requirements.
  • Display the ability to provide technical guidance and support to junior team members.
  • Maintain a proactive approach to staying updated with industry trends and technologies.
  • Possess strong documentation skills to maintain comprehensive technical specifications.
  • Demonstrate the ability to troubleshoot and resolve data workflow issues effectively.
  • Show experience in conducting code reviews and ensuring adherence to best practices.
  • Exhibit the ability to gather requirements and provide regular project updates to stakeholders.
  • Have a proven track record of developing and maintaining data solutions that drive business success.

    • Certifications Required

    Databricks Certified Associate Developer for Apache Spark Databricks Certified Professional Data Engineer

    What we offer

    • The chance to work with impact. Here, you’re empowered to bring your biggest thinking to help our company and clients improve everyday life.
    • Ownership over your career. Stay at the top of your game through our award-winning learning and development ecosystem. And when your ambitions change or we offer new opportunities, we help you pivot by providing reskilling, on-the-job learning and guidance to find new roles that might be a better fit.
    • The opportunity to thrive on a high caliber team with heart. We celebrate each other’s experiences and perspectives and promote a sense of belonging through our affinity groups and diversity and inclusion initiatives.
    • A comprehensive total rewards package, including a competitive salary and pension plan with matching contributions.
    • Flexible health and financial benefits to support you and your eligible dependents—from day one.
    • True work-life balance. Be at your best through paid time off, flexible work arrangements, volunteering opportunities, social events, and so much more.  

    Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.

    If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email [email protected] with your request and contact information.

    While our system allows application in all languages, job required language(s) and proficiency level(s) vary. However, basic English proficiency is required for Company-wide communications purposes.

    About us
    Cognizant is one of the world's leading professional services companies, transforming clients' business, operating, and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build, and run more innovative and efficient businesses. Headquartered in the U.S., Cognizant (a member of the NASDAQ-100 and one of Forbes World’s Best Employers 2024) is consistently listed among the most admired companies in the world. Learn how Cognizant helps clients lead with digital at www.cognizant.com.

    Join our talent community

    Haven’t found the right opportunity yet? Receive the latest updates on job opportunities, recruitment events and company news tailored just for you.

    Sign up