Skip to main content

Spark

a person pointing at a whiteboard


Job Summary

We are seeking a Sr. Developer with 4 to 6 years of experience to join our team. The ideal candidate will have expertise in Spark in Scala Apache Airflow Python and Databricks SQL. Experience in Asset Management Operations is a plus. This is a hybrid work model with day shifts and no travel required.


Responsibilities

  • Develop and maintain scalable data pipelines using Spark in Scala to ensure efficient data processing.
  • Implement and manage workflows using Apache Airflow to automate data tasks and ensure timely execution.
  • Write clean efficient and maintainable code in Python to support various data engineering tasks.
  • Utilize Databricks SQL to perform complex queries and data transformations for analytics and reporting.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
  • Conduct code reviews to ensure code quality and adherence to best practices.
  • Troubleshoot and resolve data pipeline issues to maintain data integrity and availability.
  • Optimize data processing performance to improve system efficiency and reduce latency.
  • Document data workflows processes and code to ensure knowledge sharing and maintainability.
  • Stay updated with the latest industry trends and technologies to continuously improve data engineering practices.
  • Provide technical guidance and mentorship to junior developers to foster team growth.
  • Participate in agile ceremonies and contribute to sprint planning retrospectives and daily stand-ups.
  • Ensure compliance with data governance and security policies to protect sensitive information.

    • Qualifications

  • Must have strong experience in Spark in Scala for developing scalable data pipelines.
  • Must have hands-on experience with Apache Airflow for workflow automation.
  • Must be proficient in Python for data engineering tasks.
  • Must have experience with Databricks SQL for data querying and transformation.
  • Nice to have experience in Asset Management Operations domain.
  • Must have excellent problem-solving skills and attention to detail.
  • Must have strong communication and collaboration skills.
  • Must be able to work in a hybrid work model with day shifts.
  • Must be able to work independently and as part of a team.
  • Must have a proactive attitude and a willingness to learn new technologies.
  • Must have a strong understanding of data governance and security practices.
  • Must be able to document processes and code effectively.

    • Certifications Required

    Certified Spark Developer Apache Airflow Certification Python Certification

    About us

    Cognizant is one of the world's leading professional services companies, transforming clients' business, operating, and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build, and run more innovative and efficient businesses. Headquartered in the U.S., Cognizant (a member of the NASDAQ-100 and one of Forbes World’s Best Employers 2024) is consistently listed among the most admired companies in the world.

    Learn how Cognizant helps clients lead with digital at www.cognizant.com.

    What we offer

    • The chance to work with impact. Here, you’re empowered to bring your biggest thinking to help our company and clients improve everyday life.
    • Ownership over your career. Stay at the top of your game through our award-winning learning and development ecosystem. And when your ambitions change or we offer new opportunities, we help you pivot by providing reskilling, on-the-job learning and guidance to find new roles that might be a better fit.
    • The opportunity to thrive on a high-caliber team with heart. We celebrate each other’s experiences and perspectives and promote a sense of belonging through our affinity groups and diversity and inclusion initiatives.
    • A comprehensive total rewards package, including a competitive salary and pension plan with matching contributions.
    • Flexible health and financial benefits to support you and your eligible dependents—from day one.
    • True work-life balance. Be at your best through paid time off, flexible work arrangements, volunteering opportunities, social events, and so much more.  

    Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.

    If you have a disability that requires reasonable accommodation to search for a job opening or apply, please email [email protected] with your request and contact information.

    Disclaimer:
    Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

    Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government-issued ID during each interview.

    Join our talent community

    Haven’t found the right opportunity yet? Receive the latest updates on job opportunities, recruitment events and company news tailored just for you.

    Sign up