Skip to main content

Kafka, Spark, Bigdata

00066742632

Skill: Kafka, Spark, Bigdata

Experience: 7 to 13 years

Location: Bangalore

Job Description

  • Design and implement complex data solutions using Big Data, Spark, and Kafka Streaming technologies.
  • Lead and guide a team of data engineers in delivering high-quality and innovative solutions.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Develop and maintain data pipelines and workflows to ensure efficient and accurate data processing.
  • Identify and troubleshoot data quality and performance issues.
  • Stay up-to-date with industry trends and best practices in data engineering to drive innovation.
  • Manage and prioritize multiple projects and tasks to meet tight deadlines.
  • Communicate effectively with stakeholders at all levels to provide updates and recommendations.
  • Implement and maintain data security and governance measures to ensure compliance with regulations.
  • Mentor and train junior data engineers to enhance their skills and knowledge.
  • Continuously evaluate and improve existing data processes and systems to optimize efficiency.
  • Assist in the evaluation and implementation of new data technologies and tools.
  • Participate in regular team meetings and provide input in decision-making processes.
  • Take ownership of data engineering projects and drive them to successful completion.
  • Be a proactive problem-solver and provide innovative solutions to complex data challenges.

Job Qualifications

  • Extensive Knowledge Of Big Data Technologies: A Lead Data Engineer At Visa Should Have A Strong Understanding Of Big Data Technologies Such As Hadoop, Spark, And Kafka. They Should Be Proficient In Designing And Developing Data Pipelines And Data Warehousing Solutions Using These Technologies.
  • Experience With Real-Time Data Processing: As A Lead Data Engineer, The Candidate Should Have Experience With Real-Time Data Processing Using Technologies Like Kafka Streaming. They Should Be Able To Design And Implement Scalable And Fault-Tolerant Streaming Data Pipelines.
  • Expertise In Data Modeling And Database Design: A Strong Foundation In Data Modeling And Database Design Is Essential For A Lead Data Engineer At Visa. They Should Be Able To Design Efficient And Optimized Data Models For Large-Scale Data Processing And Analytics.
  • Team Management Skills: Being A Lead Data Engineer, The Candidate Should Have Excellent Team Management Skills. They Should Be Able To Lead And Mentor A Team Of Data Engineers, Providing Technical Guidance And Ensuring The Successful Delivery Of Projects.
  • Business Acumen: A Successful Lead Data Engineer At Visa Should Possess Strong Business Acumen And Be Able To Understand The Business Needs And Requirements. They Should Be Able To Translate Those Requirements Into Technical Solutions And Make Data-Driven Decisions.

What we offer

  • The chance to work with impact. Here, you’re empowered to bring your biggest thinking to help our company and clients improve everyday life.
  • Ownership over your career. Stay at the top of your game through our award-winning learning and development ecosystem. And when your ambitions change or we offer new opportunities, we help you pivot by providing reskilling, on-the-job learning and guidance to find new roles that might be a better fit.
  • The opportunity to thrive on a high caliber team with heart. We celebrate each other’s experiences and perspectives and promote a sense of belonging through our affinity groups and diversity and inclusion initiatives.
  • A comprehensive total rewards package, including a competitive salary and a pension plan with matching contributions.
  • Flexible health and financial benefits to support you and your eligible dependents—from day one.
  • True work-life balance. Be at your best through paid time off, flexible work arrangements, volunteering opportunities, social events, and so much more.  

About us
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, building the bridge between AI investment and enterprise value by building full-stack AI solutions for our clients. Our deep industry, process and engineering expertise enables us to build an organization’s unique context into technology systems that amplify human potential, realize tangible returns and keep global enterprises ahead in a fast-changing world. See how at www.cognizant.com or @cognizant.

Other employment-related information
Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, provincial or local laws.

If you have a disability that requires reasonable accommodation to search for a job opening or submit an application, please email [email protected] with your request and contact information.

Language requirements vary depending on roles, but we ask that all candidates have basic English proficiency for company-wide communications purposes. For roles based in Quebec, professional English proficiency is required, as you’ll deliver services to and collaborate with stakeholders outside the province who may not speak French.