Job Summary
Serve as a senior developer specializing in Databricks and PySpark to design build and optimize large scale data and analytics solutions in a hybrid work environment using prompt engineering to enable intelligent data products supporting day shift operations without travel and delivering measurable value to business stakeholders and society through data driven outcomes.
Responsibilities
Design and develop scalable data pipelines on Databricks using PySpark and Databricks SQL to deliver reliable and timely data for analytics and reporting needs.Implement robust data transformation logic in Databricks Workflows to ensure consistent data quality and alignment with business rules across multiple domains.Configure and optimize Databricks CLI based automation scripts to streamline environment setup deployment and operational tasks for data engineering projects.Apply prompt engineering techniques to build and refine intelligent data solutions that improve insight discovery and decision support for business teams.Tune PySpark jobs and Databricks SQL queries to improve performance manage costs and ensure efficient use of compute resources across the data platform.Collaborate with data architects analysts and product teams in a hybrid work setup to translate complex requirements into clear maintainable Databricks based solutions.Establish monitoring logging and alerting practices for Databricks Workflows to ensure high reliability rapid incident detection and swift remediation.Document data models transformation logic and operational runbooks so that project teams can understand support and extend delivered solutions with confidence.Ensure all data solutions comply with security and privacy standards so that sensitive information is protected while enabling responsible insight generation.Mentor junior developers in Databricks PySpark and prompt engineering techniques so that the team continually improves its technical depth and delivery quality.Partner with business stakeholders to validate outputs from Databricks SQL dashboards and models so that delivered insights remain accurate relevant and actionable.Drive continuous improvement of development practices using Databricks CLI and version control so that releases remain predictable traceable and low risk.Contribute to innovative use cases that leverage Databricks and prompt engineering to generate positive business value and broader societal impact through better use of data.
Qualifications
Demonstrate eight to twelve years of progressive experience in data engineering or development roles with a strong recent focus on Databricks based solutions.Show advanced hands on expertise in PySpark and Databricks SQL for building complex data transformations aggregations and analytical data sets.Exhibit solid experience configuring and using Databricks Workflows to orchestrate data pipelines manage dependencies and schedule production workloads.Display practical proficiency with Databricks CLI for automation of environment management job deployment and configuration tasks in enterprise settings.Apply working knowledge of prompt engineering concepts to design effective prompts that enhance data exploration insight generation and analytics workflows.Possess strong skills in writing clean maintainable code using version control and code review practices that support high quality and collaborative delivery.Bring proven experience working in hybrid teams and day shift schedules while maintaining clear communication accountability and focus on shared objectives.
Certifications Required
Databricks Certified Data Engineer Professional or equivalent advanced Databricks certification is preferred for this role.
Sobre a Cognizant
Cognizant (NASDAQ: CTSH) é uma construtora de IA e fornecedora de serviços de tecnologia, criando a ponte entre o investimento em IA e o valor para as empresas por meio do desenvolvimento de soluções de IA completas para nossos clientes. Nossa profunda experiência em setores, processos e engenharia nos permite incorporar o contexto único de cada organização em sistemas tecnológicos que potencializam a capacidade humana, geram resultados tangíveis e mantêm empresas globais à frente em um mundo em rápida transformação. Saiba mais em cognizant.ai ou @cognizant.
A Cognizant é uma empregadora que investe em equidade. Sua candidatura não será pautada em raça, cor, gênero, sexualidade, credo, origem, deficiência, gravidez ou qualquer outra característica protegida pelas leis brasileiras.
Informações adicionais de emprego
Os candidatos podem ser obrigados a comparecer a entrevistas presenciais ou por videoconferência. Além disso, os candidatos podem ser obrigados a apresentar seu documento de identificação emitido pelo estado ou governo atual durante cada entrevista.
Embora nosso sistema permita a candidatura em todos os idiomas, o(s) idioma(s) e o(s) nível(is) de proficiência exigidos para o trabalho variam. No entanto, é necessário um nível básico de inglês para fins de comunicação em toda a empresa.
A Cognizant é uma empregadora que investe em equidade. Sua candidatura não será pautada em raça, cor, gênero, sexualidade, credo, origem, deficiência, gravidez ou qualquer outra característica protegida pelas leis brasileiras.
Se você tem uma deficiência que requer adaptações razoáveis para procurar uma vaga de emprego ou enviar uma candidatura, envie um e-mail para [email protected] com sua solicitação e informações de contato.
