ob Title: - Databricks with Pyspark
Location: - AIA Hyderabad
Minimum 9 to 12 years of experience
1. Job Title : Architect 2. Job Summary : Join our dynamic team as a Demand Role Architect where you will leverage your extensive experience in Spark in Scala Delta Sharing and Databricks technologies. You will play a pivotal role in designing and implementing cutting-edge data solutions ensuring seamless data integration and management. Your expertise will drive innovation and efficiency contributing to our companys success and societal impact. 3. Experience : 12 - 16 years 4. Required Skills : Technical Skills: Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL Databricks Delta Lake Databricks Workflows PySpark Domain Skills: 5. Nice to have skills : Domain Skills: 6. Technology : Cloud Modernization/Migration 7. Shift : Day 8. Responsibilities : - Design and implement scalable data architectures using Spark in Scala and Databricks technologies to optimize data processing and analytics workflows. - Oversee the integration of Delta Sharing and Databricks Unity Catalog Admin to enhance data governance and security across the organization. - Provide technical expertise in Databricks CLI and Delta Live Pipelines to streamline data operations and improve workflow automation. - Collaborate with cross-functional teams to develop and maintain structured streaming solutions ensuring real-time data processing and analysis. - Implement risk management strategies to mitigate potential data-related risks and ensure compliance with industry standards. - Utilize Apache Airflow for orchestrating complex data workflows ensuring efficient data pipeline management and execution. - Manage data storage and retrieval processes using Amazon S3 and Amazon Redshift optimizing data accessibility and performance. - Develop and maintain Python scripts for data manipulation and transformation enhancing data processing capabilities. - Leverage Databricks SQL and Databricks Delta Lake to perform advanced data analytics and drive data-driven decision-making. - Implement and manage Databricks Workflows to automate data processing tasks and improve operational efficiency. - Utilize PySpark for large-scale data processing ensuring high performance and scalability of data solutions. - Collaborate with stakeholders to understand business requirements and translate them into effective data solutions. - Ensure data solutions align with the companys strategic goals and contribute to overall business success. Qualifications - - Possess a minimum of 12 years of experience in data architecture and engineering roles with a strong focus on Spark in Scala and Databricks technologies. - Demonstrate proficiency in Delta Sharing Databricks Unity Catalog Admin and Databricks CLI for effective data management. - Exhibit expertise in Delta Live Pipelines and Structured Streaming for real-time data processing. - Have a solid understanding of risk management principles and practices in data environments. - Show experience with Apache Airflow Amazon S3 and Amazon Redshift for data workflow orchestration and storage management. - Proficient in Python programming for data manipulation and transformation tasks. - Skilled in Databricks SQL and Databricks Delta Lake for advanced data analytics. - Experience with Databricks Workflows and PySpark for automating data processes and large-scale data processing. 9. Job Location : Primary Location :INTNCHNA16(ITIND COG KITS Campus(CKC)SDB2&3 SEZ) Alternate Location :NA NA Alternate Location 1 :NA NA 10. Job Type : Manager - Projects [50PM00] 11. Demand Requires Travel? : No 12. Certifications Required : NA
コグニザントのコミュニティ:
私たちは、互いを尊重し支え合う優秀な人材の集まりです。社員一人ひとりが成長し、力を発揮できるよう、エネルギッシュで協力的かつインクルーシブな職場環境を大切にしています。
- コグニザントは、世界中に30万人以上のアソシエイトを擁するグローバルコミュニティです。
- 私たちは、より良い方法を夢見るだけでなく、それを実現します。
- 人、クライアント、企業、地域社会、そして環境に対して、常に「正しいこと」を行うことで責任を果たします。
- あなたにとって最適なキャリアパスを築くことができる、革新的な環境を提供します。
私たちについて:
コグニザント(NASDAQ: CTSH)は、AI builderおよびテクノロジーサービスプロバイダとして、AI投資を企業価値へとつなげるフルスタックのAIソリューションを提供しています。業界、業務プロセス、エンジニアリングに関する深い専門性を強みに、各企業固有のコンテキストをテクノロジーシステムに組み込み、人の力を最大限に引き出すとともに、具体的な成果の創出と、急速に変化する世界におけるグローバル企業の競争力維持を支援します。詳しくは、当社ウェブサイト www.cognizant.com をご覧ください。
コグニザントは機会均等を重視する雇用主です。応募者および候補者は、人種、肌の色、性別、宗教、信条、性的指向、性自認、国籍、障がい、遺伝情報、妊娠、退役軍人の地位、または連邦、州、地方の法律で保護されているその他の特性に基づいて差別されることはありません。
免責事項:
応募者は、対面またはビデオ会議による面接への参加を求められる場合があります。また、各面接の際に、現住所または政府発行の身分証明書の提示が必要となる場合があります。