Skill: Python, Pyspark, AWS
Exp: 6 to 12 years
Location: Pune
Job Summary
We are seeking a skilled Python + PySpark + AWS Developer to design, develop, and maintain scalable data engineering solutions. The role involves building high-performance ETL pipelines, processing large datasets, and integrating with AWS cloud services to support enterprise analytics and reporting needs.
Key Responsibilities
- Design, develop, and optimize ETL pipelines using PySpark and Python.
- Work with large-scale datasets to perform data cleansing, transformation, and aggregation.
- Integrate with AWS services such as S3, Glue, EMR, Lambda, Redshift, Athena, Kinesis.
- Implement data lake and data warehouse solutions on AWS.
- Ensure data quality, consistency, and security across all processing stages.
- Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions.
- Monitor, troubleshoot, and optimize data workflows for performance and cost efficiency.
- Follow best practices for code versioning, CI/CD, and cloud resource management.
- Write unit tests and maintain documentation for all developed solutions.
Required Skills & Qualifications
- Strong programming skills in Python (data manipulation, APIs, automation).
- Hands-on experience with PySpark for distributed data processing.
- Proficiency in AWS cloud services (S3, Glue, EMR, Lambda, Redshift, Athena, IAM).
- Solid understanding of SQL and relational database concepts.
- Experience with data lake and data warehouse architectures.
- Knowledge of ETL/ELT design patterns and best practices.
- Familiarity with Git and CI/CD tools (e.g., Jenkins, GitHub Actions).
- Strong problem-solving and debugging skills.
- Bachelor’s degree in Computer Science, Information Technology, or related field.
Preferred Skills
- Experience with streaming data (Kafka, Kinesis).
- Knowledge of Docker and containerized deployments.
- Familiarity with Terraform or CloudFormation for infrastructure as code.
- Exposure to machine learning pipelines in a big data environment.
- Understanding of data governance and compliance standards.
Work Environment
- Location: Onsite / Remote / Hybrid (as per company policy)
- Team: Works closely with data engineers, analysts, and cloud architects.
- Tools: AWS Cloud, Spark, Python, SQL, Git, CI/CD pipelines.
关于高知特 (Cognizant)
高知特(Cognizant)（纳斯达克代码：CTSH）作为一家AI Builder和相关技术服务提供商，致力于通过打造全栈AI解决方案，帮助企业将人工智能投资转化为实际价值。公司凭借深厚的行业经验、流程优化和工程技术专长，将企业独特的业务场景融入科技系统，赋能组织释放人才潜能，推动切实成果，并帮助全球企业在瞬息万变的环境中保持领先。如需了解更多详情，敬请访问 cognizant.ai 或关注@cognizant。
补充雇佣信息
薪酬信息截至本职位发布之日为准。Cognizant 保留在适用法律允许的范围内随时修改该信息的权利。
申请人可能需要通过现场面试或视频会议的方式参加面试。此外，候选人在每次面试时可能需要出示其当前所在州或政府签发的有效身份证件。
Cognizant 是一家提供平等就业机会的雇主。在招聘过程中，您的申请和候选资格不会因种族、肤色、性别、宗教、信仰、性取向、性别认同、国籍、残疾、遗传信息、怀孕、退伍军人身份或任何其他受联邦、州或地方法律保护的特征而受到影响。
