AWS Data Engineer/Pyspark (Hybrid role)

Description

We are Cognizant Artificial Intelligence

Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. But clients need new business models built from analyzing customers and business operations at every angle to really understand them.

With the power to apply artificial intelligence and data science to business decisions via enterprise data management solutions, we help leading companies prototype, refine, validate and scale the most desirable products and delivery models to enterprise scale within weeks

AWS Data Engineer/Pyspark (Hybrid role)

Experience: 12+ years

Job Description:

Hands on experience with Apache Spark and PySpark, including data processing, Spark SQL, DataFrame Operations and RDD Transformations.

Design, Develop and maintain large-scale data processing PySpark applications.

Optimize PySpark jobs and workflows for performance and scalability.

Write efficient Spark SQL queries and optimized data access patterns.

Hands of experience in processing different file types such as Parquet, Avro, JSON, XML etc.

Troubleshoot and debug PySpark applications, identify and resolve performance bottlenecks and issues.

Experience with ETL Processes and data warehousing.

Hands on experience in AWS services such as EMR, S3, Glue, Step Functions etc.

Good Understanding of CI/CD pipeline and Agile methodologies.

Experience using tools such as Git/Bitbucket, Jenkins etc.

Good to have knowledge/ experience in Terraform.

Strong problem-solving and analytical skills.

Salary and Other Compensation :

The annual salary for this position would depend on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant's discretionary annual incentive program, based on performance and subject to the terms of Cognizant's applicable plans.

Benefits : Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

• Medical/Dental/Vision/Life Insurance
• Paid holidays plus Paid Time Off
• 401(k) plan and contributions
• Long-term/Short-term Disability
• Paid Parental Leave
• Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Cognizant will only consider applicants for this position who are legally authorized to work in the United States without company sponsorship (H-1B, L-1B, L-1A, etc.)

#CB

#IND123