AWS Data Engineer/ Pyspark (Hybrid)

Description

We are Cognizant Artificial Intelligence

Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. However, clients need new business models built from analyzing customers and business operations at every angle to really understand them.

With the power to apply artificial intelligence and data science to business decisions via enterprise data management solutions, we help leading companies prototype, refine, validate and scale the most desirable products and delivery models to enterprise scale within weeks

You must be legally authorized to work in United States/Canada without the need of employer sponsorship, now or at any time in the future

Job Title: AWS Data Engineer / Pyspark (Hybrid)

Job summary

• Hands on experience with Apache Spark and PySpark, including data processing, Spark SQL, DataFrame Operations and RDD Transformations.
• Design, Develop and maintain large-scale data processing PySpark applications.
• Optimize PySpark jobs and workflows for performance and scalability.
• Write efficient Spark SQL queries and optimized data access patterns.
• Hands of experience in processing different file types such as Parquet, Avro, JSON, XML etc.
• Troubleshoot and debug PySpark applications, identify and resolve performance bottlenecks and issues.
• Experience with ETL Processes and data warehousing.
• Hands on experience in AWS services such as EMR, S3, Glue, Step Functions etc.
• Good Understanding of CI/CD pipeline and Agile methodologies.
• Experience using tools such as Git/Bitbucket, Jenkins etc.
• Good to have knowledge/ experience in Terraform.
• Strong problem-solving and analytical skills.

Experience 12 to 15yrs

Required Skills

Technical Skills: AWS

Technical Skills: Pyspark

Job Location

Hybrid in Plano, TX, Wilmington, DE, Columbus, OH or Jersey City, NJ.

Benefits : Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

• Medical/Dental/Vision/Life Insurance
• Paid holidays plus Paid Time Off
• 401(k) plan and contributions
• Long-term/Short-term Disability
• Paid Parental Leave
• Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

#LI-PF1 #CB #Ind123

Qualifications

Technical Skills

SNo Primary Skill Proficiency Level * Rqrd./Dsrd. 1 AWS EMR PL4 Desired 2 PySpark PL1 Required

Domain Skills

SNo Primary Skill Proficiency Level * Rqrd./Dsrd. 1 Advent Geneva NA Desired 2 COTS Products(BFS Ast&Wlth) NA Desired

* Proficiency Legends

Proficiency Level Generic Reference PL1 The associate has basic awareness and comprehension of the skill and is in the process of acquiring this skill through various channels. PL2 The associate possesses working knowledge of the skill, and can actively and independently apply this skill in engagements and projects. PL3 The associate has comprehensive, in-depth and specialized knowledge of the skill. She / he has extensively demonstrated successful application of the skill in engagements or projects. PL4 The associate can function as a subject matter expert for this skill. The associate is capable of analyzing, evaluating and synthesizing solutions using the skill.