Big Data Engineer

Description

We are Cognizant Artificial Intelligence

Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. However, clients need new business models built from analyzing customers and business operations at every angle to really understand them.

With the power to apply artificial intelligence and data science to business decisions via enterprise data management solutions, we help leading companies prototype, refine, validate and scale the most desirable products and delivery models to enterprise scale within weeks

*You must be legally authorized to work in United States without the need of employer sponsorship, now or at any time in the future *

This is a remote position open to any qualified applicant in the United States.

Job Title: Big Data Engineer

Experience 7 to 10 yrs

Technical Skills- Hadoop, Pyspark, SQL, Python, Apache, Apache Spark

Must Have

1. Enterprise level implementation and hands on experience in - Spark (PySpark preferred Dataframe Filters UDF Partition) SQL Python

2. Hands-On implementation knowledge in - Databricks / Glue / Equivalent - Enterprise Scale data pipeline platform

3. Expertise in JSON binary format transforms (parquet avro) Streaming sources (kafka/kinesis) ETL SQL - complex joins grouping etc.

Good to Have

1. Cloud Data Engineering knowledge - AWS S3 and other AWS services

2. Data Engineering

Roles/Responsibilities

- Experience in Agile Methodology Experience in Healthcare domain and clinical data model desirable Knowledge in Healthcare Payer subject Area is an advantage Develop and maintain ETL processes that meet the business and technical requirements of the specific project and of the overall EDW data integration portfolio. Document all processes and support source code control using standard tools and processes.

- Explore and profile source system data to inform the technical and business requirements.

- Identify relevant data sets from transaction systems through hands-on analysis documentation review and consultation with application teams.

- Design database structures using standard design methods and modeling tools. - Excellent Communication Skills

Salary and Other Compensation :

The annual salary for this position is depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant's discretionary annual incentive program, based on performance and subject to the terms of Cognizant's applicable plans.

Benefits : Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

• Medical/Dental/Vision/Life Insurance
• Paid holidays plus Paid Time Off
• 401(k) plan and contributions
• Long-term/Short-term Disability
• Paid Parental Leave
• Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

#LI-DC1 #CB #Ind123

Qualifications

Technical Skills

SNo Primary Skill Proficiency Level * Rqrd./Dsrd. 1 Apache Spark PL1 Desired 2 Apache Hadoop PL3 Required 3 SQL Scripting PL4 Desired 4 Core Java PL1 Desired 5 Unix Shell Scripting PL1 Desired

* Proficiency Legends

Proficiency Level Generic Reference PL1 The associate has basic awareness and comprehension of the skill and is in the process of acquiring this skill through various channels. PL2 The associate possesses working knowledge of the skill, and can actively and independently apply this skill in engagements and projects. PL3 The associate has comprehensive, in-depth and specialized knowledge of the skill. She / he has extensively demonstrated successful application of the skill in engagements or projects. PL4 The associate can function as a subject matter expert for this skill. The associate is capable of analyzing, evaluating and synthesizing solutions using the skill.