Lead Data Engineer

Description

DATA ENGINEERING LEAD

We are Cognizant Artificial Intelligence

Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. But clients need new business models built from analyzing customers and business operations at every angle to really understand them.

With the power to apply artificial intelligence and data science to business decisions via enterprise data management solutions, we help leading companies prototype, refine, validate and scale the most desirable products and delivery models to enterprise scale within weeks

*This role is not able to offer visa transfer or sponsorship now or in the future*

Location: Irving - TX USA

Job summary

Application (need experience preferably in the applications mentioned below) - Develop and optimize data pipelines and systems for supporting business operations and improving buyer and seller experience. Build highly scalable and available big data pipelines and related systems to improve different systems across the company including content understanding structured data search recommendation ads merchant logistics etc.

Technical Skills- Python Data Science PySpark

Roles & Responsibilities

Work with product managers data analysts taxonomists and QA teams collaborate with different engineering teams to move projects from inception to completion. Experience/Skills - 5+ years of experience in contributing to design and development of data engineering pipelines and systems with big data frameworks and large-scale distributed systems. (monoliths and microservices on AWS using distributed processing frameworks) - Can lead offshore dev pod (he/she will be only tech onshore to coordinate/deliver through offshore dev team of 5) - Can effectively collaborate with client Product Manager (who will provide Epics/Features/Stories) to understand requirements create solution design and technical stories/tasks for offshore team to deliver - Can estimate feature/epics identify dependencies to work with client Product Manager - Can coordinate with client in PST and India offshore devs for delivery - Can take ownership of tech delivery in alignment with Product management by working with client (in PST) and offshore team (India) - Has good communication client management and team leadership experience - Demonstrates good Emotional Intelligence Primary Skills - Python Data Store (MySQL Postgress Mongo S3 Elastic Search Redis) Amazon AWS Distributed Frameworks (Hadoop Spark Hive Presto) Data Processing (Kafka Flink SQS Airflow Cron) Grafana Kubernetes Tableau. Secondary Skills - Golang. Good to Have - Any experience related to developing microservices data science or machine learning related systems is a big plus

#CB

#IND123

Qualifications

Technical Skills

SNo Primary Skill Proficiency Level * Rqrd./Dsrd. 1 Data Science PL3 Required 2 PySpark PL3 Desired 3 Python PL3 Desired

* Proficiency Legends

Proficiency Level Generic Reference PL1 The associate has basic awareness and comprehension of the skill and is in the process of acquiring this skill through various channels. PL2 The associate possesses working knowledge of the skill, and can actively and independently apply this skill in engagements and projects. PL3 The associate has comprehensive, in-depth and specialized knowledge of the skill. She / he has extensively demonstrated successful application of the skill in engagements or projects. PL4 The associate can function as a subject matter expert for this skill. The associate is capable of analyzing, evaluating and synthesizing solutions using the skill.