Senior Data Engineer (hybrid)

Description

This hybrid position is open to any qualified applicant in the United States.

This position is on-site in Dearborn, Michigan.

Practice - AIA - Artificial Intelligence and Analytics

About AI & Analytics: Artificial intelligence (AI) and the data it collects and analyzes will soon sit at the core of all intelligent, human-centric businesses. By decoding customer needs, preferences, and behaviors, our clients can understand exactly what services, products, and experiences their consumers need. Within AI & Analytics, we work to design the future-a future in which trial-and-error business decisions have been replaced by informed choices and data-supported strategies!

By applying AI and data science, we help leading companies to prototype, refine, validate, and scale their AI and analytics products and delivery models! Cognizant's AIA practice takes insights that are buried in data and provide businesses with a clear way to transform how they source, interpret, and consume their information. Our clients need flexible data structures and a streamlined data architecture that quickly turns data resources into informative, meaningful intelligence.

Job Duties and Responsibilities:

• Design and develop change data capture processes between BigQuery tables to efficiently process data
• Write and deploy custom BigQuery UDFs to implement data validation checks at scale, ensuring accuracy.
• Create reusable Airflow DAGs leveraging advanced features like SLAs, custom operator plugins, and parallel task execution.
• Utilize Terraform to automate provisioning of analytics infrastructure on GCP; automated tables, views, and other services on GCP.
• Migrate legacy data from Teradata EDW into BigQuery leveraging custom Spark ETL code.
• Build custom Airflow failure notification plugin using Python for error handling and SLA tracking.
• Optimize BigQuery SQL performance through query partitioning, clustering reducing run times by 90%.
• Profile query execution plans and create appropriate aggregations to improve read throughput for core business analytics workloads.
• Establish SQL coding best practices in team including commenting, indenting, table aliasing for easier debugging and maintenance.
• Create views, tables leveraging SQL for addressing ad-hoc analysis requests on enterprise data warehouse.
• Conduct full data profiling and standardized data quality checks; implement a set of validation test cases in Python to ensure integrity.

Position Qualifications:

• At least 5 to 8 years of work experience.
• Required skills: GCP Big Query, PySpark, Python, and Google Cloud Composer

Salary and Other Compensation:

Applications will be accepted until 03/11/2024.

The annual salary for this position is between $82,000 to $123,000 depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant's discretionary annual incentive program and stock awards, based on performance and is subject to the terms of Cognizant's applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

• Medical/Dental/Vision/Life Insurance
• Paid holidays plus Paid Time Off
• 401(k) plan and contributions
• Long-term/Short-term Disability
• Paid Parental Leave
• Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.