Lead Data Engineer (P791)
Job Description
84.51° Overview:
84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.
Powered by cutting-edge science, we utilize first-party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer-centric journey using 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.
Join us at 84.51°!
__________________________________________________________
As a Lead Data Engineer, you will have the opportunity to build solutions that ingest, store and distribute our big data to be consumed by data scientists and our products.
Our data engineers use PySpark/Python, Databricks, Airflow, Hadoop, Hive, and other data engineering technologies and visualization tools to deliver data capabilities and services to our scientists, products, and tools.
Responsibilities
Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC. This includes internal and external facing applications as well as process improvement activities:
- Lead design of Hadoop and SQL based solutions
- Perform development of Hadoop and SQL based solutions
- Execute unit and integration testing
- Collaborate with senior resources to ensure consistent development practices
- Provide mentoring to junior resources
- Bring new perspectives to problems and be driven to improve yourself and the way things are done
Requirements
- 5+ years proven ability of professional Data Development experience
- 5+ years proven ability of developing with Hadoop/HDFS and SQL (Oracle, SQL Server)
- 3+ years of experience with PySpark/Spark
- 3+ years of experience developing with either Python, Java, or Scala
- 1+ years of experience with Databricks
- Full understanding of ETL concepts and Data Warehousing concepts
- Exposure to VCS (Git, SVN)
- Strong understanding of Agile Principles (Scrum)
- Bachelor’s Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM)
Preferred Skills – Experience in the following
- Experience with Azure
- Exposure to NoSQL (Mongo, Cassandra)
- Exposure to Service Oriented Architecture
- Exposure to BI Tooling (Tableau, Power BI, Cognos, etc.)
- Proficient with Relational Data Modeling and/or Data Mesh principles
- Experience with CI/CD - Continuous Integration/Continuous Delivery
Important:
This is a Hybrid position. Candidates must be able to come into the office on Monday, Tuesday, and Wednesday of each week. We have locations in Cincinnati, OH, Chicago, IL, Deerfield, IL, New York, NY, and Portland, OR.
There are no remote options for this position.
#LI-DOLF
Date Posted
06/04/2024
Views
0
Similar Jobs
Software Engineering Lead - Dotdash Meredith
Views in the last 30 days - 0
Dotdash Meredith is seeking a skilled Engineering Lead for a missioncritical role in designing and scaling their nextgeneration publishing platform Th...
View DetailsSenior Software Engineer, Devices Automation - Block
Views in the last 30 days - 0
Square a company that has evolved since its inception in 2009 is seeking a Software Engineer with extensive experience in embedded devices and test en...
View DetailsIT Support Engineer (Contract) - Informa
Views in the last 30 days - 0
Curinos a company with decades of expertise in the financial services industry is seeking an IT Support Engineer for their New York office The role in...
View Details