Lead Data Engineer (Python, SQL, Snowflake) - P3224

As a Lead Data Engineer, you will have the opportunity to design and build software products and features for both internal and external clients. We are a team of innovators, continuously exploring new technologies that ensure 84.51° remains on the forefront of application development. In this position, you will be utilizing Python, SQL, Azure Cloud Services, Databricks and Snowflake.

As part of the Identity & Privacy engineering team, you will be working in a new space that will be using audience and insights data in order to facilitate identity resolution for offsite activations in a cookie-less future and determining when we can contact customers. Identity capabilities also includes understanding our customers with every touchpoint in-store and online, where profiling and behavioral insights are maintained in order to inform our business. 

Responsibilities

Take ownership of stories and drive them to completion through all phases of the entire 84.51° SDLC. This includes external facing and internal applications as well as process improvement activities such as:

• Design and develop Python & SQL based data pipeline solutions 
• Perform unit and integration testing 
• Create quality checks for ingested and post processed data 
• Ensure alerting and monitoring of automated pipeline solutions 
• Provide mentoring to junior team members 
• Participate in retrospective reviews 
• Participate in the estimation process for new work and releases 
• Maintain and enhance existing applications 
• Bring new perspectives to problems 
• Be driven to improve yourself and the way things are done 

Requirements

• Bachelor’s degree (Master’s degree desired) typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program. 
• Understanding of Agile Principles (Scrum)
• 5+ years of proven professional Python and SQL development experience 
• Proficient with distributed data processing (PySpark, Snowpark)
• Proficient with automated testing (PyTest, etc…)
• Proficient with GitHub
• Experience using Python frameworks 
• Experience with Cloud Technologies & Services (Azure preferred, GCP, AWS) 
• Experience with dependency management (Conda, venv, etc) 
• Experience with performance tuning enterprise applications 
• Experience with debugging enterprise applications 
• Experience with RESTful APIs 
• Understanding of CI/CD 
• Understanding of Object Oriented Principles 
• Understanding SOLID principles 

Preferred Skills

• Python & SQL Development 
• Distributed Data Processing (PySpark, Snowpark)
• CI/CD practices 
• Automated data pipeline orchestration 
• Data observability – Logging, Monitoring, and Alerting (Datadog)
• Azure Cloud infrastructure development 
• Snowflake 
• Databricks
• API development 
• Data quality checks 
• Cloud Technologies

IMPORTANT INFO 

This is a Hybrid position. Candidates must be able to come into the office on Monday, Tuesday, and Wednesday of each week. We have locations in Cincinnati, OH, Chicago, IL, Deerfield, IL, New York, NY, and Portland, OR. There are no remote options for this position. 

We are not working with staffing firms, consulting companies, or any other 3rd parties on this particular position. Full-time only, no contracts, no C2C. Also, please do not contact me about any products or services, as I have nothing to do with procurement. 
#LI-DOLF