Data Engineer

About the team:

As part of the Data Engineering team, you will ingest, transform, and steward the data that powers leadership decisions across DHI. Using a tech stack that is primarily based on Amazon Redshift, dbt Core, and Python, the team consumes raw data from every corner of the enterprise, working closely with diverse stakeholders to produce tailored data products for visualization & export to business processes.

About the role:

As a Data Engineer, you will collaborate directly with technical and non-technical stakeholders to solve complex business problems with data. On any given day, you might:

• Collect data from a newly deployed product feature, working with a product manager and analysts to prove out ROI
• Integrate a novel data source, join it to existing data, and export to our data scientists for ML scoring
• Obliterate tech debt in our deployment pipeline, making our builds more visible & performant
• Export customer journey data off-platform, enabling our marketers to drive ROI in novel and exciting ways

Why we’re hiring for this role:

Our cloud-based data platform is the nexus of all data-driven decision-making at DHI. To maintain it, we need an engineer who enjoys working independently, is comfortable gathering requirements from both technical and non-technical stakeholders and is passionate about solving their problems with data.

In the short term you will:

• Learn about DHI's business, our team, and the stakeholders you'll be working with.
• Learn DHI's domain-driven design precepts and our team's data engineering doctrine.
• Familiarize with our tools & architecture by taking on projects of increasing scope and complexity.
• Build subject matter expertise on data & business processes we support.

In the long term you will:

• Design robust, scalable cloud-based data infrastructure, automating the ingestion and delivery of all types of data: structured or unstructured, batch or streaming.
• Build and maintain complex, billion-row data models & rich supporting documentation.
• Contribute thought leadership on technical decisions, architecture, processes, and team doctrine.
• Harness your natural curiosity to understand technical infrastructure, business logic, and business processes throughout DHI, and advocate to improve them.

What you bring to the team:

Required:

• Experience writing complex, performant SQL data models in dbt.
• Experience writing Python data extraction & orchestration scripts.
• Familiarity working in containerized UNIX environments, e.g. Docker.
• Expert-level competency in gathering business requirements from diverse stakeholders & synthesizing them into Jira tickets.
• Availability to perform on-call support on a schedule which rotates weekly, with coverage from 6:30am to 6:00pm MT, after onboarding is complete.

 Preferred:

• Experience with data orchestration tools like Apache Airflow.
• Familiarity with AWS data warehousing ecosystem (Redshift, S3, Glue, CloudFormation, Lambda, Kinesis).