Data Engineer

LTK is the largest influencer-driven platform used by millions of shoppers every month to find new styles and products curated by influencers all over the world.  As a Data Engineer, you will be part of a growth-hungry, acceleration-minded team of problem-solvers and product-builders. This is an opportunity to grow with a fast-growing organization. We thrive in an extremely dynamic competitive environment. We focus relentlessly on the needs of our influencers, brands, and consumers. We seek thought-leaders who can collaborate effectively with product managers, designers, and engineers to identify actionable insights to help us grow.

Responsibilities

• Data Engineer responsible for building robust, reliable, and usable data pipelines and data sets that are used to fuel LTK’s products, analytics, and data science solutions
• Bring modern technical strategies that optimize data engineering technical approach, workflows, and processes
• Lead data engineering optimization projects and initiatives
• Lead all aspects of data pipeline design activities (definition, analysis, architecture design, estimation)
• Participate in shaping, scoping, and setting technical direction for major projects and initiatives, working with product owners and engineering leads
• Lead analytical dimensional model design activities and support on-going improvement and useability of high value data sets
• Identify high value opportunities for using our data to drive the business forward
• Set robust, comprehensive design and development standards with clarity
• Develop reusable data engineering approaches and patterns
• Serve as a mentor to more junior data engineers; guide and facilitate work of other team members
• Lead out in an agile development environment, effectively planning, grooming, and delivering data engineering work
• Produce high quality technical documentation and artifacts that are easily consumable by data teams and other engineering teams

Qualifications

• Experience building production data pipelines, ELT/ETL solutions, data lakes, and data warehouses at a large scale
• 2-5+ years in data engineering role on cloud data platform (min 2 years AWS)
• Programming proficiency in cloud data ecosystem using Python, R or Scala (min 2 years)
• 2+ years utilizing large scale Analytic/MPP data warehouse platform (Redshift, Snowflake, databricks, etc.)
• Highly proficient with complex SQL
• Highly proficient with modern analytical/dimensional modeling approaches, key management techniques, and understanding of how data sets can power a variety of analytic use cases (clustering, segmentation, regression, etc.)
• Highly proficient in engineering data pipelines using big data tooling (Spark, Hudi, Kafka)
• Highly proficient working in AWS cloud environment (S3, Cloud Formation, RDS, AWS Glue, Athena, EMR, Kinesis, Redshift)
• Strong understanding of cloud computing and optimization techniques
• Demonstrated leadership and specialized expertise in at least 2 of the following:
• Batch data ingestion
• Big data pipeline engineering and optimization
• Analytic/MPP data warehouse optimization
• Analytical data modeling
• Event streaming data processing
• Data pipeline metadata observability
• Data Platform Cost Optimization
• DataOps
• Specialized expertise designing and working with at least 2 of the following data domains:
• Retail product data
• Ecommerce data
• Consumer profile data
• Clickstream data
• Consumer event data
• Marketing channel/campaign data
• Affiliate data
• Retailer/Brand data

Preferred Qualifications

• AWS Certified Data Analytics - Specialty Certification
• Exposure and experience with multiple platform stacks and tooling (Databricks, Snowflake, DBT, Airflow Orchestration, etc.)

 #LI-MM3