Data Engineering Lead - Cloud

Egen · West Suburbs

Company

Egen

Location

West Suburbs

Type

Full Time

Job Description

Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results.


As a Data Engineer Lead, you will lead a team of insatiably curious data engineers in the design and creation of scalable data platforms and fault-tolerant pipelines for modern analytics and AI services. You will be a key voice to leverage your subject matter expertise in modernizing organizations from legacy disparate data warehouse environments (Informatica and Hadoop) to modern distributed data environments (AWS Redshift or Snowflake).

Responsibilities:

  • Lead and develop passionate data engineering teams through complex data migrations from disparate legacy ETL platforms to modern and highly scalable distributed data platforms.
  • Design and develop distributed ETL/ELT pipelines with cloud-native data stores. AWS Redshift and Snowflake preferred.
  • Facilitate fast and efficient data migrations through a deep understanding of design, mapping, implementation, management, and support of distributed data pipelines.
  • Prepare data mapping, data flow, production support, and pipeline documentation for all projects.
  • Create and document end-to-end data warehouse and data mart implementation plans.
  • Consult business, product, and data science teams to understand end-user requirements or analytics needs to implement the most appropriate data platform technology and scalable data engineering practices.

What we're looking for:

  • Minimum of Bachelor’s Degree or its equivalent in Computer Science, Computer Information Systems, Information Technology and Management, Electrical Engineering or a related field.
  • You have extensive past experience with legacy Informatica and Hadoop based EDW platforms and have led or significantly contributed to a major cloud migration
  • You are a subject matter expert of standard concepts, best practices, and procedures within an enterprise data warehousing environment 
  • You have a strong background in distributed data warehousing with AWS Redshift (Snowflake, Big Query, and/or Azure Data Warehouse would be ok).
  • You have expert programming/scripting knowledge in building and managing ETL pipelines using SQL, Python, and Bash.


Apply Now

Date Posted

04/28/2024

Views

0

Back to Job Listings Add To Job List Company Profile View Company Reviews
Positive
Subjectivity Score: 0.8

Similar Jobs

Junior Graphic Designer - Dealer eProcess

Views in the last 30 days - 0

DEP is seeking a graphic designer for a fulltime hybrid position in Lisle IL The designer will create visual concepts for various platforms including ...

View Details

Marketing Coordinator - Marcus & Millichap

Views in the last 30 days - 0

The job posting is for a Marketing Coordinator position in Oak Brook IL The role involves providing marketing and administrative support in a fastpace...

View Details

Product Manager - Carpentry - Chervon North America

Views in the last 30 days - 0

Chervon a leading global manufacturer of power tools and outdoor power equipment is seeking a Product Manager for Carpentry The role involves managing...

View Details

EDI Coordinator - Chervon North America

Views in the last 30 days - 0

Chervon North America is seeking an EDI Coordinator with a Bachelors degree and 35 years of relevant experience The role involves endtoend ownership o...

View Details

Associate Product Manager | OPE - Chervon North America

Views in the last 30 days - 0

Chervon a leading global manufacturer of power tools and outdoor power equipment is seeking an Associate Product Manager for OPE The role involves dev...

View Details

Senior Accounting Manager - Sourcebooks

Views in the last 30 days - 0

Sourcebooks is seeking a Senior Accounting Manager to lead a team of four in a hybrid role based in Naperville Illinois The role involves overseeing k...

View Details