Lead Data Engineer

About Us:

Everstream Analytics is a technology-driven company that is revolutionizing Supply Chain Risk Analytics. We’re looking for a talented and experienced Lead Data Engineer to join our team.

What You’ll Do:

• Management: Manage and grow a remote team of data engineers based in Europe.

• Architect Data Solutions: Collaborate with Platform and Data Architecture teams to deliver robust scalable and maintainable data pipelines.

• Lead Data Initiatives: Lead and own data engineering projects including data ingestion transformation and storage.

• Real-Time Data Processing: Develop and optimize real-time data processing pipelines using technologies like Apache Kafka/MSK or similar.

• Data Lakehouse and ETL: Design and implement data lakehouses and ETL pipelines using AWS services like Glue or similar.

• Data Modeling and Optimization: Create efficient data models and optimize database queries for optimal performance.

• Collaborate with Stakeholders: Work closely with data scientists product managers and engineers to understand data requirements and translate them into technical solutions.

• Mentor and Guide: Mentor junior data engineers and share your expertise. Establish and promote best practices.

What You’ll Need:

• Strong Python Proficiency: Deep understanding of Python including data manipulation and analysis libraries like Pandas and NumPy or similar.

• Data Engineering Expertise: Extensive experience in data engineering including ETL data warehousing and data pipelines.

• Cloud Platform Proficiency: Strong knowledge of AWS services such as RDS Lake Formation Glue Spark etc.

• Real-Time Data Processing: Experience with real-time data processing frameworks like Apache Kafka/MSK.

• Database Skills: Proficiency in SQL and NoSQL databases including PostgreSQL Opensearch and Athena.

• Data Modeling: Ability to design efficient and scalable data models.

• Problem-Solving and Analytical Skills: Strong analytical skills to identify and solve complex data problems.

• Collaboration Skills: Excellent communication and collaboration skills to work effectively with cross-functional teams.

Why Join Us:

• Impactful Work: Contribute to data-driven decision-making and product innovation.

• Collaborative Culture: Work with a talented passionate team from across the world.

• Continuous Learning: Opportunities to learn new technologies and skills.

• Competitive Compensation: A competitive salary and benefits package.

We are looking for a hands-on Lead data engineer who is passionate about data enjoys solving complex problems and is excited to build and lead scalable data teams and solutions.

100% Remote Position

#LI-