Sr Data Engineering Manager - Data Lake

Summary

Data Team plays a central role at Pismo providing Data-Intensive Analytics for internal product teams also processing and delivering TBs of high-quality data  needed by our Partners to produce outstanding products downstream. Operating mainly in Brazil the data team recently extended its scope to accelerate the Platformization of data services globally with representatives in Europe and soon to the US and Asia. We are looking for talented leaders who share our culture of trust mutual responsibility and technological excellence to be part of this unprecedented and diverse global Data Organisation.

What you'll do

• As the Manager of Data Engineering at Pismo you will lead a team responsible for our Data Lake and corporate data platform. Your critical role involves ensuring the Data Lake meets quality standards Service Level Objectives (SLOs) and Service Level Agreements (SLAs) while continuously evolving the platform.

Minimum Qualifications

• At least 3 years managing Data Platform teams.

• Concrete previous hands-on experience as a Data Engineer Analytics Engineer Data Scientist Software Engineer or Machine Learning Engineer.

• Negotiation and communication skills to deal with different levels of stakeholders.

• Big Data Architecture

• Parallel processing with Apache Spark.

• Experience with Python SQL and Orchestration Tools (eg. Airflow).

Desirable Qualifications

• Experience Developing automated Unit and Integration tests for data pipelines;

• Experience using notebooks for data exploration (e.g. Jupyter Databricks Hex);

• Experience consuming data-intensive distributed messaging processing systems (e.g. Kafka SQS Pub-Sub Pulsar Kinesis);

• Experience developing and maintaining CI/CD for Data Pipelines (e.g. CodeFresh Jenkins etc);

Core Benefits

• Remote work

• Flexible hours

• Gympass

• Meal & Food vouchers

• Remote work financial support

• Life Insurance

• Medical and Dental

• Assistance Employee child care benefit: daycare

• Private Pension (2x1)

• Vidalink partnership

• Day off (Birthday)

• Support for studying languages

• 50% off AWS and GCP certifications

• Sesc Partnership

• Performance Incentive Plan

Technologies that we apply in our day

• AWS Services;

• Data Processing: Spark Flink

• Python

• Airflow

• Relational databases (PostgreSQL and MySQL)