Software Engineer IV - Data Platform

Summary

The Data Platform team is responsible for evolving the design architecture and development of our events platform at Pismo. Play a pivotal role in enhancing the data platform stack refining best practices and shaping the future of data processing performance and data engineering standards across the organization.

What you'll do

• Develop and improve data pipelines using big data technologies and implement solutions to evolve data platform architecture.

• Seek technological evolutions that improve the data processing platform.

• Be accountable for the operation and monitoring of the production of file and event systems.

• Ensure that the systems meet the established SLAs.

• Participate in the design and implementation of high-complexity features.

• Collaborate with other internal and external teams and customers to ensure efficient delivery and needs files and events.

• Acting in the demands of system operation (RUN/Oncall) respecting customer slas and proposing improvements to improve the service level.

• Be a guardian of the processes following them rigorously and ensuring that data stakeholders also follow them.

• Support in production management processes: performing root cause analyses and contributing to their problem-solving skills.

Minimum Qualifications

• B2 English (Upper Intermediate);

• Experience with Golang Event/Data Processing Architecture and Cloud Computing.

• Desirable experience with : Python Spark  Airflow Terraform Docker CI/CD and SQL/NoSQL Databases;

Core Benefits

• Remote work

• Flexible hours

• Gympass

• Meal & Food vouchers

• Remote work financial support

• Life Insurance

• Medical and Dental Assistance

• Employee child care benefit: daycare

• Vidalink partnership

• Day off (Birthday)

• Support for studying languages

• 50% off AWS and GCP certifications

Technologies that we apply in our day

• AWS Services;

• Data Processing: Spark Flink

• Python

• Airflow

• Relational databases (PostgreSQL and MySQL)