Senior Data Engineer

Teachable · Brazil

Company

Teachable

Location

Brazil

Type

Full Time

Job Description

About your Team

At Teachable our Data Team is all about getting things done with minimal overhead. We work closely together sharing ideas designing efficient systems and building a robust data platform that supports the entire organization. Reporting to the Data Engineering Manager you’ll take the lead on key initiatives from optimizing our data lake to shaping the future of our events pipeline and ETL processes.

Our data infrastructure is primarily hosted on AWS. We leverage managed Airflow for orchestration Kafka for event collection Redshift for analytics and S3 for data lake storage. As a Senior Data Engineer your expertise will be pivotal in influencing the tools and technologies we use as well as setting best practices for the entire data ecosystem.

The Impact You'll Make

In this role you'll be at the heart of our data strategy taking ownership of mission-critical infrastructure that supports teams across the company. You’ll also have the opportunity to make strategic recommendations on how we can evolve our data platform to stay ahead of the curve.

This is a fully remote role based in Brazil and you’ll collaborate closely with teams across the U.S. and Brazil (including Hotmart’s Data Team).

Your work will follow Brasilia Standard Time and you’ll be hired as a CLT contract employee with compensation in BRL.

What You’ll Do

  • Partner with Engineering and Product teams on high-impact initiatives.

  • Design and implement robust data pipelines using AWS services.

  • Enhance event collection queueing and processing mechanisms.

  • Build and refine meaningful alerts with automated corrective actions.

  • Troubleshoot and resolve issues ensuring system reliability and stability.

  • Architect scalable data products with long-term vision and efficiency in mind.

  • Identify and resolve complex technical challenges involving system integration infrastructure and software bugs.

About You

  • 4+ years of professional experience in data engineering.

  • Proficiency in processes used in modern data engineering

    • Solid understanding of cloud infrastructure

    • Hands-on experience with relevant data-related AWS services

    • Advanced understanding of the relational data model

    • Experience interacting with RESTful APIs and webhooks

    • Understanding of DevOps disciplines and Git version control

    • A commitment to writing clean efficient and maintainable code

    • Familiarity with monitoring tools like CloudWatch or New Relic

    • Familiarity with incident management tools like PagerDuty is desirable

    • Understanding Software Engineering paradigms and lifecycle is desirable

  • Proficiency in languages used in data engineering

    • Strong SQL skills

    • Expertise utilizing Python for data wrangling

    • Experience using Airflow for data pipeline orchestration

    • Experience with Spark creating big data workloads

    • Experience working with Delta Lake Hudi or Iceberg

    • Experience working with large-scale data warehouses like Redshift

    • Experience with Terraform composing AWS infrastructure is desirable

  • A team player who values diversity and collaboration

Apply Now

Date Posted

10/17/2024

Views

0

Back to Job Listings Add To Job List Company Profile View Company Reviews
Positive
Subjectivity Score: 0.8

Similar Jobs

Senior Software Engineer - Depositary - Visa

Views in the last 30 days - 0

Pismo a tech company founded in 2016 offers cloudbased solutions for banking and fintech The job involves managing card receivables developing project...

View Details

Sr. Software Engineer - Data Platform - Visa

Views in the last 30 days - 0

Pismo is a technology company providing banking and financial infrastructure solutions collaborating with Visa to address technological challenges for...

View Details

Senior DevOps Engineer - Feegow - Docplanner

Views in the last 30 days - 0

The text promotes a tech companys mission to improve healthcare accessibility and employee wellbeing It highlights global operations innovative soluti...

View Details

Senior Backend Product Engineer - Origin

Views in the last 30 days - 0

This Senior Product Engineer role emphasizes leading technical innovation collaborating with crossfunctional teams and shaping longterm strategies The...

View Details

Software Engineer - Config UI - Visa

Views in the last 30 days - 0

Pismo is a technology company founded in 2016 offering cloudbased solutions for banking and financial infrastructure They seek a Backend Engineer with...

View Details

QA Engineer - Authorizations - Visa

Views in the last 30 days - 0

Pismo is a technology company founded in 2016 that provides cloudbased solutions for banking and financial infrastructure The job description highligh...

View Details