Job Description
About your Team
At Teachable our Data Team is all about getting things done with minimal overhead. We work closely together sharing ideas designing efficient systems and building a robust data platform that supports the entire organization. Reporting to the Data Engineering Manager you’ll take the lead on key initiatives from optimizing our data lake to shaping the future of our events pipeline and ETL processes.
Our data infrastructure is primarily hosted on AWS. We leverage managed Airflow for orchestration Kafka for event collection Redshift for analytics and S3 for data lake storage. As a Senior Data Engineer your expertise will be pivotal in influencing the tools and technologies we use as well as setting best practices for the entire data ecosystem.
The Impact You'll Make
In this role you'll be at the heart of our data strategy taking ownership of mission-critical infrastructure that supports teams across the company. You’ll also have the opportunity to make strategic recommendations on how we can evolve our data platform to stay ahead of the curve.
This is a fully remote role based in Brazil and you’ll collaborate closely with teams across the U.S. and Brazil (including Hotmart’s Data Team).
Your work will follow Brasilia Standard Time and you’ll be hired as a CLT contract employee with compensation in BRL.
What You’ll Do
-
Partner with Engineering and Product teams on high-impact initiatives.
-
Design and implement robust data pipelines using AWS services.
-
Enhance event collection queueing and processing mechanisms.
-
Build and refine meaningful alerts with automated corrective actions.
-
Troubleshoot and resolve issues ensuring system reliability and stability.
-
Architect scalable data products with long-term vision and efficiency in mind.
-
Identify and resolve complex technical challenges involving system integration infrastructure and software bugs.
About You
-
4+ years of professional experience in data engineering.
-
Proficiency in processes used in modern data engineering
-
Solid understanding of cloud infrastructure
-
Hands-on experience with relevant data-related AWS services
-
Advanced understanding of the relational data model
-
Experience interacting with RESTful APIs and webhooks
-
Understanding of DevOps disciplines and Git version control
-
A commitment to writing clean efficient and maintainable code
-
Familiarity with monitoring tools like CloudWatch or New Relic
-
Familiarity with incident management tools like PagerDuty is desirable
-
Understanding Software Engineering paradigms and lifecycle is desirable
-
-
Proficiency in languages used in data engineering
-
Strong SQL skills
-
Expertise utilizing Python for data wrangling
-
Experience using Airflow for data pipeline orchestration
-
Experience with Spark creating big data workloads
-
Experience working with Delta Lake Hudi or Iceberg
-
Experience working with large-scale data warehouses like Redshift
-
Experience with Terraform composing AWS infrastructure is desirable
-
-
A team player who values diversity and collaboration
Explore More
Date Posted
10/17/2024
Views
0
Similar Jobs
Senior Software Engineer - Depositary - Visa
Views in the last 30 days - 0
Pismo a tech company founded in 2016 offers cloudbased solutions for banking and fintech The job involves managing card receivables developing project...
View DetailsSr. Software Engineer - Data Platform - Visa
Views in the last 30 days - 0
Pismo is a technology company providing banking and financial infrastructure solutions collaborating with Visa to address technological challenges for...
View DetailsSenior DevOps Engineer - Feegow - Docplanner
Views in the last 30 days - 0
The text promotes a tech companys mission to improve healthcare accessibility and employee wellbeing It highlights global operations innovative soluti...
View DetailsSenior Backend Product Engineer - Origin
Views in the last 30 days - 0
This Senior Product Engineer role emphasizes leading technical innovation collaborating with crossfunctional teams and shaping longterm strategies The...
View DetailsSoftware Engineer - Config UI - Visa
Views in the last 30 days - 0
Pismo is a technology company founded in 2016 offering cloudbased solutions for banking and financial infrastructure They seek a Backend Engineer with...
View DetailsQA Engineer - Authorizations - Visa
Views in the last 30 days - 0
Pismo is a technology company founded in 2016 that provides cloudbased solutions for banking and financial infrastructure The job description highligh...
View Details