Job Description
About your Team
At Teachable our Data Team is all about getting things done with minimal overhead. We work closely together sharing ideas designing efficient systems and building a robust data platform that supports the entire organization. Reporting to the Data Engineering Manager you’ll take the lead on key initiatives from optimizing our data lake to shaping the future of our events pipeline and ETL processes.
Our data infrastructure is primarily hosted on AWS. We leverage managed Airflow for orchestration Kafka for event collection Redshift for analytics and S3 for data lake storage. As a Senior Data Engineer your expertise will be pivotal in influencing the tools and technologies we use as well as setting best practices for the entire data ecosystem.
The Impact You'll Make
In this role you'll be at the heart of our data strategy taking ownership of mission-critical infrastructure that supports teams across the company. You’ll also have the opportunity to make strategic recommendations on how we can evolve our data platform to stay ahead of the curve.
This is a fully remote role based in Brazil and you’ll collaborate closely with teams across the U.S. and Brazil (including Hotmart’s Data Team).
Your work will follow Brasilia Standard Time and you’ll be hired as a CLT contract employee with compensation in BRL.
What You’ll Do
-
Lead a greenfield data migration project from concept to execution.
-
Partner with Engineering and Product teams on high-impact initiatives.
-
Design and implement robust data pipelines using AWS services.
-
Enhance event collection queueing and processing mechanisms.
-
Drive the next phase of our data lake development optimizing for scalability.
-
Build and refine meaningful alerts with automated corrective actions.
-
Troubleshoot and resolve issues ensuring system reliability and stability.
-
Architect scalable data products with long-term vision and efficiency in mind.
-
Identify and resolve complex technical challenges involving system integration infrastructure and software bugs.
About You
-
4+ years of professional experience in data engineering.
-
Strong SQL skills with an advanced understanding of relational data models.
-
Proficiency in Python or Java for data processing.
-
Experience with version control systems like Git .
-
Proven track record of leading projects or initiatives.
-
Solid understanding of cloud infrastructure with hands-on experience in AWS services .
-
Familiarity with data monitoring tools like Datadog or PagerDuty .
-
Experience working with large-scale data warehouses like Redshift Snowflake or BigQuery .
-
A commitment to writing clean efficient and maintainable code.
-
A team player who values diversity and collaboration .
-
Experience interacting with RESTful APIs and webhooks .
-
Familiarity with Kafka or other messaging systems is a plus.
-
Experience with DevOps tools like Terraform is a bonus.
Explore More
Date Posted
09/13/2024
Views
0
Similar Jobs
Senior Software Engineer - Depositary - Visa
Views in the last 30 days - 0
Pismo a tech company founded in 2016 offers cloudbased solutions for banking and fintech The job involves managing card receivables developing project...
View DetailsSr. Software Engineer - Data Platform - Visa
Views in the last 30 days - 0
Pismo is a technology company providing banking and financial infrastructure solutions collaborating with Visa to address technological challenges for...
View DetailsSoftware Engineer - Config UI - Visa
Views in the last 30 days - 0
Pismo is a technology company founded in 2016 offering cloudbased solutions for banking and financial infrastructure They seek a Backend Engineer with...
View DetailsStaff Software Engineer - Authorizer Enablement - Visa
Views in the last 30 days - 0
Pismo a tech company founded in 2016 and partnered with Visa offers cloudbased solutions for banking innovation The job description highlights roles i...
View DetailsStaff Software Engineer - Visa
Views in the last 30 days - 0
Pismo is a technology company founded in 2016 that provides cloudbased solutions for banking and financial infrastructure The company collaborates wit...
View DetailsStaff Software Engineer - Visa
Views in the last 30 days - 0
Pismo is a technology company founded in 2016 that provides cloudbased solutions for banking and fintech collaborating with Visa to address legacy sys...
View Details