Staff, Data Engineer - Messaging Data Platform
Company
Twilio
Location
Estonia
Type
Full Time
Job Description
See yourself at Twilio
Join the team as Twilio’s next Staff Data Engineer Messaging Data Platform team.
Who we are & why we’re hiring
Twilio powers real-time business communications and data solutions that help companies and developers worldwide build better applications and customer experiences.
Although we're headquartered in San Francisco we have presence throughout South America Europe Asia and Australia. We're on a journey to becoming a globally anti-racist anti-oppressive anti-bias company that actively opposes racism and all forms of oppression and bias. At Twilio we support diversity equity & inclusion wherever we do business. We employ thousands of Twilions worldwide and we're looking for more builders creators and visionaries to help fuel our growth momentum.
About the job
This position is needed to build and maintain highly scalable reliable and efficient data pipelines that will empower both inbound and outbound messaging stacks not to mention other internal engineering solutions with its data insights interfaces for real-time decision-making.
Responsibilities
In this role you’ll:
-
Oversee the design construction testing and maintenance of advanced scalable data architectures and pipelines.
-
Drive the development of innovative data solutions that meet complex business requirements.
-
Create and enforce best practices for data architecture ensuring scalability reliability and performance.
-
Provide architectural guidance and mentorship to junior engineers.
-
Tackle the most challenging technical issues and provide advanced troubleshooting support.
-
Collaborate with senior leadership to align data engineering strategies with organizational goals.
-
Participate in long-term planning for data infrastructure and analytics initiatives.
-
Lead cross-functional projects ensuring timely delivery and alignment with business objectives.
-
Coordinate with product managers analysts and other stakeholders to define project requirements and scope.
-
Continuously monitor and enhance the performance of data systems and pipelines.
Qualifications
Not all applicants will have skills that match a job description exactly. Twilio values diverse experiences in other industries and we encourage everyone who meets the required qualifications to apply. While having “desired” qualifications make for a strong candidate we encourage applicants with alternative experiences to also apply. If your career is just starting or hasn't followed a traditional path don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table!
Required:
-
3+ years of Java development experience.
-
5+ years of experience with Big Data processing tools and frameworks such as Apache Spark SparkSQL.
-
Experience with Lakehouse technologies such as Apache Hudi Apache Iceberg Databricks Delta Lake.
-
Experience in building AI/ML pipelines.
-
Deep technical understanding of ETL tools low-latency data stores multiple data warehouses and data catalogs.
-
Familiarity with data testing and verification tooling and best practices.
-
Experience with cloud services (AWS preferred Google Azure etc.)
-
Proficient in working with Key-Value Streaming and Search Database technologies including AWS DynamoDB Apache Kafka and ElasticSearch.
-
Readiness to participate in the on-call rotation.
Desired:
-
Demonstrated technical breadth and depth as evidenced by papers code and/or presentations.
-
Exposure to service-oriented architectures microservices and REST APIs.
-
Experience with containerization and orchestration tools (e.g. Docker Kubernetes).
-
Bachelor's degree in Computer Science Engineering or a related field or equivalent training fellowship or work experience.
Location
This role will be based in our Tallinn Estonia office or remotely in Estonia based on your preference.
What We Offer
There are many benefits to working at Twilio including in addition to competitive pay things like generous time-off ample parental and wellness leave healthcare a retirement savings program and much more. Offerings vary by location.
Twilio thinks big. Do you?
We like to solve problems take initiative pitch in when needed and are always up for trying new things. That's why we seek out colleagues who embody our values — something we call Twilio Magic . Additionally we empower employees to build positive change in their communities by supporting their volunteering and donation efforts.
So if you're ready to unleash your full potential do your best work and be the best version of yourself apply now! If this role isn't what you're looking for please consider other open positions .
Date Posted
08/15/2024
Views
3
Similar Jobs
Staff, Software Engineer - Messaging Data Platform - Twilio
Views in the last 30 days - 0
Twilio is seeking a Staff Software Engineer for the Messaging Data Platform team The role involves designing constructing testing and maintaining scal...
View DetailsData Engineer - Messaging Data Platform - Twilio
Views in the last 30 days - 4
Twilio is hiring a Data Engineer to build and maintain scalable data pipelines The role requires 3 years of Java development experience and experience...
View DetailsData Engineer - Messaging Data Platform - Twilio
Views in the last 30 days - 0
Twilio is looking for a Staff Data Engineer to join their Messaging Data Platform team The role involves building and maintaining scalable data pipeli...
View DetailsProduct Manager - Messaging Data Platform - Twilio
Views in the last 30 days - 0
Twilio is looking for a Product Manager to join the Messaging Data Platform product team The role involves crafting and delivering a vision for Twilio...
View DetailsProduct Manager - Messaging Data Platform - Twilio
Views in the last 30 days - 0
Twilio is looking for a Product Manager to join the Messaging Data Platform product team The role involves crafting and delivering a vision for analyt...
View DetailsProduct Manager - Messaging Routing Platform - Twilio
Views in the last 30 days - 0
Twilio is looking for a Product Manager to lead the Messaging Routing Platform team responsible for crafting and delivering the vision strategy and ro...
View Details