Data Engineer

EF is the world leader in international education. Our mission is to break down barriers in language, culture, and geography and so far, we have helped over 15 million people learn a language, discover the world or earn an academic degree. We have 500 schools and offices in over 50 countries and employs over 52,000 staff and teachers. In today's increasingly complex and interdependent world our mission is more relevant than ever.   

The Role

This role is a crucial part of our EdTech Data team. We're a lean and agile group of Data Engineers and Data Scientist focused on building modern cloud-based infrastructure to enable ML for Education. You will be contributing to our event-based, streaming data platform that enables real time insights for teachers and students in the classroom or when studying remotely online.

Want more jobs like this?

Get Data and Analytics jobs in London, United Kingdom delivered to your inbox every week.

Get Jobs

Send me The Muse newsletters for the best in career advice and job search tips.

By signing up, you agree to our Terms of Service & Privacy Policy.

Our current EdTech stack is based on AWS and includes Kafka, Kinesis, Databricks, Airflow, dbt & Snowflake but you will also work with the wider business to develop ETL processes to move data from multiple data sources into our data lake/ warehouse.

Main Responsibilities

• Create and contribute to a data platform that enables self-service analytics and creates the foundation for data science applications across our businesses
• Build batch and streaming pipelines for the purpose of analysis & data science
• Design, implement and maintain the data warehouse
• Support and maintain existing production services

We ask that you have

• AWS, GCP or Azure cloud expertise
• Experience with cloud-based data warehousing (Snowflake, Redshift or similar)
• Experience with Agile methodologies and practices
• Experience using distributed version control systems (e.g. git, mercurial)
• Experience in developing data processing applications in Java/Scala/Python
• Experience working with streaming data sources (e.g. Kinesis Streams or Apache Kafka)
• Experience with Kubernetes, Helm charts and Docker
• Experience with real-time processing engines (e.g. Spark, Flink, Beam, Storm)
• Excellent verbal and written skills in order to effectively communicate with partner teams

We offer a flexible working environment with a lot of autonomy. You'll have the opportunity to shape our data and tech stack and find/ explore opportunities that impact our growth and how our customers learn. We're a highly motivated team, like to challenge each other and collaborate closely on key projects.