Senior Staff Software Engineer, Data Platform

OVERVIEW

Our backend systems power the clients used by millions of customers every year to buy their groceries online. These systems must also support tight integration with the largest retailers in the US and Canada. Engineering at Instacart provides the opportunity to work on challenging scaling problems while also designing the features that will define our industry. You will learn how to build in an open collaborative environment serving millions of requests daily.

The Data Platform team provides a robust and cutting edge platform to process petabytes of data daily using industry best practices. We work closely with Product/Data Science/ML teams to understand their needs and provide high quality solutions.

The team is still small and many of our bigger initiatives are at an early stage. We expect you to work closely with stakeholders and shape these systems from design, technical decisions, project management to execution.

You will be responsible for driving the Data Strategy and building the platform that Instacart data lake will be built upon.

Instacart's technology is constantly changing and adapting. Some of the technologies you would use at Instacart include:

Scala, Python, Postgres, Snowflake, DeltaLake, Iceberg, Clickhouse, Spark, DBT, Flink Kafka, Airflow

If you have experience with these technologies, you will have the opportunity to dive deeper. If you haven't used these technologies you will have the chance to learn from the collective experience of our team.

ABOUT THE JOB

• You will work closely with other teams to understand their main pain points and translate them into self-serve and reliable solutions.
• You are expected to mentor other team members and be a champion of engineering  excellence.
• You will be part of a small team, with a large amount of ownership and autonomy for managing things directly.
• You will have the freedom to suggest and drive organization-wide initiatives.

ABOUT YOU

MINIMUM QUALIFICATIONS

• Self-motivation and an enjoyment for a startup environment
• A strong sense of ownership
• Strong knowledge of common data infra technologies (Python, Scala, Kafka, Airflow, Spark) in a production environment
• Strong knowledge of common industry datastores (Postgres, ElasticSearch, Cassandra)
• An ability to balance a sense of urgency with shipping high quality and pragmatic solutions
• Experience working with a large codebase on a cross functional team.
• Strong knowledge of SQL
• 12+ years of working experience in a similar field/environment

PREFERRED QUALIFICATIONS

• Bachelor’s degree in Computer Science, computer engineering, electrical engineering OR equivalent work experience

#LI-Remote