Senior Software Engineer, Ads Measurement

OVERVIEW

ABOUT THE ROLE

Are you ready to take your development skills to the next level? We’re looking for a Senior Software Engineer to join our Ads Measurement Data Pipelines team. You’ll be a key player in the evolution of our Ads suite and help build a world-class system that supports all our advertisers, retailers, customers and internal data consumers. You will help evolve and scale our Ads products and infrastructure in partnership with Product Designers, Product Managers, Data Scientists, Machine Learning Engineers and other cross-functional partners. 

The Instacart Ads team is building the next generation of our ads products and supporting infrastructure, so you will be part of the team that’s responsible for building and maintaining petabyte-scale data processing systems that are used for billing, reporting, attribution, experimentation and driving business decisions.

Our products are used by millions of people every year. To meet–and exceed–expectations we are rapidly improving and modernizing our ads platform, helping raise the quality bar for our products across the entire organization. Sound exciting? Keep reading.

ABOUT THE TEAM

The Ads Measurement Data Pipelines team is a diverse group of spirited and highly-dedicated engineers. We deal with complex, large-scale data solutions that are the backbone of Instacart's innovative advertising platform. 

Our team thrives on dynamic challenges, and we take pride in developing and maintaining scalable and fault-tolerant data processing systems. We've embraced a culture of open and candid collaboration where everyone's views matter, allowing us to continuously innovate and make substantial impact to the digital advertising industry through our work.

Our tech stack includes but is not limited to Scala, Apache Spark, Databricks, Delta Lake, Snowflake, Python, Terraform and Apache Airflow. We believe in constantly learning, growing and adopting the most efficient practices that enable us to deliver quality data services to our stakeholders. If you're a detective at heart, love solving complex problems, and are passionate about the intersection of data and technology, you'll fit right in!

ABOUT THE JOB

We believe that high-quality data is essential for any business organization, as such we are looking for a strong software engineer excited to raise our efficiency, quality and scalability bar. You will be part of a team of ~10 engineers with extensive ownership and the ability to help set best practices and contribute to product and infrastructure features. 

As a craft leader, you'll be responsible for contributing to the vision, strategy and development of Nebula, our Ads data processing platform. You will advocate for data quality, correctness, scalability and latency standards to ensure consistency in how we enable data-driven decisions and features across the organization. 

You will also be proactive in spearheading new initiatives, coding and documenting components, writing and reviewing system design documents and partnering with other teams and functions to gather and understand our customer's requirements. You will think and plan strategically for short and long term initiatives to continue shaping our platform and products.

ABOUT YOU

MINIMUM QUALIFICATIONS

• Bachelor's degree or higher in Computer Science, Software Engineering, or a related field, or equivalent proven industry experience (4+ years).
• 5+ years of experience in software engineering.
• Comprehensive understanding of distributed systems and proven experience with big data technologies such as Spark, Hadoop, Flink, Hive or Kafka.
• Highly proficient with SQL, capable of writing and reviewing complex queries for data analysis and debugging.
• You can design for scale with the entire system in mind.
• Solid communicator, comfortable seeking and receiving feedback.
• Strong analytical and debugging skills.
• Strong sense of ownership working with a large codebase and diverse suite of products.
• A collaborative mindset to be able to partner with engineers, designers and PM's from multiple teams to co-create impactful solutions while supporting system contributions.
• Strong organizational skills with the ability to communicate and present ideas clearly and influence key stakeholders at the manager, director, and VP level.

PREFERRED QUALIFICATIONS

• Prior work experience in the digital advertising industry.
• Experience with both streaming and batch data pipelines.
• Proven experience with distributed system design.
• Proficiency with Scala, Spark and Delta Lake.
• Strong general programming and algorithm skills.
• Strong attention to detail and accuracy in the implementation, keen eye for edge cases and code reviews. 
• Strong experience writing complex SQL queries.
• Data driven mindset.

#LI-Remote