Senior Software Engineer - Analytics Data Platform Lakehouse

Analytics Data Platform Lakehouse team builds and operates the foundations that power data engineers applied AI and product teams—managing millions of tables on their behalf and simplifying operations from maintenance and observability to governance for both internal and customer-facing use cases. If you're excited by the intersection of petabyte data processing scale open-source query engines and building platforms with real product stakes this is the team for you.

At Datadog we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

What You’ll Do: 

• Design build and operate core components of our lakehouse platform including Apache Iceberg table management (data compaction data layout optimization materialized view scheduling…) and Iceberg catalog
• Drive adoption of open table formats across internal teams owning the integration of Trino Spark and other query engines (DuckDB Puppygraph…) with our Iceberg-based at petabyte scale
• Build observability for managed iceberg tables to identify query performance bottlenecks cost drivers and contribute fixes back to upstream open-source projects (Iceberg Trino Spark Open Lineage) where relevant
• Build self-serve tooling and abstractions that allow data engineering teams to reliably run thousands of pipelines per day against our lakehouse
• Collaborate with data engineers analysts and infrastructure teams to define the roadmap for our lakehouse architecture and shape how Datadog manages analytic data at scale

Who You Are: 

• You have a BS/MS/PhD in Computer Science Engineering or a related field or equivalent professional experience
• You have deep production-grade experience with one or more of Apache Iceberg Trino or Apache Spark ideally demonstrated through significant open-source contributions: merged PRs committer status or PMC membership on projects 
• You have built or operated large-scale distributed data systems
• You have a solid grasp of query planning columnar file formats (Parquet ORC) and table format internals (snapshots manifests partition evolution)
• You are fluent in Java Scala or Go and comfortable with Python for pipeline tooling
• You have experience deploying and running data infrastructure on Kubernetes in cloud environments

Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills we encourage you to apply.

#LI-LB1

What We Do

Datadog (NASDAQ: DDOG) is a global SaaS business delivering a rare combination of growth and profitability. We are on a mission to break down silos and solve complexity in the cloud age by enabling digital transformation cloud migration and infrastructure monitoring of our customers' entire technology stacks. Built by engineers for engineers Datadog is used by organizations of all sizes across a wide range of industries. Together we champion professional development diversity of thought innovation and work excellence to empower continuous growth. Join the pack and become part of a collaborative pragmatic and thoughtful people-first community where we solve tough problems take smart risks and celebrate one another.

Why Work With Us

At Datadog we learn from and celebrate each other daily - each win is a team win. Datadogs solve tough problems innovate pragmatically and grow together. We promote from within provide mentorship and opportunities for career development and support our colleagues in the process. Best of all? We truly love what we do.

Gallery