Technical Lead II - Data Infrastructure, Backend

POS-16866

HubSpot is seeking a Technical Lead II to join the Data Infrastructure—Batch Processing Team.

About the team

The Batch Processing Team makes processing large datasets at HubSpot unified fast and easy. We provide a suite of tools platforms and processes based on Spark Hadoop and Iceberg.

Our platform supports thousands of processing jobs daily across hundreds of Spark and Hadoop clusters processing a petabyte of customer data per day. We deliver this platform on AWS through a Kubernetes control plane across multiple data centers and regions. Through supporting tools and libraries we enable teams across the engineering organization by defining developing and advocating for best practices that help them process data effectively reliably and with high performance.

Typical projects include developing tools and client libraries as well as implementing core orchestration and deployment functionality within our suite of Kubernetes operators. This past year we introduced an Iceberg lakehouse platform that's driving substantial improvements in interoperability and cost savings as new ML and AI workloads ramp up.

What we're looking for

This role offers a unique opportunity to work at scale on a team pushing the boundaries of a business-critical system. As an engineer you'll design and solve problems in large distributed systems and develop software in Java. As a technical lead you'll own the roadmap and strategy for these platforms balance competing demands across a portfolio of technologies and craft the platform into a true product that provides leverage for hundreds of engineers at HubSpot.

Role Responsibilities:

• Lead a team of 3–5 engineers as a player-coach

• Design and implement scalable backend services libraries tools and automation for data store operations and usage

• Collaborate with engineering teams to reliably integrate data processing technologies into their stack

• Support the uptime and reliability of database systems

• Work in a dynamic agile environment to deliver comprehensive solutions that address user needs

• Conduct code reviews contribute to internal tooling and maintain high coding standards for application reliability and performance

• Coach the team to work iteratively experiment with new ideas and embrace a startup mentality of learning fast and adapting quickly

• Continuously learn and adapt to new technologies and frameworks to keep our solutions at the forefront of innovation

Ideal Candidate:

• Has extensive experience in the Spark or Hadoop ecosystems and backend platform or infrastructure development with proficiency in Java

• Has experience delivering infrastructure platforms to other engineering teams and understands how to build infrastructure as a product

• Has a history of developing solutions that have had an outsized impact on organizational business goals

• Thrives in a collaborative environment with strong communication skills and the ability to work effectively with teams across the organization

• Is innovative and entrepreneurial with a keen interest in staying ahead of technology trends particularly in AI and machine learning

• Demonstrates strong ownership of projects end-to-end with a track record of successfully rolling out infrastructure and collaborating with multiple engineering teams to deliver results

• Has proven ability to solve complex technical problems and analyze trade-offs with empathy for developers

Bonus points for:

• Experience developing automation or power-user expertise with technologies such as Iceberg Doris Trino and Flink

• Interest and experience actively supporting infrastructure at scale on Kubernetes

• Interest and experience contributing to open source software

Pay & Benefits

The cash compensation below includes base salary on-target commission for employees in eligible roles and annual bonus targets under HubSpot’s bonus plan for eligible roles. In addition to cash compensation some roles are eligible to participate in HubSpot’s equity plan to receive restricted stock units (RSUs). Some roles may also be eligible for overtime pay. Individual compensation packages are tailored to your skills experience qualifications and other job-related reasons.

This resource will help guide how we recommend thinking about the range you see. Learn more about HubSpot’s compensation philosophy .

Benefits are also an important piece of your total compensation package. Explore the benefits and perks HubSpot offers to help employees grow better.

At HubSpot fair compensation practices aren’t just about checking off the box for legal compliance. It’s about living out our value of transparency with our employees candidates and community.

Annual Cash Compensation Range:

$200600—$321000 USD