Senior Query Optimizer Software Engineer

Voltron Data • Remote

Company

Voltron Data

Location

Remote

Type

Full Time

Job Description

We are looking for a highly motivated Senior Query Optimizer Software Engineer to join Voltron Data’s team. On the team, you’ll have the opportunity to help support and grow the Voltron Data and Apache Arrow ecosystems. You will work closely with Voltron Data development teams to build and maintain a SQL parser and query optimizer for large scale single node and distributed query execution engines.

 

Why work at Voltron Data?

  • We are Going for Impact: We are a Series A, venture-backed startup assembling a global team to design next-generation data systems, creating a new foundation for data processing built on composable open standards, with Theseus, our GPU query engine for petabyte-scale ETL, harnessing the speed and efficiency of modern hardware.
  • We are Committed to Bridging Open Source Communities: We are a collection of open source maintainers who have been driving open source ecosystems over the last 15 years, particularly in the C++, Python, and R programming ecosystems.
  • We are Building a Diverse, Inclusive Company:  We are creating a representative, equitable, and respectful workplace that prioritizes employee growth. Everyone at Voltron Data is bought into the company’s success; all voices are critical to shaping the organization’s future. 
Timeline

Below is a rough timeline of where you can expect to be at different points during your career path starting in this position.

Upon joining:
    • Spending time learning about the Apache Arrow compute primitives, compute intermediate representation, compute engine, and other foundational components.
    • Familiarizing yourself with the different partners for compute kernels and the query execution engine on Apache Arrow.
    • Learning and embracing the Apache development process.
Within a month:
    • Becoming familiar with our SQL parser and query optimizer.
    • Benchmarking queries and exploring the effects of different query optimization techniques using our query optimizer.
    • Making changes and improvements to the existing query optimization rules and how it creates physical execution plans for the execution engines under development.
Within 6 months:
    • Adding new query optimization rules.
    • Making improvements to decision making in the cost based optimization based on metadata availability for the tables being queried.
    • Integrating non-SQL operations to the optimization framework.
    • Working with client interfacing engineers to understand performance bottlenecks in customer queries.
Within 12 months:
    • Proposing and implementing improvements to the query parsing and optimization framework.
    • Integrating with a stateful inter-query query engine context to optimize the reusability of compute stages across queries that query the same data in similar ways.
Previous experience that could be helpful:
    • Building and/or using open source query optimization frameworks like Apache Calcite, Apache Spark Catalyst, Postgres Query Optimizer, and/or others.
    • Developing in C++, especially using modern C++.
    • Utilizing serialization libraries like FlatBuffers, Protobuf, Thrift, MessagePack, and/or others.
    • Working on non-SQL systems and non-SQL computational abstractions.

US Compensation - The salary range for this role is between $175,000 to $210,000. We have a global market-based pay structure which varies by location. Please note that the base pay range is a guideline and for candidates who receive an offer, the exact base pay will vary based on factors such as actual work location, skills and experience of the candidate. This position is also eligible for additional incentives such as equity awards.

#LISM1

Benefits

• Work from Anywhere - Payroll and Benefits in 150+ Countries

• Unlimited PTO

• Medical, Dental, and Vision

• Retirement [USA Only]

• Home Office Budget

• Continuing Education Budget

 

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

To All Agencies: Please, no phone calls or emails to any employee of Voltron Data outside of the Talent Acquisition team. Voltron Data's policy is to only accept resumes from agencies via the Voltron Data Agency Portal. Agencies must have a valid fee agreement in place and they must have been assigned the specific requisition to which they submit resumes, by the Talent Acquisition team. Any resume submitted outside of this process will be deemed the sole property of Voltron Data and in the event a candidate is submitted outside of this policy is hired, no fee or payment of any kind will be paid

Apply Now

Date Posted

05/11/2024

Views

8

Back to Job Listings ❤️Add To Job List Company Info View Company Reviews
Positive
Subjectivity Score: 0.9

Similar Jobs

Software Engineer Networking Software and Services - xAI

Views in the last 30 days - 0

The text describes xAIs mission to develop AI systems for understanding the universe and advancing human knowledge It outlines a role involving networ...

View Details

Senior Design Manager (Infrastructure) - Canonical

Views in the last 30 days - 0

Canonical a leading opensource provider seeks a Senior Design Manager to drive innovation in cloud and AI technologies The role offers remote work glo...

View Details

Senior Product Designer - Org & Security - Typeform

Views in the last 30 days - 0

This job description outlines a role in developing an intelligent contact management system with AI capabilities The position involves designing user ...

View Details

Senior Business Analyst - Xpansiv

Views in the last 30 days - 0

Xpansiv promotes its role as an energy market innovator with a global platform for environmental commodities The job posting seeks a Business Analyst ...

View Details

Senior Specialist Senior Accountant Shared Financial Services - Make-A-Wish America

Views in the last 30 days - 0

The text describes Make a Wish Foundations mission to grant childrens wishes and their community efforts It outlines job positions with remotehybrid o...

View Details

Associate Technical Support Engineer - Recharge

Views in the last 30 days - 0

Recharge is a subscription platform for innovative brands offering customer retention solutions They seek Technical Support roles with 247 coverage em...

View Details