Senior Software Engineer - Developer Productivity

We are looking for an adaptable and inquisitive Senior Software Engineer to join Voltron Data’s team. On the team you’ll have the opportunity to help guide measure and contribute to the Voltron Data and Apache Arrow ecosystems. Voltron Data is fundamentally data-driven and this team is at the core of running measuring persisting and communicating what drives our development and product improvements. You will build tools and infrastructure to measure analyze and make data-backed decisions. This work will be very collaborative: you’ll work with Data Scientists with expertise in data analysis and data communication you’ll work with developers of Arrow and other Voltron Data software and you’ll work with product managers who need to access and understand the metrics the tools you build produce.

Why work at Voltron Data?

• We are Going for Impact : We are a Series A venture-backed startup assembling a global team to design next-generation data systems creating a new foundation for data processing built on composable open standards with Theseus our GPU query engine for petabyte-scale ETL harnessing the speed and efficiency of modern hardware.

• We are Committed to Bridging Open Source Communities: We are a collection of open source maintainers who have been driving open source ecosystems over the last 15 years particularly in the C++ Python and R programming ecosystems.

• We are Building a Diverse Inclusive Company: We are creating a representative equitable and respectful workplace that prioritizes employee growth. Everyone at Voltron Data is bought into the company’s success; all voices are critical to shaping the organization’s future.

Upon Joining:

• Spend time familiarizing yourself with Conbench and other benchmarking standards and tools

• Becoming familiar with current continuous benchmarking for Apache Arrow and Voltron Data

• Learning and adopting the Apache development process

Within a month:

• Learn details about how we collect our current metrics and benchmarking data

• Build modular tools that facilitate benchmarking (both continuously and as part of developer workflows): environment and configuration collection communication with the conbench API basic results handling

• Collaborate with DevOps to run benchmarks in various development environments

• Triaging regressions and working with engineering teams to find root cause and ensuring the issue resolution.

Within 6 months:

• Collaborate with Voltron Data team members to develop improve automation of benchmarking and profiling

• Develop monitoring and alerting tools that are targeted reliable and actionable

• Further iterate on modular tools that make writing running and reporting on benchmarks easy and reliable — finding what our tools are lacking and fixing adding and reimagining until they are a joy to use

• Design deployment strategies for benchmarking of distributed algorithms

Within 12 months:

• Someone in this role will have the opportunity to grow in a number of different directions. Here is a selection of possible directions (we expect no single candidate to do all of them and there are many areas not listed here). Specifically you will research design build and implement appropriate frameworks tools and infrastructure for:

  • Continuous improvements of benchmarking environments by adding features in current framework to improve Theseus development and benchmarking velocity and extending benchmarking coverage.

  • Tracing profiling and logging (especially ones that work well in distributed systems)

  • Performance-related research and development

Previous experience that could be helpful:

• Experience with Python software development

• Experience with SQL query systems. Familiarity with data processing frameworks.

• User-focused software development — having a knack for what makes something easy to use and striving to make everything that way

• Experience building tools with an emphasis on developing tools that are a delight to use

• Experience with Continuous Integration and Delivery

US Compensation - The salary range for this role is between $160000-$190000. We have a global market-based pay structure which varies by location. Please note that the base pay range is a guideline and for candidates who receive an offer the exact base pay will vary based on factors such as actual work location skills and experience of the candidate. This position is also eligible for additional incentives such as equity awards.

To All Agencies: Please no phone calls or emails to any employee of Voltron Data outside of the Talent Acquisition team. Voltron Data's policy is to only accept resumes from agencies via the Voltron Data Agency Portal. Agencies must have a valid fee agreement in place and they must have been assigned the specific requisition to which they submit resumes by the Talent Acquisition team. Any resume submitted outside of this process will be deemed the sole property of Voltron Data and in the event a candidate is submitted outside of this policy is hired no fee or payment of any kind will be paid