Voltron Data

Senior Query Optimizer Software Engineer

Remote Remote Worldwide
USD 175k - 210k
PostgreSQL SQL C++ Python R Spark
Search for More Jobs Talk to a recruiter now 💪
Description
We are looking for a highly motivated Senior Query Optimizer Software Engineer to join Voltron Data’s team. On the team, you’ll have the opportunity to help support and grow the Voltron Data and Apache Arrow ecosystems. You will work closely with Voltron Data development teams to build and maintain a SQL parser and query optimizer for large scale single node and distributed query execution engines.
 

Why work at Voltron Data?

  • We are Going for Impact: We are a Series A, venture-backed startup assembling a global team to design next-generation data systems, creating a new foundation for data processing built on composable open standards, with Theseus, our GPU query engine for petabyte-scale ETL, harnessing the speed and efficiency of modern hardware.
  • We are Committed to Bridging Open Source Communities: We are a collection of open source maintainers who have been driving open source ecosystems over the last 15 years, particularly in the C++, Python, and R programming ecosystems.
  • We are Building a Diverse, Inclusive Company:  We are creating a representative, equitable, and respectful workplace that prioritizes employee growth. Everyone at Voltron Data is bought into the company’s success; all voices are critical to shaping the organization’s future. 

Timeline

Below is a rough timeline of where you can expect to be at different points during your career path starting in this position.

Upon joining:

    • Spending time learning about the Apache Arrow compute primitives, compute intermediate representation, compute engine, and other foundational components.
    • Familiarizing yourself with the different partners for compute kernels and the query execution engine on Apache Arrow.
    • Learning and embracing the Apache development process.

Within a month:

    • Becoming familiar with our SQL parser and query optimizer.
    • Benchmarking queries and exploring the effects of different query optimization techniques using our query optimizer.
    • Making changes and improvements to the existing query optimization rules and how it creates physical execution plans for the execution engines under development.

Within 6 months:

    • Adding new query optimization rules.
    • Making improvements to decision making in the cost based optimization based on metadata availability for the tables being queried.
    • Integrating non-SQL operations to the optimization framework.
    • Working with client interfacing engineers to understand performance bottlenecks in customer queries.

Within 12 months:

    • Proposing and implementing improvements to the query parsing and optimization framework.
    • Integrating with a stateful inter-query query engine context to optimize the reusability of compute stages across queries that query the same data in similar ways.

Previous experience that could be helpful:

    • Building and/or using open source query optimization frameworks like Apache Calcite, Apache Spark Catalyst, Postgres Query Optimizer, and/or others.
    • Developing in C++, especially using modern C++.
    • Utilizing serialization libraries like FlatBuffers, Protobuf, Thrift, MessagePack, and/or others.
    • Working on non-SQL systems and non-SQL computational abstractions.

US Compensation - The salary range for this role is between $175,000 to $210,000. We have a global market-based pay structure which varies by location. Please note that the base pay range is a guideline and for candidates who receive an offer, the exact base pay will vary based on factors such as actual work location, skills and experience of the candidate. This position is also eligible for additional incentives such as equity awards.

#LISM1

Benefits

• Work from Anywhere - Payroll and Benefits in 150+ Countries
• Unlimited PTO
• Medical, Dental, and Vision
• Retirement [USA Only]
• Home Office Budget
• Continuing Education Budget
 
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

To All Agencies: Please, no phone calls or emails to any employee of Voltron Data outside of the Talent Acquisition team. Voltron Data's policy is to only accept resumes from agencies via the Voltron Data Agency Portal. Agencies must have a valid fee agreement in place and they must have been assigned the specific requisition to which they submit resumes, by the Talent Acquisition team. Any resume submitted outside of this process will be deemed the sole property of Voltron Data and in the event a candidate is submitted outside of this policy is hired, no fee or payment of any kind will be paid

Voltron Data
Voltron Data
Analytics Hardware Software

30 applies

479 views

Similar Jobs

Jr. Data Scientist

Bengaluru, India

Data Engineer II

Hyderabad, India

Software Engineering II

Hyderabad, India

Principal Applied AI Engineer

San Francisco, CA US

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 340 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Wall Of Love From Fellow Engineers

Frequently Asked Questions

  • Salaries for the engineering jobs on our site range from $100K-$200K. On average, senior engineer positions on our EchoJobs are about $160K.
  • The EchoJobs positions have been sourced and vetted from the top companies to work for in the US as a software engineer, including LinkedIn and other reputable job sites. We also have syndicated jobs from companies that have just raised funding, as well as those that have great unique products and culture. From all of these sources, our founder, Morgan, has also resourced the company's authenticity in terms of their website, public appearance, and more.
  • Yes, our users asked us for just this, so now our search filters allow you to search for your top jobs via location, as well as by onsite, remote, or both. Approximately 30% of our jobs are remote, so you’ve got the best options for you!
  • We have not yet implemented this option, but are considering doing so in the future. For the moment, you would need to cancel your subscription, and resubscribe when you wanted to come back.
  • We add new jobs to EchoJobs every day! We scan our sources for the newest jobs, verify them, and post them to EchoJobs within minutes. We add about 2,000-3,000 new jobs for you each day!
  • From starting your job search to getting hired, the entire job search process can take us software engineers anywhere between 3-6 months. However, at EchoJobs, we’re striving to shorten this duration by finding the best, newest jobs for you, so you can do less job searching, and more applying.
  • We’d recommend checking EchoJobs daily, as we add new jobs to the site each day. Additionally, if you got a chance to read our previous email on “what makes EchoJobs different from any other job search tools,” we also recommended that you set a job alert based on your job filters, so if you get emails on those new jobs, you could be checking more than once per day.
  • If you decide to continue with us after the 1-month trial, we definitely recommend this, as we all know it usually takes 3-6 months to find a quality job as a software engineer these days. So to best support you, we just adjusted our membership options at EchoJobs to monthly, 3 months, or 12 months (this option is more for passive job seekers looking a little bit for the future if they want to come back to work or make a job switch potentially. This lets you see what’s out there in case an even better fit job becomes available.)
  • EchoJobs is truly the only job site of its kind. We want to be THE spot for you to find the best job for you, and haven’t encountered any other company doing this. Other job sites are in niches besides software engineering or focus on a small portion of engineering jobs (like a specific coding language). In the words of Morgan, our founder, “I think what makes EchoJobs different is the amount of jobs, frequency that we add new jobs (we add 2,000-3,000 new jobs daily!), and the powerful search engines to find exactly the job you want more easily and efficiently. We can provide you with the most jobs that are vetted by us, we’ll continually find more new jobs for you, and we make it easier for you to apply and get hired.