Senior C++ Software Engineer, Data Engines

Job Description

• Spending time learning about the Apache Arrow, the compute primitives we use in Theseus, the query parser and optimizer and other foundational components • Diving into the data processing engine architecture, how all the different components interact with each other and how data flows through the compute graph • Understanding memory management mechanics, including spilling memory from GPU, to Host and Disk • Learning and embracing the software development culture at Voltron Data • Profiling single node and distributed queries executions and analyzing the engine telemetry to better understand how the engine works and how to solve distributed engine issues • Diving deep into the various distributed relational algebra algorithms to understand how they work and how they can be improved • Working with the team on fixing bugs, implementing simple optimizations or code refactoring projects • Building new relational algebra components to expand SQL coverage or DataFrame functionality coverage • Making small improvements to more sophisticated engine components such as resource management, task scheduling, and fault tolerance • Proposing and implementing core architecture improvements to the engine • Working on challenging tasks such as language agnostic user defined functions, multi-query concurrency, and multi-tenancy • Integrating the engine with other components and features developed by other teams in the company to provide enterprise grade customer experiences

Qualifications

• Experience with data processing engines or frameworks • Experience in distributed and multi-threaded systems • Experience in HW resource management including memory and thread pools • Working with SQL and non-SQL systems and their computational abstractions • Developing in C++, especially using modern C++ • Developing for multiple types of hardware (i.e. CPU, GPU)

Benefits

• Work from Anywhere - Payroll and Benefits in 150+ Countries • Unlimited PTO • Medical, Dental, and Vision • Retirement [USA Only] • Home Office Budget • Continuing Education Budget