Senior C++ Storage Engineer

January 5, 2023

Apply Now
Logo of Voltron Data

Voltron Data

Connecting data, hardware, and developers

51 - 200

Description

• Developing high-performance storage and I/O primitives • Benchmarking existing I/O library functions to determine where there are bottlenecks • Participating in peer code review of all PRs related to file storage and interacting with different filesystems • Analyzing I/O throughput in a massively parallel and distributed query engine to identify inefficiencies and crafting solutions to tackle those inefficiencies • Ensuring that the everything related to storage is built as high quality as possible, balancing performance, usability, and maintainability across the Voltron Data and Apache Arrow ecosystems • Developing a comprehensive set of low level benchmarks for I/O functions targeting various local, networked and cloud storage technologies to enable monitoring for performance regressions • Identifying and building reusable software components to ensure a high quality and maintainable codebase

Requirements

• Strong experience developing in C++, especially using Modern C++ • Experience developing and using various data lake storage technologies as: S3, Google Compute Storage, Azure Blob Storage • Building and using distributed networked file systems such as HDFS or Ceph • Experience working with technologies such as io_uring, DMA, RDMA, or GPUDirect Storage • Experience with data lake table formats such as Iceberg, Delta Lake, and Hudi • Experience with data lake formats such as Parquet, Delta Lake, and Avro • Experience with data lake formats such as Iceberg, Delta Lake, and Hudi • Strong experience with C++ development tools such as Apache Arrow • Experience with C++ development tools such as Apache Arrow

Benefits

• Unlimited PTO • Medical, Dental, and Vision • Retirement [USA Only] • Home Office Budget • Continuing Education Budget

Apply Now
Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or lior@remoterocketship.com
Jobs by Title
Remote Account Executive jobsRemote Accounting, Payroll & Financial Planning jobsRemote Administration jobsRemote Android Engineer jobsRemote Backend Engineer jobsRemote Business Operations & Strategy jobsRemote Chief of Staff jobsRemote Compliance jobsRemote Content Marketing jobsRemote Content Writer jobsRemote Copywriter jobsRemote Customer Success jobsRemote Customer Support jobsRemote Data Analyst jobsRemote Data Engineer jobsRemote Data Scientist jobsRemote DevOps jobsRemote Ecommerce jobsRemote Engineering Manager jobsRemote Executive Assistant jobsRemote Full-stack Engineer jobsRemote Frontend Engineer jobsRemote Game Engineer jobsRemote Graphics Designer jobsRemote Growth Marketing jobsRemote Hardware Engineer jobsRemote Human Resources jobsRemote iOS Engineer jobsRemote Infrastructure Engineer jobsRemote IT Support jobsRemote Legal jobsRemote Machine Learning Engineer jobsRemote Marketing jobsRemote Operations jobsRemote Performance Marketing jobsRemote Product Analyst jobsRemote Product Designer jobsRemote Product Manager jobsRemote Project & Program Management jobsRemote Product Marketing jobsRemote QA Engineer jobsRemote SDET jobsRemote Recruitment jobsRemote Risk jobsRemote Sales jobsRemote Scrum Master / Agile Coach jobsRemote Security Engineer jobsRemote SEO Marketing jobsRemote Social Media & Community jobsRemote Software Engineer jobsRemote Solutions Engineer jobsRemote Support Engineer jobsRemote Technical Writer jobsRemote Technical Product Manager jobsRemote User Researcher jobs