Parallel Software Engineer

Job not on LinkedIn

October 29

🏄 California – Remote

Although this job is listed in California, this company may be open to hiring remote in other states.

⏰ Full Time

🟡 Mid-level

🟠 Senior

🧑‍💻 Full-stack Engineer

🦅 H1B Visa Sponsor

Apply Now

Receive Emails with Similar Jobs

DataPelago

WebsiteLinkedInAll Job Openings

Artificial Intelligence • Enterprise • B2B

DataPelago is a company that provides a universal data processing engine (DataPelago Nucleus) and the DataPelago Accelerator for Spark to dramatically accelerate GenAI and analytics workloads. Their platform leverages heterogeneous accelerated computing (GPUs, FPGAs, and CPUs), integrates with open-source frameworks like Spark, Trino, and Gluten/Substrait, and aims to deliver orders-of-magnitude performance and significant cost reductions with zero changes to applications or vendor lock-in. DataPelago targets enterprise data and AI practitioners, offering deployment guides, benchmarks, and case studies demonstrating large savings and faster processing for large-scale structured, semi-structured, and unstructured datasets.

51 - 200 employees

Founded 2022

🤖 Artificial Intelligence

🏢 Enterprise

🤝 B2B

📋 Description

• Architect: Influence the architecture of how our data processing engine harnesses the parallelism in GPUs and SIMD-capable CPUs efficiently in processing diverse large-scale data. • Design: Lead design of functional and performance enhancements to operators and functions that are accelerated by our engine. • Core Development: Individually design, implement, test, optimize, and maintain parallel implementations of operators and functions on diverse acceleration hardware. • Innovation and Differentiation: Analyze advances in accelerated computing hardware, programming models, and related tools and ensure our engine extends technology and product leadership. • Collaboration: Partner effectively with the execution engine engineering team in integrating parallel software components with the overall engine. • Continuous Improvement: Foster best practices in design and code reviews, testing, CI/CD, and issue resolution to maintain highest product quality, security, efficiency, & productivity.

🎯 Requirements

• Bachelor's degree in Computer Science or a related field with 5+ years of relevant experience OR a Master's degree in Computer Science or a related field with 3+ years of relevant experience. • 3+ years of deep technical experience in developing production applications that process large scale data using SIMD-extensions of CPUs (e.g., AVX), GPU programming models (e.g., CUDA, ROCm), or equivalent accelerated computing framework. • Demonstrated experience working with software libraries, development tools, and profiling tools specific to parallel and accelerated computing. • Demonstrated experience in troubleshooting and resolving functional and performance anomalies in both pre- and post-production scenarios. • Strong knowledge of computer architecture. • Exceptional programming skills in C, C++. • Extensive development experience in Linux environments. • Strong analytical and problem-solving skills with a passion for performance optimization.

🏖️ Benefits

• Technology Leadership: Shape the architecture and development of core parallel data processing functions of our engine. • Cutting-Edge Innovation: Work on challenging problems at the forefront of accelerated computing and data processing. • Significant Impact: Your contributions will directly impact the performance and scalability of our mission-critical platform. • Growth: Expand your technical expertise and scope of responsibilities working with other talented engineers and with a growing product. • Competitive compensation, stock options, comprehensive benefits package, leadership development opportunities