Parallel Software Engineer

Job not on LinkedIn

🕒 5 days ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

DataPelago

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded 2022

🤖 Artificial Intelligence

🏢 Enterprise

🤝 B2B

Artificial Intelligence • Enterprise • B2B

DataPelago is a company that provides a universal data processing engine (DataPelago Nucleus) and the DataPelago Accelerator for Spark to dramatically accelerate GenAI and analytics workloads. Their platform leverages heterogeneous accelerated computing (GPUs, FPGAs, and CPUs), integrates with open-source frameworks like Spark, Trino, and Gluten/Substrait, and aims to deliver orders-of-magnitude performance and significant cost reductions with zero changes to applications or vendor lock-in. DataPelago targets enterprise data and AI practitioners, offering deployment guides, benchmarks, and case studies demonstrating large savings and faster processing for large-scale structured, semi-structured, and unstructured datasets.

📋 Description

• Architect: Influence the architecture of how our data processing engine harnesses the parallelism in GPUs and SIMD-capable CPUs efficiently in processing diverse large-scale data. • Design: Lead design of functional and performance enhancements to operators and functions that are accelerated by our engine. • Core Development: Individually design, implement, test, optimize, and maintain parallel implementations of operators and functions on diverse acceleration hardware. • Innovation and Differentiation: Analyze advances in accelerated computing hardware, programming models, and related tools and ensure our engine extends technology and product leadership. • Collaboration: Partner effectively with the execution engine engineering team in integrating parallel software components with the overall engine. • Continuous Improvement: Foster best practices in design and code reviews, testing, CI/CD, and issue resolution to maintain highest product quality, security, efficiency, & productivity.

🎯 Requirements

• Bachelor's degree in Computer Science or a related field with 5+ years of relevant experience OR a Master's degree in Computer Science or a related field with 3+ years of relevant experience. • 3+ years of deep technical experience in developing production applications that process large scale data using SIMD-extensions of CPUs (e.g., AVX), GPU programming models (e.g., CUDA, ROCm), or equivalent accelerated computing framework. • Demonstrated experience working with software libraries, development tools, and profiling tools specific to parallel and accelerated computing. • Demonstrated experience in troubleshooting and resolving functional and performance anomalies in both pre- and post-production scenarios. • Strong knowledge of computer architecture. • Exceptional programming skills in C, C++. • Extensive development experience in Linux environments. • Strong analytical and problem-solving skills with a passion for performance optimization.

🏖️ Benefits

• Competitive compensation • Stock options • Comprehensive benefits package • Leadership development opportunities