Software Engineer – AI, HPC Middleware

Job not on LinkedIn

🔥 0 minutes ago

🗽 New York – Remote

info

⏰ Full Time

🟢 Junior

🟡 Mid-level

🤖 AI Engineer

🦅 H1B Visa Sponsor

info
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Cornelis Networks

Cornelis Networks

51 - 200 employees

🤖 Artificial Intelligence

🔧 Hardware

🏢 Enterprise

💰 $29M Series B on 2022-11

Artificial Intelligence • Hardware • Enterprise

Cornelis Networks is a leading provider of intelligent, scalable, high-performance interconnects designed for AI applications. The company specializes in delivering end-to-end purpose-built high-performance fabrics to commercial, scientific, academic, and government organizations. Cornelis Networks’ solutions are aimed at enhancing performance, scalability, and efficiency across hyperscale, cloud AI, and on-premises AI/HPC environments. Their offerings are known for scalable architecture, high bandwidth solutions, and universal compatibility with accelerators and GPUs. Originating as an Intel spin-off, the company is positioned to challenge existing technologies like InfiniBand and Ethernet, providing advanced interconnects that power modern AI infrastructure.

📋 Description

• Develop and optimize Cornelis Networks' AI/HPC communication middleware • Implement and optimize HPC middleware (MPI/SHMEM) and AI middleware collective communication libraries (CCL), including NCCL/RCCL and related stacks • Integrate middleware capabilities with transport and provider layers such as libfabric/OFI, UCX, and applicable verbs-like semantics • Prepare and submit upstream contributions across MPI/SHMEM projects, CCL ecosystems, and related components • Collaborate with kernel/driver and switch teams to deliver end-to-end performance aligned with the product roadmap • Analyze performance traces and reproduce customer issues • Translate performance findings into fixes • Contribute to features, testing, and upstream open-source work across drivers/kernel, switches, systems, and application/framework teams

🎯 Requirements

• 2+ years of experience in systems programming in C/C++ on Linux • Bachelor's degree in Computer Science, Engineering, or related field, or equivalent experience • Exposure to or coursework/project experience with HPC middleware such as MPI/SHMEM • Exposure to or coursework/project experience with AI collective communication libraries such as NCCL/RCCL, CUDA/ROCm, or other CCL stacks • Familiarity with performance concepts and ability to diagnose issues using profiling/tracing tools, or strong willingness to learn • Foundational understanding of networking and/or RDMA concepts • Experience contributing to open-source projects preferred • Exposure to libfabric providers preferred • Familiarity with Ultra Ethernet (UEC/UET) specifications preferred • Experience with RoCEv2, congestion control, and/or Ethernet-based RDMA deployments preferred • Experience with benchmarking, profiling, and optimization preferred • Background with Omni-Path/OPX or Ethernet-based HPC fabrics preferred

🏖️ Benefits

• Equity, cash, and incentives • Health, medical, dental, and vision coverage • Disability and life insurance • Dependent care flexible spending account • Accidental injury insurance • Pet insurance • Generous paid holidays • 401(k) with company match • Open Time Off (OTO) for regular full-time exempt employees • Sick time • Bonding leave • Pregnancy disability leave • Flexible work environment

Apply Now

Similar Jobs

🔥 2 hours ago

Metanoia IT Solutions GmbH

11 - 50

💼 Consulting

📣 Marketing

📦 Logistics

AI Developer building production LLM features and scalable SaaS products for established clients. Designing evaluations, tracing, and human-in-the-loop agent workflows.

🗣️🇩🇪 German Required

🔥 4 hours ago

M3 USA

201 - 500

🏥 Healthcare

💼 Consulting

⚕️ Healthcare Insurance

AI Engineer building agentic AI applications and workflow automation for M3 USA’s healthcare businesses. Deploying LLM solutions supporting non-technical teams and real end users.

🔥 5 hours ago

Finance of America

501 - 1000

🛡️ Insurance

💸 Finance

🏦 Banking

AI Engineer II building and deploying machine learning solutions for Finance of America’s reverse mortgage business. Developing scalable models, AI applications, and MLOps workflows to improve automation and decision-making.

🔥 8 hours ago

Alight Solutions

10,000+ employees

🤝 B2B

🏥 Healthcare

☁️ SaaS

AI Engineer building agentic assistants and AI delivery infrastructure for Alight, which manages health, wealth, wellbeing, and absence services. Developing retrieval, evaluation, AWS deployment, observability, and developer tooling.

🇺🇸 United States – Remote

💵 $120k - $220k / year

💰 $22.5M Post-IPO Secondary - Alight Solutions on 2023-08

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🕒 Yesterday

Alight Solutions

10,000+ employees

💼 Consulting

🏥 Healthcare

📦 Logistics

AI Engineer building agent infrastructure, retrieval pipelines, evaluation, and deployment automation for Alight’s benefits administration platform. Supporting AI assistants serving over 30 million people.