Senior Software Engineer – AI/HPC Middleware

🕒 August 13

🗽 New York – Remote

infoinfo

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

infoinfo

👻 Ghost score 13%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Cornelis Networks

Cornelis Networks

51 - 200 employees

🤖 Artificial Intelligence

🔧 Hardware

🏢 Enterprise

💰 $29M Series B on 2022-11

Artificial Intelligence • Hardware • Enterprise

Cornelis Networks is a leading provider of intelligent, scalable, high-performance interconnects designed for AI applications. The company specializes in delivering end-to-end purpose-built high-performance fabrics to commercial, scientific, academic, and government organizations. Cornelis Networks’ solutions are aimed at enhancing performance, scalability, and efficiency across hyperscale, cloud AI, and on-premises AI/HPC environments. Their offerings are known for scalable architecture, high bandwidth solutions, and universal compatibility with accelerators and GPUs. Originating as an Intel spin-off, the company is positioned to challenge existing technologies like InfiniBand and Ethernet, providing advanced interconnects that power modern AI infrastructure.

📋 Description

• Implement and optimize features for HPC middleware (HPI and SHMEM) and AI middleware, including CCL stacks such as NCCL/RCCL • Integrate middleware capabilities with transport and provider layers such as libfabric/OFI, UCX, and verbs-like semantics • Prepare and submit upstream contributions across MPI/SHMEM projects, CCL ecosystems, and related open-source components • Collaborate with kernel/driver and switch teams to deliver end-to-end performance aligned with the product roadmap • Analyze performance traces and reproduce customer issues • Translate customer findings into fixes • Contribute to the design, development, and upstream enablement of AI/HPC communication middleware over Cornelis Networks interconnects • Drive performance, correctness, and deployability across real customer workloads

🎯 Requirements

• 6+ years of experience in systems programming in C/C++ on Linux • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience • Hands-on experience with HPC middleware internals such as Open MPI, MPICH, MVAPICH, and/or SHMEM • Experience optimizing AI collective communications, including NCCL/RCCL, CUDA/ROCm, and/or other CCL stacks • Ability to deliver low-latency/high-throughput communication paths • Ability to diagnose performance issues using profiling and tracing tools • Working knowledge of OFI/libfabric, UCX, and verbs-style concepts • Solid background in RDMA concepts and performance tuning • Experience contributing to open-source projects • Familiarity with Ultra Ethernet (UEC/UET) specifications preferred • Experience with RoCEv2, congestion control, and/or Ethernet-based RDMA deployments preferred • Experience with cluster-scale benchmarking, profiling, and optimization preferred • Background with HPC fabrics such as Omni-Path preferred

🏖️ Benefits

• Equity, cash, and incentives • Health insurance • Retirement benefits • Medical, dental, and vision coverage • Disability and life insurance • Dependent care flexible spending account • Accidental injury insurance • Pet insurance • Generous paid holidays • 401(k) with company match • Open Time Off (OTO) for regular full-time exempt employees • Sick time • Bonding leave • Pregnancy disability leave • Flexible work environment

Apply Now

Similar Jobs

🕒 August 13

Solventum

10,000+ employees

🏥 Healthcare

📦 Logistics

💼 Consulting

AI Architect building scalable GenAI and agentic AI platforms for Solventum, a healthcare innovation company. Designing production-grade systems for clinical, revenue-cycle, and patient-engagement applications.

🇺🇸 United States – Remote

💵 $184.4k - $253.6k / year

⏰ Full Time

🟠 Senior

🔴 Lead

🤖 AI Engineer

Cloud

Python

PyTorch

Tensorflow

🕒 August 13

Metanoia IT Solutions GmbH

11 - 50

💼 Consulting

📣 Marketing

📦 Logistics

AI Developer building production LLM features and scalable SaaS products for established clients. Designing evaluations, tracing, and human-in-the-loop agent workflows.

🇺🇸 United States – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🗣️🇩🇪 German Required

🕒 August 13

M3 USA

201 - 500

🏥 Healthcare

💼 Consulting

⚕️ Healthcare Insurance

AI Engineer building agentic AI applications and workflow automation for M3 USA’s healthcare businesses. Deploying LLM solutions supporting non-technical teams and real end users.

🕒 August 13

Finance of America

501 - 1000

🛡️ Insurance

💸 Finance

🏦 Banking

AI Engineer II building and deploying machine learning solutions for Finance of America’s reverse mortgage business. Developing scalable models, AI applications, and MLOps workflows to improve automation and decision-making.

🇺🇸 United States – Remote

💵 $130k - $150k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

infoinfo

AWS

Azure

Cloud

Python

PyTorch

Scikit-Learn

Tensorflow

🕒 August 13

EVERSANA

5001 - 10000

💼 Consulting

🏥 Healthcare

⚕️ Healthcare Insurance

Senior AI developer designing production AI workflows, integrations, and cloud solutions for EVERSANA INTOUCH, a healthcare and life sciences marketing agency. Connecting client systems and data to accelerate pharmaceutical marketing operations.

🇺🇸 United States – Remote

💵 $122k - $207k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

infoinfo