Senior Software Engineer – AI/HPC Middleware

🕒 August 13

🗽 New York – Remote

infoinfo

⏰ Full Time

🟠 Senior

🤖 AI Engineer

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Cornelis Networks

Cornelis Networks

51 - 200 employees

🤖 Artificial Intelligence

🔧 Hardware

🏢 Enterprise

💰 $29M Series B on 2022-11

Artificial Intelligence • Hardware • Enterprise

Cornelis Networks is a leading provider of intelligent, scalable, high-performance interconnects designed for AI applications. The company specializes in delivering end-to-end purpose-built high-performance fabrics to commercial, scientific, academic, and government organizations. Cornelis Networks’ solutions are aimed at enhancing performance, scalability, and efficiency across hyperscale, cloud AI, and on-premises AI/HPC environments. Their offerings are known for scalable architecture, high bandwidth solutions, and universal compatibility with accelerators and GPUs. Originating as an Intel spin-off, the company is positioned to challenge existing technologies like InfiniBand and Ethernet, providing advanced interconnects that power modern AI infrastructure.

📋 Description

• Implement and optimize features for HPC middleware (HPI and SHMEM) and AI middleware, including CCL stacks such as NCCL/RCCL • Integrate middleware capabilities with transport and provider layers such as libfabric/OFI, UCX, and verbs-like semantics • Prepare and submit upstream contributions across MPI/SHMEM projects, CCL ecosystems, and related open-source components • Collaborate with kernel/driver and switch teams to deliver end-to-end performance aligned with the product roadmap • Analyze performance traces and reproduce customer issues • Translate customer findings into fixes • Contribute to the design, development, and upstream enablement of AI/HPC communication middleware over Cornelis Networks interconnects • Drive performance, correctness, and deployability across real customer workloads

🎯 Requirements

• 6+ years of experience in systems programming in C/C++ on Linux • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience • Hands-on experience with HPC middleware internals such as Open MPI, MPICH, MVAPICH, and/or SHMEM • Experience optimizing AI collective communications, including NCCL/RCCL, CUDA/ROCm, and/or other CCL stacks • Ability to deliver low-latency/high-throughput communication paths • Ability to diagnose performance issues using profiling and tracing tools • Working knowledge of OFI/libfabric, UCX, and verbs-style concepts • Solid background in RDMA concepts and performance tuning • Experience contributing to open-source projects • Familiarity with Ultra Ethernet (UEC/UET) specifications preferred • Experience with RoCEv2, congestion control, and/or Ethernet-based RDMA deployments preferred • Experience with cluster-scale benchmarking, profiling, and optimization preferred • Background with HPC fabrics such as Omni-Path preferred

🏖️ Benefits

• Equity, cash, and incentives • Health insurance • Retirement benefits • Medical, dental, and vision coverage • Disability and life insurance • Dependent care flexible spending account • Accidental injury insurance • Pet insurance • Generous paid holidays • 401(k) with company match • Open Time Off (OTO) for regular full-time exempt employees • Sick time • Bonding leave • Pregnancy disability leave • Flexible work environment

Apply Now

Similar Jobs

🕒 August 13

M3 USA

201 - 500

🏥 Healthcare

💼 Consulting

⚕️ Healthcare Insurance

AI Engineer building agentic AI applications and workflow automation for M3 USA’s healthcare businesses. Deploying LLM solutions supporting non-technical teams and real end users.

🕒 August 13

EVERSANA

5001 - 10000

💼 Consulting

🏥 Healthcare

⚕️ Healthcare Insurance

Senior AI developer designing production AI workflows, integrations, and cloud solutions for EVERSANA INTOUCH, a healthcare and life sciences marketing agency. Connecting client systems and data to accelerate pharmaceutical marketing operations.

🇺🇸 United States – Remote

💵 $122k - $207k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

infoinfo

🕒 August 13

Voya Financial

5001 - 10000

💼 Consulting

🏥 Healthcare

📣 Marketing

Lead AI product strategy for Voya, a retirement, employee benefits, and investment management company. Build regulated AI experiences for participants, advisors, and plan sponsors.

🇺🇸 United States – Remote

💵 $131k - $183.7k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🕒 August 13

Paramount

10,000+ employees

💼 Consulting

📣 Marketing

📱 Media

Senior Software Engineer building NextJS, FastAPI, and AI-powered products for Paramount Streaming. Owning internal data tools that guide streaming performance, audience, and content decisions.

🇺🇸 United States – Remote

💵 $124k - $186k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

infoinfo

🕒 August 12

SolV Independent Insurance Associates

11 - 50

🏥 Healthcare

⚖️ Legal

📦 Logistics

Senior product engineer building AI-powered healthcare infrastructure at Solv. Developing full-stack products, agents, and workflows that improve patient access and clinic operations.

🇺🇸 United States – Remote

💵 $150k - $210k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok