Senior Software Engineer – AI/HPC Middleware

🔥 0 minutes ago

🗽 New York – Remote

info

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

info
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Cornelis Networks

Cornelis Networks

51 - 200 employees

🤖 Artificial Intelligence

🔧 Hardware

🏢 Enterprise

💰 $29M Series B on 2022-11

Artificial Intelligence • Hardware • Enterprise

Cornelis Networks is a leading provider of intelligent, scalable, high-performance interconnects designed for AI applications. The company specializes in delivering end-to-end purpose-built high-performance fabrics to commercial, scientific, academic, and government organizations. Cornelis Networks’ solutions are aimed at enhancing performance, scalability, and efficiency across hyperscale, cloud AI, and on-premises AI/HPC environments. Their offerings are known for scalable architecture, high bandwidth solutions, and universal compatibility with accelerators and GPUs. Originating as an Intel spin-off, the company is positioned to challenge existing technologies like InfiniBand and Ethernet, providing advanced interconnects that power modern AI infrastructure.

📋 Description

• Implement and optimize features for HPC middleware (HPI and SHMEM) and AI middleware, including CCL stacks such as NCCL/RCCL • Integrate middleware capabilities with transport and provider layers such as libfabric/OFI, UCX, and verbs-like semantics • Prepare and submit upstream contributions across MPI/SHMEM projects, CCL ecosystems, and related open-source components • Collaborate with kernel/driver and switch teams to deliver end-to-end performance aligned with the product roadmap • Analyze performance traces and reproduce customer issues • Translate customer findings into fixes • Contribute to the design, development, and upstream enablement of AI/HPC communication middleware over Cornelis Networks interconnects • Drive performance, correctness, and deployability across real customer workloads

🎯 Requirements

• 6+ years of experience in systems programming in C/C++ on Linux • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience • Hands-on experience with HPC middleware internals such as Open MPI, MPICH, MVAPICH, and/or SHMEM • Experience optimizing AI collective communications, including NCCL/RCCL, CUDA/ROCm, and/or other CCL stacks • Ability to deliver low-latency/high-throughput communication paths • Ability to diagnose performance issues using profiling and tracing tools • Working knowledge of OFI/libfabric, UCX, and verbs-style concepts • Solid background in RDMA concepts and performance tuning • Experience contributing to open-source projects • Familiarity with Ultra Ethernet (UEC/UET) specifications preferred • Experience with RoCEv2, congestion control, and/or Ethernet-based RDMA deployments preferred • Experience with cluster-scale benchmarking, profiling, and optimization preferred • Background with HPC fabrics such as Omni-Path preferred

🏖️ Benefits

• Equity, cash, and incentives • Health insurance • Retirement benefits • Medical, dental, and vision coverage • Disability and life insurance • Dependent care flexible spending account • Accidental injury insurance • Pet insurance • Generous paid holidays • 401(k) with company match • Open Time Off (OTO) for regular full-time exempt employees • Sick time • Bonding leave • Pregnancy disability leave • Flexible work environment

Apply Now

Similar Jobs

🔥 52 minutes ago

Solventum

10,000+ employees

🏥 Healthcare

📦 Logistics

💼 Consulting

AI Architect building scalable healthcare AI platforms for Solventum, a company developing health, material, and data science solutions. Designing LLM, RAG, and multi-agent systems for healthcare applications.

🔥 2 hours ago

Metanoia IT Solutions GmbH

11 - 50

💼 Consulting

📣 Marketing

📦 Logistics

AI Developer building production LLM features and scalable SaaS products for established clients. Designing evaluations, tracing, and human-in-the-loop agent workflows.

🗣️🇩🇪 German Required

🔥 4 hours ago

Mitratech

1001 - 5000

💼 Consulting

⚖️ Legal

🤖 Artificial Intelligence

Senior AI Engineer building and operating AWS-native LLM agents for Mitratech’s legal, risk, compliance, and HR software. Owning agent workflows, RAG architectures, MCP servers, evaluation pipelines, and production reliability.

🔥 4 hours ago

M3 USA

201 - 500

🏥 Healthcare

💼 Consulting

⚕️ Healthcare Insurance

AI Engineer building agentic AI applications and workflow automation for M3 USA’s healthcare businesses. Deploying LLM solutions supporting non-technical teams and real end users.

🔥 5 hours ago

Finance of America

501 - 1000

🛡️ Insurance

💸 Finance

🏦 Banking

AI Engineer II building and deploying machine learning solutions for Finance of America’s reverse mortgage business. Developing scalable models, AI applications, and MLOps workflows to improve automation and decision-making.