Software Engineer – AI, HPC Middleware

🕒 August 13

🗽 New York – Remote

infoinfo

⏰ Full Time

🟢 Junior

🟡 Mid-level

🤖 AI Engineer

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Cornelis Networks

Cornelis Networks

51 - 200 employees

🤖 Artificial Intelligence

🔧 Hardware

🏢 Enterprise

💰 $29M Series B on 2022-11

Artificial Intelligence • Hardware • Enterprise

Cornelis Networks is a leading provider of intelligent, scalable, high-performance interconnects designed for AI applications. The company specializes in delivering end-to-end purpose-built high-performance fabrics to commercial, scientific, academic, and government organizations. Cornelis Networks’ solutions are aimed at enhancing performance, scalability, and efficiency across hyperscale, cloud AI, and on-premises AI/HPC environments. Their offerings are known for scalable architecture, high bandwidth solutions, and universal compatibility with accelerators and GPUs. Originating as an Intel spin-off, the company is positioned to challenge existing technologies like InfiniBand and Ethernet, providing advanced interconnects that power modern AI infrastructure.

📋 Description

• Develop and optimize Cornelis Networks' AI/HPC communication middleware • Implement and optimize HPC middleware (MPI/SHMEM) and AI middleware collective communication libraries (CCL), including NCCL/RCCL and related stacks • Integrate middleware capabilities with transport and provider layers such as libfabric/OFI, UCX, and applicable verbs-like semantics • Prepare and submit upstream contributions across MPI/SHMEM projects, CCL ecosystems, and related components • Collaborate with kernel/driver and switch teams to deliver end-to-end performance aligned with the product roadmap • Analyze performance traces and reproduce customer issues • Translate performance findings into fixes • Contribute to features, testing, and upstream open-source work across drivers/kernel, switches, systems, and application/framework teams

🎯 Requirements

• 2+ years of experience in systems programming in C/C++ on Linux • Bachelor's degree in Computer Science, Engineering, or related field, or equivalent experience • Exposure to or coursework/project experience with HPC middleware such as MPI/SHMEM • Exposure to or coursework/project experience with AI collective communication libraries such as NCCL/RCCL, CUDA/ROCm, or other CCL stacks • Familiarity with performance concepts and ability to diagnose issues using profiling/tracing tools, or strong willingness to learn • Foundational understanding of networking and/or RDMA concepts • Experience contributing to open-source projects preferred • Exposure to libfabric providers preferred • Familiarity with Ultra Ethernet (UEC/UET) specifications preferred • Experience with RoCEv2, congestion control, and/or Ethernet-based RDMA deployments preferred • Experience with benchmarking, profiling, and optimization preferred • Background with Omni-Path/OPX or Ethernet-based HPC fabrics preferred

🏖️ Benefits

• Equity, cash, and incentives • Health, medical, dental, and vision coverage • Disability and life insurance • Dependent care flexible spending account • Accidental injury insurance • Pet insurance • Generous paid holidays • 401(k) with company match • Open Time Off (OTO) for regular full-time exempt employees • Sick time • Bonding leave • Pregnancy disability leave • Flexible work environment

Apply Now

Similar Jobs

🕒 August 13

M3 USA

201 - 500

🏥 Healthcare

💼 Consulting

⚕️ Healthcare Insurance

AI Engineer building agentic AI applications and workflow automation for M3 USA’s healthcare businesses. Deploying LLM solutions supporting non-technical teams and real end users.

🕒 August 10

Huron

5001 - 10000

🏥 Healthcare

📦 Logistics

📣 Marketing

Forward Deployed Engineer building and testing full-stack AI solutions on AWS and Azure for Huron’s consulting clients. Collaborating directly with business users inside delivery pods.

🇺🇸 United States – Remote

💵 $120k - $145k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

infoinfo

🕒 August 7

Seso Inc.

11 - 50

💼 Consulting

📦 Logistics

🌾 Agriculture

Software Engineer building production AI agents for Seso’s agricultural workforce platform. Developing end-to-end TypeScript, Node.js, and React features for modern farm payroll and workforce management.

🇺🇸 United States – Remote

💵 $160k - $220k / year

⏰ Full Time

🟢 Junior

🟡 Mid-level

🤖 AI Engineer

🚫👨‍🎓 No degree required

🕒 August 4

EMCOR Group, Inc.

10,000+ employees

📦 Logistics

🏭 Manufacturing

🏥 Healthcare

AI Engineer developing secure generative AI, automation, and agent solutions for EMCOR’s construction and infrastructure businesses. Partnering with operating companies to deploy scalable, governed AI capabilities.

🇺🇸 United States – Remote

💵 $135k - $168k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🕒 August 4

Chime

1001 - 5000

💼 Consulting

🛡️ Insurance

💳 Fintech

Software Engineer building governed AI platforms and LLM tooling for Chime, a fintech company helping Americans achieve financial progress. Extending Archimedes, Bosun, and easyRAG to support safe internal AI adoption.

🇺🇸 United States – Remote

💵 $133k - $184k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

infoinfo
Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok