Senior Software Engineering Manager – KV Cache Platform

🔥 0 minutes ago

🏄 California – Remote

info

💵 $220k - $275k / year

⏰ Full Time

🟠 Senior

👮‍♀️ Software Engineering Manager

🦅 H1B Visa Sponsor

info
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of DDN

DDN

1001 - 5000 employees

Founded 1998

🤖 Artificial Intelligence

💰 $10M Funding Round on 2011-06

Artificial Intelligence • Data Center and Cloud Computing • High Performance Computing

DDN is a global leader in AI data intelligence solutions, providing high-performance computing and sophisticated data management technologies. With a focus on accelerating AI deployments and advanced data analytics, DDN's products, including the Data Intelligence Platform and advanced storage systems, serve diverse sectors such as healthcare, financial services, and government. DDN is committed to transforming enterprise data infrastructure to leverage the full potential of AI and drive operational efficiency.

📋 Description

• Lead, mentor, and grow a geographically distributed team of software engineers and technical leaders, fostering a culture of technical excellence, innovation, ownership, and collaboration. • Define and execute the technical strategy and roadmap for the KV Cache Platform, ensuring scalability, reliability, security, and operational excellence. • Drive the architecture, development, and delivery of distributed systems supporting AI inference, GPU memory optimization, distributed caching, RDMA networking, GPUDirect Storage, NVIDIA BlueField DPUs, and emerging AI infrastructure technologies. • Partner closely with Product Management, Sales, Customer Engineering, NVIDIA, and strategic technology partners to prioritize customer requirements, drive proof-of-concepts (POCs), influence product direction, and successfully deliver customer deployments. • Own day-to-day engineering execution, including feature development, release planning, bug triage, production issues, customer escalations, and cross-functional execution to ensure timely, high-quality software delivery. • Establish engineering best practices for software quality, observability, automation, performance, testing, and production readiness. • Collaborate across engineering, infrastructure, and hardware teams to deliver scalable, production-ready AI infrastructure while developing future engineering leaders and driving continuous improvement.

🎯 Requirements

• 15+ years of experience building distributed systems, cloud infrastructure, storage platforms, or AI infrastructure software. • 7+ years leading high-performing software engineering organizations, including geographically distributed teams. • Proven experience delivering large-scale distributed infrastructure products from architecture through production deployment. • Strong background in distributed systems, Linux, networking, performance engineering, and cloud-native architectures. • Hands-on programming experience with Go and Python; experience with C/C++ is a plus. • Demonstrated ability to lead cross-functional initiatives and influence technical direction across multiple organizations. • Experience building AI infrastructure, LLM serving platforms, distributed caching systems, or high-performance storage solutions. • Experience with technologies such as NVIDIA Dynamo, TensorRT-LLM, Triton, RDMA, GPUDirect Storage, BlueField DPUs, Kubernetes, or related AI infrastructure. • Background in HPC, distributed storage, networking, or enterprise infrastructure software. • Experience working directly with strategic customers, technology partners, OEMs, or hyperscalers to deliver enterprise AI solutions.

🏖️ Benefits

• Health insurance • 401(k) matching • Flexible work hours • Paid time off • Remote work options

Apply Now

Similar Jobs

🔥 8 minutes ago

Horizon3.ai

51 - 200

Lead Engineering Manager for the Client team developing cybersecurity solutions at Horizon3.ai. Focused on software deployment to customer environments and team building.

🔥 7 hours ago

Senior Engineering Manager leading multiple software teams at Penn Interactive, enhancing online gaming platforms and supporting engineering initiatives. Guiding development and performance management in a dynamic environment.

🔥 14 hours ago

apiphani

11 - 50

🏢 Enterprise

☁️ SaaS

🔐 Security

Engineering Manager leading a team of 6-8 engineers for Luumen's AI platform at Apiphani. Overseeing technical architecture and process while fostering team growth and development.

🔥 14 hours ago

Deepgram

51 - 200

🤖 Artificial Intelligence

☁️ SaaS

🔌 API

Senior Technical Program Manager overseeing large-scale ML infrastructure projects at Deepgram. Collaborating with cross-functional teams for optimizing AI technologies and model deployment.

🔥 20 hours ago

The Home Depot

10,000+ employees

🛒 Retail

👥 B2C

Software Engineer Manager at Home Depot leading engineering talent and collaborating with product teams. Ensuring the effective integration of third-party tools and platforms for high-quality software solutions.

🇺🇸 United States – Remote

💵 $120k - $150k / year

💰 Debt Financing on 2007-07

⏰ Full Time

🟡 Mid-level

🟠 Senior

👮‍♀️ Software Engineering Manager