Machine Learning Infrastructure Engineer – LLM, Agentic AI

🔥 6 minutes ago

🇺🇸 United States – Remote

💵 $150k - $215k / year

⏰ Full Time

🟢 Junior

🟡 Mid-level

👷 Infrastructure Engineer

Where this job comes from

Posted on Stellar Cyber's careers page, not through a job board

First seen by Remote Rocketship 6 minutes ago

Logo of Stellar Cyber

Stellar Cyber

51 - 200 employees

🔒 Cybersecurity

🤖 Artificial Intelligence

🏢 Enterprise

💰 $38M Series B on 2021-11

Cybersecurity • Artificial Intelligence • Enterprise

Stellar Cyber is a company that provides an automation-driven security operations platform seamlessly integrating next-generation SIEM, Network Detection and Response (NDR), and Open Extended Detection and Response (XDR). Their platform utilizes advanced AI to quickly detect and correlate cybersecurity threats across various security tools, offering comprehensive threat intelligence and automated incident response to enhance security operations for enterprises, MSSPs, and MSPs. With a focus on reducing security operation costs and improving threat response times, Stellar Cyber helps organizations protect their entire attack surface, including on-premises, cloud, and IT/OT environments.

📋 Description

• Design and build Agentic AI frameworks to orchestrate LLM-based agents capable of reasoning, planning, and executing SecOps tasks in Stellar Cyber’s Open XDR platform • Design and develop scalable LLM inference infrastructure supporting runtime- and cost-efficient serving and resource management across LLM hosting providers • Develop MCP servers that interact with Open XDR platform services and features and integrate with LLM-based agents • Develop supporting API services for Autonomous SOC applications to provide reliable and extensible interfaces for agent operations • Collaborate with machine learning and security researchers, UI, backend, and infrastructure engineers, and product management to align infrastructure with evolving product needs

🎯 Requirements

• Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience • 2 years of experience with software development or 1 year of experience with an advanced degree in an industry setting • 2 years of experience with data structures or algorithms in either an academic or industry setting • 2 years of experience with developing backend infrastructure, distributed systems, APIs (REST / gRPC), and microservices for MLOps related projects • Experience with cloud computing technologies, including containerization, orchestration, and deployment (Docker, Kubernetes, etc) • Experience in one or more of the following programming languages: Python, Java, Go • Experience working on LLM applications in high-sensitivity domains is preferred • Experience with Generative AI frameworks and technologies is preferred • Experience with observability practices in ML systems is preferred • Experience deploying and scaling LLMs for inference using frameworks such as vLLM and llama.cpp is preferred • Experience working on ML platform teams and/or building tools for researchers is preferred • Knowledge of SecOps concepts, activities, and workflows is a plus

🏖️ Benefits

• Pre-IPO Stock Options • Medical, Dental & Vision care • 401(k) • Employee Assistance Program • Employee Discount Program • Life Insurance • Paid time off • Referral Program • Rewards and Recognition Program • Competitive salary • Comprehensive benefits • Ample career growth opportunities

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🔥 13 hours ago

Red Hat

10,000+ employees

🏢 Enterprise

Telco infrastructure architect designing Red Hat cloud, virtualization, and automation solutions. Advising telecommunications customers and leading integrated architecture implementations.

🔥 22 hours ago

VAILEXA

51 - 200

🎯 Recruiter

👥 HR Tech

AI Infrastructure Engineer maintaining Linux, SLURM, and GPU systems for Vailexa’s large-scale AI and HPC infrastructure. Troubleshooting validation issues and improving diagnostics, monitoring, and automation.

🕒 Yesterday

FormAssembly

51 - 200

🏥 Healthcare

🍽️ Food & Beverage

💼 Consulting

Infrastructure Systems Engineer securing and automating AWS environments for FormAssembly’s government and private-sector clients. Building compliant CI/CD, container, monitoring, and AI-assisted operations.

🕒 Yesterday

Keycard Labs

1 - 10

💼 Consulting

📣 Marketing

🤖 Artificial Intelligence

Staff infrastructure engineer owning Keycard’s BYOC deployments and cloud cells. Building secure, repeatable infrastructure for its agent identity and access platform.

🕒 2 days ago

Centene Corporation

10,000+ employees

🛡️ Insurance

💼 Consulting

🏥 Healthcare

Firewall infrastructure engineering manager leading enterprise firewall operations for Centene’s healthcare technology environment. Driving reliability, lifecycle management, capacity, resiliency, and team development.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok