Senior MLOps Engineer

🔥 3 minutes ago

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🤖 Machine Learning Engineer

Where this job comes from

Posted on Salvo Software's careers page, not through a job board

First seen by Remote Rocketship 3 minutes ago

Logo of Salvo Software

Salvo Software

11 - 50 employees

🤝 B2B

☁️ SaaS

🏢 Enterprise

B2B • SaaS • Enterprise

Salvo Software is a global software development company headquartered in Vancouver, WA, with near-shoring capabilities that offer a blend of international pricing and U. S. standards. The company specializes in custom software solutions, providing services such as software product development, AI-enabled applications, blockchain development, IoT, speech recognition, web application development, and business automation. Salvo Software is dedicated to helping enterprises and startups develop strategic products through agile development processes and adaptable, affordable services. Their expertise includes UI/UX design, QA and testing, embedded firmware development, and cloud application development, supporting various industries with tailored solutions like e-commerce platforms, CRM systems, and educational resource platforms.

📋 Description

• Design, deploy, and operate MLOps platform infrastructure, cloud services (AWS, Azure, GCP), and LLM inference pipelines (Ollama, vLLM). • Build automated CI/CD pipelines, Infrastructure as Code, and monitoring/alerting systems for RAG applications, AI agents, and production deployments. • Manage Linux servers, networking, security endpoints, and troubleshoot production issues alongside AI engineering teams. • Establish department-wide MLOps/DevOps standards, best practices, and reusable infrastructure templates. • Partner with AI Developers and RAG Engineers on architecture, deployment strategies, tool selection, and production readiness. • Translate feature requirements into reliable, secure, cost-effective infrastructure and maintain comprehensive system documentation. • Provision containerized workloads, Linux servers, and infrastructure using Terraform and Ansible across cloud and on-prem environments. • Manage CI/CD with GitHub Actions and Azure DevOps, observability tools including Prometheus and Grafana, secure networking, and GPU-enabled hardware. • Troubleshoot platform incidents, perform root cause analysis, and maintain operational resilience.

🎯 Requirements

• 5+ years of senior-level experience in DevOps/SRE/platform engineering with at least 1 year deploying ML models and LLM inference engines (Ollama, vLLM) in production. • Proficiency with Linux, Docker, Kubernetes, virtualization (Proxmox, VMware), GPU infrastructure (CUDA/NVIDIA), and major cloud platforms (AWS, Azure, GCP). • Hands-on expertise with Infrastructure as Code (Terraform, Ansible), CI/CD platforms (GitHub Actions, Azure DevOps), Bash, and Python scripting. • Solid background in core networking (DNS, TLS, firewalls, VPNs), monitoring/logging, and security/authentication (OAuth2/OIDC, API gateways, Zero Trust/SOC 2). • Familiarity with ML tooling (MLflow, Kubeflow), vector DBs, RAG/agent frameworks (MCP), workflow orchestration (Airflow/Kafka), and model optimization/quantization.

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🔥 8 hours ago

Stack AV

51 - 200

📦 Logistics

🏭 Manufacturing

💼 Consulting

Senior Software Engineer building multimodal search, data mining, and ML infrastructure for Stack AV’s autonomous trucking systems. Developing high-throughput platforms with LLMs, vector databases, Python, and C++.

🔥 8 hours ago

Bask Health

11 - 50

🏥 Healthcare

💼 Consulting

📦 Logistics

Machine learning engineer building recommendation and personalization systems for Bask Health’s direct-to-consumer telehealth platform. Deploying reliable models, APIs, experiments, and privacy-conscious healthcare features.

🔥 8 hours ago

Bask Health

11 - 50

🏥 Healthcare

💼 Consulting

📦 Logistics

Applied ML Engineer building AI-powered care coordination and patient-support workflows. Developing reliable ML services for Bask Health’s direct-to-consumer telehealth platform.

🔥 8 hours ago

Bask Health

11 - 50

🏥 Healthcare

💼 Consulting

📦 Logistics

Machine learning engineer building semantic, hybrid, and vector search for Bask Health's telehealth platform. Improving retrieval relevance, ranking, and AI-powered information discovery.

🔥 8 hours ago

Bask Health

11 - 50

🏥 Healthcare

💼 Consulting

📦 Logistics

Machine learning engineer building evaluation systems and reliability tests for Bask Health’s AI-powered telehealth platform. Measuring model quality, safety, and production performance.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok