Senior AI/ML Engineer – RAG, Co-Pilot Systems

October 31

Apply Now

Receive Emails with Similar Jobs

Switch

WebsiteLinkedInAll Job Openings

Data Centers • Telecommunications • Cloud Computing

Switch is a world-leading technology infrastructure company that specializes in exascale data center ecosystems and innovative telecommunications solutions. The company focuses on providing enterprise-class, emerging hybrid cloud technology solutions while emphasizing sustainability and social responsibility. Switch operates multiple data centers across the U. S. , offering colocation and edge data center services tailored to the needs of its diverse clientele, including global logistics and e-commerce firms.

501 - 1000 employees

Founded 2000

📡 Telecommunications

📋 Description

• Design and Build scalable AI/ML systems, with a focus on RAG architectures (retrieval pipelines, embeddings, vector stores, LLM orchestration). • Prototype and Deploy generative AI features into production using PyTorch, LangChain, LlamaIndex, and other modern AI frameworks. • Operationalize Models with MLflow for experiment tracking, model registry, deployment, and governance. • Optimize Inference Pipelines for performance, efficiency, and cost, leveraging NVIDIA GPUs, NVIDIA NIM inference microservices, and the NVIDIA GPU Operator for Kubernetes-based cluster management. • Implement Cloud-Native Patterns: containerization, microservices, sidecars, service mesh, and event-driven pipelines. • Deploy in Secure Environments: architect and support systems in air-gapped, regulated, or on-premises environments with strict compliance requirements. • Ensure Reliability with robust observability (monitoring, logging, alerting, tracing) and CI/CD automation. • Collaborate Cross-Functionally to translate product and research requirements into technical specifications for data, models, and serving. • Continuously evaluate and integrate emerging tools in LLM orchestration, vector databases, and distributed ML infrastructure. • Drive next-level innovation in Product Development to support our mission-critical infrastructure. • Work in a fast-paced, high-impact environment where execution is key. • Leverage cutting-edge technology and sustainable design principles to create world-class solutions. • Uphold Switchs Karma philosophy leading with integrity and empowering those around you.

🎯 Requirements

• 8+ years professional experience in AI/ML engineering or software engineering (or equivalent). • Deep expertise with large language models and RAG systems (retrieval, embeddings, vector search, prompt control). • Strong proficiency in Python for AI/ML workflows and integration. • Hands-on experience with: PyTorch, MLflow, LangChain / LlamaIndex, NVIDIA NIM, NVIDIA GPU Operator. • Kubernetes expertise: deploying, scaling, and securing ML workloads in containers. • Familiarity with cloud-native design patterns (microservices, service mesh, sidecars, event-driven pipelines, serverless). • Experience building and deploying systems in air-gapped, regulated, or hybrid on-prem/cloud environments. • Solid understanding of distributed systems, ML system scaling, and performance tuning. • Strong engineering practices (CI/CD, testing, code reviews, version control). • Excellent communication skills and ability to explain complex systems and trade-offs. • Preferred advanced degree (MS/Ph.D.) in Computer Science, Machine Learning, or related field. • Preferred experience with vector databases (e.g., Qdrant, Weaviate, Milvus, Pinecone) or custom vector search solutions. • Preferred experience with large-scale LLM serving and optimization techniques (quantization, distillation, sharding). • Preferred experience in regulated industries (finance, healthcare, energy, government) with compliance frameworks (SOC 2, HIPAA, FedRAMP, etc.). • Contributions to open-source AI/ML frameworks or cloud-native tooling.

🏖️ Benefits

• Generous Benefits Package - Switch provides comprehensive coverage for you and your family that can be tailored to fit your personal needs, and more!