Machine Learning Engineer, Ops

Job not on LinkedIn

🔥 4 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Cantina

WebsiteLinkedInAll Job Openings

51 - 200 employees

Founded founded by Sean Parker

🤖 Artificial Intelligence

🎮 Gaming

🌍 Social Impact

Artificial Intelligence • Gaming • Social Impact

Cantina is a company that specializes in creating advanced AI characters that can talk, feel, and capture their adventures with selfies. It offers a platform where users can unleash their AI bots in online communities, allowing these lifelike, social creatures to interact with humans. Cantina focuses on building networks of AI influencers and encourages users to explore and build their own collections of AI bots. The company's mission is to foster an interactive universe, inviting creativity and social interaction through digital personalities and AI technology.

📋 Description

• Design and maintain inference infrastructure for generative audio model architectures. • Implement and manage high-performance inference engines. • Orchestrate service deployments using Kubernetes (K8S), implementing advanced autoscaling paradigms to handle varying traffic loads efficiently. • Develop and automate robust CI/CD pipelines to streamline the testing and deployment of model artifacts and inference configurations. • Monitor production systems, establishing observability practices to track latency, resource utilization, and overall model performance. • Collaborate closely with research teams to optimize model serving paths and evaluate various inference strategies. • Optimize inference performance for both streaming and batch applications.

🎯 Requirements

• Deep understanding of modern audio model architectures (e.g., TTS, ASR) and their specific inference requirements. • Strong hands-on experience with Kubernetes (K8S), container orchestration, and implementing autoscaling strategies for production workloads. • Solid background in MLOps, including CI/CD automation and managing scalable cloud infrastructure. • Proficiency in software engineering principles and experience with Python or Go for infrastructure tooling and backend services. • Experience with GPU-accelerated inference and performance profiling techniques. • Familiarity with high-performance inference engines (e.g., Triton Inference Server, vLLM-Omni) is a plus.

🏖️ Benefits

• Competitive salary and generous company equity • Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina • 42 days of paid time off, including: • 15 PTO days • 10 sick days • 15 company holidays • 2 floating holidays • Generous parental leave & fertility support • 401(k) retirement savings plan • Lifestyle spending account – $500/month to use however you’d like • Complimentary lunch and snacks for in-office employees • One Medical membership, and more!