Machine Learning Engineer, Core Evaluations

🕒 April 29

🇺🇸 United States – Remote

⏰ Full Time

🟠 Senior

🔴 Lead

🤖 Machine Learning Engineer

Where this job comes from

Posted on Cantina's careers page ↗Cantina's careers page, not through a job board

First seen by Remote Rocketship April 29

Still open on Cantina's site. Checked 4 hours ago.

Apply Now
Logo of Cantina

Cantina

51 - 200 employees

Founded founded by Sean Parker

🤖 Artificial Intelligence

🎮 Gaming

🌍 Social Impact

Artificial Intelligence • Gaming • Social Impact

Cantina is a company that specializes in creating advanced AI characters that can talk, feel, and capture their adventures with selfies. It offers a platform where users can unleash their AI bots in online communities, allowing these lifelike, social creatures to interact with humans. Cantina focuses on building networks of AI influencers and encourages users to explore and build their own collections of AI bots. The company's mission is to foster an interactive universe, inviting creativity and social interaction through digital personalities and AI technology.

📋 Description

• Designing model evaluation pipelines for models in development and production • Designing user studies for subjective model evaluations. • Converting requirements into measurable metrics. • Designing and developing automated evaluation dashboard to see model performances and compare results. • Training new models to capture new and different evaluation metrics. • Communicating with the model team to help design better models based on the evaluation results. • Communicating with the data team to help decide the type of data necessary to improve model performance. • Communication with the product-manager to make sure product requirements are correctly measured. • Help grow the evaluation team as the founding member. • Lead the evaluation team in the future.

🎯 Requirements

• Strong experience and intuition for designing metrics that capture model performance. • Strong experience with designing user studies on Mechanical Turk or similar platforms. • Strong experience with model training and fine-tuning for model evaluation. • Strong statistical knowledge and experience to statistically compare evaluation results and take decisions. • Very strong engineering and programming skills. • Experience with training ASR, TTS models. • Experience at ML teams working on large-scale machine learning problems. (>3B models with >1m hours of data)

🏖️ Benefits

•

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 April 17

Foundation EGI

11 - 50

🏭 Manufacturing

💼 Consulting

📦 Logistics

Research Software Engineer solving engineering problems using AI and geometry processing. Collaborating on machine learning and software development in remote team setting.

🕒 April 16

PrizePicks

201 - 500

🎮 Gaming

⚽ Sports

Lead technical charge in scaling and productionizing ML capabilities at PrizePicks. Directly impacting metrics like Time-to-Bet and Deposit Velocity in the DFS industry.

🕒 April 13

Signify

11 - 50

🔒 Cybersecurity

🤝 B2B

☁️ SaaS

Senior Machine Learning Engineer responsible for building and maintaining ML models at Signifyd. Enhance fraud detection capabilities and collaborate with cross-functional teams for better solutions.

🕒 April 9

Instacart

1001 - 5000

🍽️ Food & Beverage

📦 Logistics

🛍️ eCommerce

Senior Machine Learning Engineer specializing in Operations Research at Instacart. Developing ML solutions for logistics optimization in a flexible work environment.

🕒 April 3

May Mobility

51 - 200

🚘 Automotive

📦 Logistics

🚗 Transport

Lead ML Engineer designing and implementing lane and route network mapping systems at May Mobility. Collaborating with cross-functional teams and advancing autonomous vehicle technology.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok