Technical Staff Member, Model Efficiency

Likely ghost job

πŸ•’ March 18

πŸ‡ΊπŸ‡Έ United States – Remote

⏰ Full Time

🟑 Mid-level

🟠 Senior

Where this job comes from

Posted on Cohere's careers page β†—Cohere's careers page, not through a job board

First seen by Remote Rocketship March 18

Still open on Cohere's site. Checked 1 hour ago.

Apply Now
Logo of Cohere

Cohere

11 - 50 employees

πŸ€– Artificial Intelligence

🏒 Enterprise

☁️ SaaS

Artificial Intelligence β€’ Enterprise β€’ SaaS

Cohere is a leading enterprise AI platform optimized for generative AI, search and discovery, and advanced retrieval. The company offers AI-powered applications designed to augment and elevate the global workforce, helping businesses thrive in the AI era. Cohere provides solutions such as embedding and reranking models, allowing enterprises to efficiently retrieve information and build powerful applications. The company offers flexible deployment options for enterprise-grade AI, on any cloud or on-premises, and provides extensive developer resources and support. Cohere is committed to scaling intelligence to serve humanity, making intelligence abundant, affordable, and accessible.

πŸ“‹ Description

β€’ Work across the inference stack to improve core performance metrics β€’ Dive deep into model execution β€’ Identify bottlenecks and develop innovative optimizations β€’ Collaborate closely with modeling and systems teams β€’ Experiment, measure, and ship improvements that accelerate inference β€’ Build expertise in advanced performance techniques, including GPU/CUDA optimizations, kernel-level improvements, and model execution strategies for MoE and large-scale architectures

🎯 Requirements

β€’ 5+ years of experience writing high-performance, production-quality code β€’ Strong programming skills in C++ or Python (Rust/Go also welcome) β€’ Experience working with large language models and familiarity with the LLM inference ecosystem (e.g., vLLM, SGLang, etc.) β€’ Ability to diagnose and resolve performance bottlenecks across the model execution stack β€’ A strong bias for action β€” you ship fast, measure impact, and iterate β€’ It’s a big plus if you have experience with GPU programming, CUDA, or low-level systems optimization β€’ Language modeling with transformers (MoE, speculative decoding, KV-cache optimizations) β€’ Scaling performance-critical distributed systems (e.g., computation, search, storage)

πŸ–οΈ Benefits

β€’ An open and inclusive culture and work environment β€’ Work closely with a team on the cutting edge of AI research β€’ Weekly lunch stipend, in-office lunches & snacks β€’ Full health and dental benefits, including a separate budget to take care of your mental health β€’ 100% Parental Leave top-up for up to 6 months β€’ Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement β€’ Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend β€’ 6 weeks of vacation (30 working days!)

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ February 26

Center Street Lending

51 - 200

πŸ—οΈ Construction

πŸ“¦ Logistics

πŸ’Ό Consulting

Draw Management Specialist evaluating and managing construction draw requests for residential property loans. Ensuring compliance, assessing risks, and providing exceptional service to borrowers.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $26 - $31 / hour

⏰ Full Time

🟒 Junior

🟑 Mid-level

πŸš«πŸ‘¨β€πŸŽ“ No degree required

πŸ•’ February 23

Leap

51 - 200

πŸ—οΈ Construction

πŸ“¦ Logistics

πŸ’Ό Consulting

Senior SalesPro Specialist managing SaaS onboarding and customer success efforts. Focused on driving customer adoption and ensuring successful product launches in the home improvement industry.

πŸ‡ΊπŸ‡Έ United States – Remote

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ•’ February 9

Structure Networks, Inc.

51 - 200

πŸ’Ό Consulting

Site Engagement Coordinator supporting participant recruitment and retention for Structure Therapeutics’ clinical-stage medicines. Developing trial engagement strategies, site relationships, and participant-facing materials.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $75k - $98k / year

⏰ Full Time

🟠 Senior

πŸ•’ February 2

X-Series USA

1 - 10

🏭 Manufacturing

Laser Applications Specialist at XOVR CNC Parts & Service providing expert-level support for CNC machine tools. Involves extensive customer training, troubleshooting, and travel across the United States.

πŸ‡ΊπŸ‡Έ United States – Remote

πŸ’΅ $65k - $110k / year

⏰ Full Time

🟑 Mid-level

🟠 Senior

πŸ•’ January 23

Westfield Insurance

1001 - 5000

πŸ›‘οΈ Insurance

🀝 B2B

πŸ‘₯ B2C

Territory Leader driving profitable small business growth across multi-state territory. Leading sales performance, talent development, and agency engagement at Westfield.

πŸ‡ΊπŸ‡Έ United States – Remote

⏰ Full Time

🟠 Senior

πŸ”΄ Lead

Developed byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok