Member of Technical Staff, Integration/RL Team, Research Engineer

Job not on LinkedIn

August 19

Apply Now

Receive Emails with Similar Jobs

Cohere

WebsiteLinkedInAll Job Openings

Artificial Intelligence • Enterprise • SaaS

Cohere is a leading enterprise AI platform optimized for generative AI, search and discovery, and advanced retrieval. The company offers AI-powered applications designed to augment and elevate the global workforce, helping businesses thrive in the AI era. Cohere provides solutions such as embedding and reranking models, allowing enterprises to efficiently retrieve information and build powerful applications. The company offers flexible deployment options for enterprise-grade AI, on any cloud or on-premises, and provides extensive developer resources and support. Cohere is committed to scaling intelligence to serve humanity, making intelligence abundant, affordable, and accessible.

11 - 50 employees

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

📋 Description

• Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. • Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do. We believe that a diverse range of perspectives is a requirement for building great products. • The integration team is responsible for developing and scaling machine learning algorithms and infrastructure for LLM post-training, with a focus on large-scale, distributed RL methods. • In particular, this role aims to enhance the global quality of the post-training codebase by implementing new tools to ease and support research, optimizing post-training algorithms, and scaling distributed RL to unprecedented levels. • As a Member of Technical Staff, you will: design and write high-performing and scalable software for training models. Develop new tools to support and accelerate research and LLM training. Coordinate with other engineering teams (Infrastructure, Efficiency, Serving) and the scientific teams (Agent, Multimodal, Multilingual, etc.) to create a strong and integrated post-training ecosystem. • Craft and implement techniques to improve performance and speed up our training cycles, both on SFT, offline preference, and the RL regime. • Research, implement, and experiment with ideas on our cluster and data infrastructure. • Collaborate, Collaborate, and Collaborate with other scientists, engineers, and teams! • You are an ideal candidate if you have: extremely strong software engineering skills. Value test-driven development methods, clean code, and strive to reduce technical debts at all levels. Proficiency in Python and related ML frameworks such as JAX, Pytorch and/or XLA/MLIR. Experience using and debugging large-scale distributed training strategies (memory/speed profiling). • [Bonus] Experience with distributed training infrastructures (Kubernetes) and associated frameworks (Ray). • [Bonus] Hands-on experience with the post-training phase of model training, with a strong emphasis on scalability and performance. • [Bonus] Experience in ML, LLM and RL academic research. • This role is perfect for you if you: • Have a deep passion for quality work. • Enjoy tuning and optimising large LLM models. • Comfortable working with people with different levels of software engineering skills, from beginner to more advanced. • Comfortable diving into complex ML codebases to identify and resolve issues, ensuring the smooth operation of our systems. • Thrive in a fast-paced, technically challenging environment, where you can contribute your innovative ideas and solutions. • If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply! If you want to work really hard on a glorious mission with teammates that want the same thing, Cohere is the place for you. • We value and celebrate diversity and strive to create an inclusive work environment for all. We welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.

🎯 Requirements

• Extremely strong software engineering skills. • Value test-driven development methods, clean code, and strive to reduce technical debts at all levels. • Proficiency in Python and related ML frameworks such as JAX, Pytorch and/or XLA/MLIR. • Experience using and debugging large-scale distributed training strategies (memory/speed profiling). • [Bonus] Experience with distributed training infrastructures (Kubernetes) and associated frameworks (Ray). • [Bonus] Hands-on experience with the post-training phase of model training, with a strong emphasis on scalability and performance. • [Bonus] Experience in ML, LLM and RL academic research.

🏖️ Benefits

• An open and inclusive culture and work environment • Work closely with a team on the cutting edge of AI research • Weekly lunch stipend, in-office lunches & snacks • Full health and dental benefits, including a separate budget to take care of your mental health • 100% Parental Leave top-up for 6 months for employees based in Canada, the US, and the UK • Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement • Remote-flexible, offices in Toronto, New York, San Francisco and London and co-working stipend • 6 weeks of vacation