Technical Program Manager – Infrastructure & Capacity Management

November 21

🗽 New York – Remote

Although this job is listed in New York, this company may be open to hiring remote in other states.

⏰ Full Time

🟡 Mid-level

🟠 Senior

🔧 Technical Program Manager

🦅 H1B Visa Sponsor

Apply Now

Receive Emails with Similar Jobs

Cohere

WebsiteLinkedInAll Job Openings

Artificial Intelligence • Enterprise • SaaS

Cohere is a leading enterprise AI platform optimized for generative AI, search and discovery, and advanced retrieval. The company offers AI-powered applications designed to augment and elevate the global workforce, helping businesses thrive in the AI era. Cohere provides solutions such as embedding and reranking models, allowing enterprises to efficiently retrieve information and build powerful applications. The company offers flexible deployment options for enterprise-grade AI, on any cloud or on-premises, and provides extensive developer resources and support. Cohere is committed to scaling intelligence to serve humanity, making intelligence abundant, affordable, and accessible.

11 - 50 employees

🤖 Artificial Intelligence

🏢 Enterprise

☁️ SaaS

📋 Description

• Coordinate with internal and external teams (cloud providers, GPU manufacturers etc.) to manage the full lifecycle of compute resources, with a heavy emphasis on GPUs • Lead end-to-end programs within the infrastructure space from planning and execution to cross-functional coordination and stakeholder management • Collaborate directly with technical and non-technical teams to set, track, and manage timelines, deliverables, budgets, scope etc. • Manage various overlapping projects and programs, ruthlessly prioritizing asks, to ensure that the company’s top priorities are met • Work with leadership on anticipating and planning capacity needs across the company, and turning these needs into practical execution plans on how capacity is allocated, tracked, and managed • Deliver clear, timely, and consistent updates across engineering, leadership, and non–technical teams on the monthly container releases and wider model launches.

🎯 Requirements

• 5+ years of experience as a Technical Program Manager • 3+ years working with infrastructure teams, and have a solid understanding of the challenges with project and program management in this space • You know how to use Github & Grafana, can read Terraform, and are generally comfortable with onboarding and diving into new technologies • You have practical experience, either in a hands-on role or as a TPM, with full lifecycle management of compute resources (GPUs, CPUs, VMs etc.) • You have a blend of experience working in the intersection of software, hardware, and machine learning – particularly with GPUs used for ML training and inference • You have hands-on experience with coordinating large-scale, company-wide programs within a deeply technical space • You have worked in highly dynamic, fast-paced environments, requiring striking a balance between speed and structure • (bonus) You have experience with managing projects and programs related to serving and efficiency of LLMs • (bonus) You have past experience in a technical role, such as infrastructure engineer, software engineer, machine learning engineer etc.

🏖️ Benefits

• An open and inclusive culture and work environment • Work closely with a team on the cutting edge of AI research • Weekly lunch stipend, in-office lunches & snacks • Full health and dental benefits, including a separate budget to take care of your mental health • 100% Parental Leave top-up for up to 6 months • Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement • Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend • 6 weeks of vacation (30 working days!)