We offer an optimization platform for ML Training. Using our platform, you significantly save on your training costs for small and gigantic models.

CentML

Full-stack Engineer

• Do you want to help drive the development of high-performance, power-efficient datacenter solutions for Deep Learning? Do you have an interest in how system architecture across GPU, networking, CPU and IO relate to brand new generative AI capabilities? Come join our team, and bring your experience and interests to help us optimize our next generation of inference and training frameworks/frameworks and to redefine the deep learning industry once again.
• Responsibilities:
- Communicate with our product teams and profile ML/DL workloads to acquire an in-depth understanding of the problems (e.g., slow kernels).
- Figure out where the bottleneck of the slow GPU kernels with profilers
- Optimize the GPU kernels.
- Write tests and benchmarks to validate and evaluate our solutions.

Seniorn Software Engineer - Compiler

• Own and support CentML’s open-source inference compiler ensuring wide adoption by ML and System developers and researchers.
• Derive and execute strategies to set CentML’s products on a positive trajectory within the ML ecosystem and the competitive landscape.
• Develop a strategic roadmap for CentML’s compiler products by collaborating with functional leaders and senior leadership; execute the roadmap and make sure CentML’s inference products are more capable, scalable, and reliable each day.
• Build, mentor, and manage a high-performing engineering team, and foster a collaborative and inclusive work environment.
• Identify and recruit top engineering talent that accelerates the development of CentML’s products.
• Continuously optimize engineering processes, workflows, and methodologies to enhance efficiency, productivity, and quality.
• Implement best practices and drive a culture of continuous improvement.

Engineering Lead - Compiler

Software Engineer

About Us We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential. Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems who holds multiple academic and industry research awards from Google, Amazon, Facebook, and VMware. About the Position We are seeking an experienced VP of Engineering who will be a key member of our leadership team. The successful candidate will participate in strategic planning, propose and align product roadmaps, as well as build, manage, and scale high-performing engineering teams that transform our product roadmaps into exceptional software. What you’ll do Technical Leadership & Execution - Oversee CentML’s product roadmaps and development, making sure engineering efforts are aligned with business goals - Have a deep understanding of software development and architecture best practices and technology trends. Steer the teams to make informed decisions that drive innovation and growth. - Work closely with the Product Management team, Sales teams, and the Founders to refine, enhance, and deliver on our product vision. - Continuously optimize engineering processes, workflows, and methodologies to enhance efficiency, productivity, and quality. Implement best practices and drive a culture of continuous improvement. People & Team Leadership - Build and nurture high-performing engineering teams and develop future team leaders within the CentML organization. - Drive career development, set goals, and provide continuous feedback to team members. - Identify and recruit top engineering talents that accelerates the development of CentML’s products. Customer Focus & Business Acumen - Understanding user needs and translating them into technical solutions is essential. A customer-centric mindset ensures that engineering efforts align with delivering value to end-users. - Understand the business domain, revenue models, and market dynamics. Contribute to product strategy and revenue generation. What you’ll need to be successful Proven track record of building and managing high-performing engineering teams. Ability to inspire, guide, and develop team members to achieve their potential. Exceptional interpersonal and communication skills, enabling effective collaboration with cross-functional teams and executive leadership. Experience working with stakeholders launching products into the market Deep experience with ML-system-related technologies and building ML-system-related products. Possession of deep technical & analytical prowess in problem-solving, defining risk, identifying potential threats, and developing action/mitigation plans. Experience delivering scalable, high-quality software products and platforms. While not essential, experience in a technical leadership role at an early or mid-stage startup is highly desirable.

VP Engineering

• We are seeking a highly motivated and skilled senior infrastructure engineer to join our team in a key role focused on designing, developing, and maintaining the CentML platform that offers a cost effective infrastructure for serving and training large scale machine learning models. As an infrastructure engineer, you will be responsible for laying out the design of a deployment infrastructure for ML training and inference jobs over GPU clusters that spans across multiple cloud service providers like AWS, GCP, Azure, Coreweave, and OCI. You should also be responsible for leading a team of engineers and building a scalable, performant, and reliable platform, enabling our customers to seamlessly access and utilize a comprehensive suite of ML services that we offer.
• Design and lead the development of the deployment infrastructure of the CentML platform. The deployment infrastructure manages the hardware resources necessary to deploy the ML training and inference applications.
• Implementing GPU cluster scheduling solutions for large scale ML training and inference workloads to efficiently utilize the hardware resources in the GPU cluster.
• Communicate with our product teams and define new features and goals for improving the CentML platform.

Senior Software Engineer, Infrastructure

• Taking part in the design and development of the CentML platform
• Designing and building solutions for scheduling large scale ML training and inference workloads on GPU clusters over multiple CSPs
• Communicate with product teams to define use cases, develop methodology & benchmarks

Remote Jobs at CentML

CentML

Seniorn Software Engineer - Compiler

CentML

Engineering Lead - Compiler

CentML

VP Engineering

CentML

Senior Software Engineer, Infrastructure

CentML

Software Engineer - Platform

CentML