Engineering Manager – AI Product

Job not on LinkedIn

🔥 0 minutes ago

Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Pragmatike

Pragmatike

11 - 50 employees

Founded 2022

💼 Consulting

📣 Marketing

🎯 Recruiter

Consulting • Marketing • Recruitment

Pragmatike is a remote IT recruitment and staffing company that sources, vets, and places international tech talent for businesses. They provide human-curated matching (not solely AI), technical assessments, and fast placements—claiming qualified specialists can be introduced within 48 hours—while handling onboarding, invoicing and international payroll. Pragmatike serves startups and enterprises with roles like developers, data engineers, mobile and game developers, product managers and specialists, operating across 60+ countries with a large vetted talent pool.

📋 Description

• Lead, mentor, and grow a team of 3 engineers focused on AI platform and product engineering • Drive architectural direction for the AI product, emphasizing inference performance, reliability, cost efficiency, and developer experience • Contribute hands-on to design, implementation, and optimization of model serving, inference pipelines, retrieval, orchestration, and evaluation systems • Own the AI/ML platform end to end, including GPU capacity and scheduling, model deployment and versioning, data and embedding pipelines, monitoring, and quality evaluation • Collaborate with Product, Infrastructure, Security, and Backend teams to define priorities and ensure smooth integrations • Conduct regular 1:1s, performance reviews, and technical coaching • Foster ownership, engineering excellence, and continuous improvement • Translate strategic objectives into execution plans and ensure timely delivery • Influence AI platform evolution through pragmatic technical decisions • Champion software development, automation, evaluation, and operational-excellence best practices

🎯 Requirements

• 7+ years of software engineering experience • 2+ years in a technical leadership or engineering management role • Proven experience building and operating AI/ML platforms or inference infrastructure in production • Experience with model serving, GPU workloads, latency optimization, and cost optimization • Solid experience building distributed backend systems • Strong Python skills • Experience with a systems language such as Go or Rust is a plus • Hands-on familiarity with model APIs, open-weight models, vLLM, TGI, Triton or similar serving frameworks, retrieval/vector databases, and prompt or context engineering • Strong grasp of evaluation frameworks, benchmarking, regression testing, and observability for non-deterministic AI systems • Strong expertise in cloud platforms, with AWS preferred, including EC2, ECS, Lambda, IAM, and CloudWatch • Familiarity with Kubernetes, containerization, and Infrastructure-as-Code tools such as Terraform, Pulumi, or AWS CDK • Understanding of CI/CD automation using GitHub Actions, CircleCI, or similar • Strong knowledge of Linux systems, networking fundamentals, and monitoring/alerting best practices • Excellent communication and leadership skills • Strong technical judgment and ability to balance coding with people and strategic responsibilities

🏖️ Benefits

• Fully remote role • Remote-first flexibility • Opportunity to work with cutting-edge LLM, inference infrastructure, GPU compute, and distributed systems technology • Leadership, mentoring, and strategic technical growth opportunities • Cross-functional collaboration with Product, Infrastructure, Security, and Backend teams

Apply Now

Similar Jobs

🕒 December 1, 2025

Tabby

201 - 500

💳 Fintech

🛍️ eCommerce

Engineering Manager at a FinTech company driving large cross-team projects and contributing to technical planning and execution. Managing team performance and ensuring efficient collaboration.

🇦🇲 Armenia – Remote

💰 $58M Series C on 2023-01

⏰ Full Time

🟡 Mid-level

🟠 Senior

👮‍♀️ Software Engineering Manager

Cloud

Distributed Systems

Google Cloud Platform

Kubernetes

Microservices

Postgres

Redis

Go