
2 - 10 employees
🤖 Artificial Intelligence
☁️ SaaS
🤝 B2B
Artificial Intelligence • SaaS • B2B
StackYak is an AI infrastructure orchestration platform that combines inference, GPU compute, and private networking into a single control plane. It provides hosted inference and dedicated GPU capacity, built-in private connectivity, and observability so teams can move models from testing to production without stitching together separate vendors. The platform targets developers, enterprises, and MSPs/resellers, and plans to add storage and security layers in future releases.
🔥 1 hour ago
Where this job comes from
Posted on StackYak's careers page ↗, not through a job board
First seen by Remote Rocketship 1 hour ago

2 - 10 employees
🤖 Artificial Intelligence
☁️ SaaS
🤝 B2B
Artificial Intelligence • SaaS • B2B
StackYak is an AI infrastructure orchestration platform that combines inference, GPU compute, and private networking into a single control plane. It provides hosted inference and dedicated GPU capacity, built-in private connectivity, and observability so teams can move models from testing to production without stitching together separate vendors. The platform targets developers, enterprises, and MSPs/resellers, and plans to add storage and security layers in future releases.
• Determine how large language models should run against available GPUs and production latency requirements • Select precision, quantization, tensor parallelism, pipeline parallelism, expert parallelism, memory strategy, batching, concurrency, topology, and serving runtime • Defend, measure, and operate inference architecture decisions • Benchmark, deploy, debug, tune, automate, and operate production inference systems • Own serving runtime selection across vLLM, SGLang, TensorRT-LLM, and successors • Establish concurrency limits, latency and TTFT targets, and throughput commitments • Build benchmarking methodology, harnesses, and reproducibility practices • Manage model loading, startup, health, upgrades, capacity, and failure handling • Operate multi-tenant and dedicated serving systems • Diagnose inference incidents across serving runtimes, GPUs, drivers, hosts, and networks • Turn inference expertise into auditable, tested software and automated deployment decisions • Share technical decisions and participate in production on-call
• Production experience running large language models under real load • Experience serving models across multiple GPUs and multiple nodes • Experience sizing models against hardware • Experience choosing quantization and precision strategies with quality and cost consequences • Experience tuning batching and concurrency • Experience measuring and defending latency, TTFT, throughput, utilization, and cost metrics • Experience in NVIDIA and/or AMD inference environments • Production Python tooling and product development • Linux and systems debugging below the container boundary • Experience finding inference failure root causes outside serving runtimes • Understanding of distributed inference and multi-node networking • Experience benchmarking and comparing serving runtimes • Experience automating deployment decisions, or building schedulers, placement systems, or capacity planners • Ability to operate without narrowly defined ownership or a long ramp-up • Willingness to participate in production and on-call responsibilities
• Meaningful equity • Remote and distributed work across time zones • Employment or contract engagement depending on location • Direct access to founders • Shared responsibility for production and on-call • Technical decision participation • Flexible scope across inference, infrastructure, and networking
Apply NowImprove your chances of getting an interview by checking your resume score before you apply.
🔥 1 hour ago
Senior Advisor helping large organizations adopt AI through executive strategy, transformation programs, and Section’s workforce platform. Remote U.S. role with monthly client-site travel.
🇺🇸 United States – Remote
🔥 Funding within the last year
💰 $3.1M Venture Round on 2026-06
⏰ Full Time
🟠 Senior
🤖 Artificial Intelligence
🔥 2 hours ago
AI Strategist improving clinical, regulatory, safety, and medical-writing operations for a cancer cell therapy company. Building prototypes, quantifying savings, and guiding AI solutions into production.
🇺🇸 United States – Remote
💵 $130k - $150k / year
⏰ Full Time
🟡 Mid-level
🟠 Senior
🤖 Artificial Intelligence
🔥 3 hours ago
AI Strategist guiding clients’ AI roadmaps, strategies, and technology integration. Driving AI innovation, training, and business transformation for Iteria.us clients.
🔥 3 hours ago
Remote AI and machine learning training program for professionals, IT specialists, analysts, and tech enthusiasts. Practical instruction in Python, TensorFlow, Scikit-learn, data analytics, and real-world AI implementation.
🔥 3 hours ago
Senior AI Product Manager leading figure-generation and generative media features. Building intuitive AI tools for scientists tackling biomedical and climate challenges.