
201 - 500 employees
Founded 2014
πΌ Consulting
π¦ Logistics
π£ Marketing
π° Series C on 2022-01
Consulting β’ Logistics β’ Marketing
Zenlayer is a hyperconnected cloud service provider focused on deploying and running applications close to users. With over 50 countries covered and 300 edge nodes, Zenlayer offers solutions like on-demand dedicated servers, scalable virtual servers, and edge data center colocations. Their services include cloud connectivity, network performance optimization, and multi-cloud services, specifically designed to enhance application performance and reduce latency across emerging markets. Zenlayer emphasizes intelligent routing and private global networking to improve user satisfaction and network efficiency. They serve industries such as gaming, blockchain, VPN, and cloud services worldwide.
π October 29
πΊπΈ United States β Remote
π΅ $300k - $600k / year
β° Full Time
π Senior
π£οΈ LLM Engineer
π¦ H1B Visa Sponsor
π» Ghost score 2%
Where this job comes from
Posted on Zenlayer's careers page β, not through a job board
First seen by Remote Rocketship October 29
Still open on Zenlayer's site. Checked 4 hours ago.

201 - 500 employees
Founded 2014
πΌ Consulting
π¦ Logistics
π£ Marketing
π° Series C on 2022-01
Consulting β’ Logistics β’ Marketing
Zenlayer is a hyperconnected cloud service provider focused on deploying and running applications close to users. With over 50 countries covered and 300 edge nodes, Zenlayer offers solutions like on-demand dedicated servers, scalable virtual servers, and edge data center colocations. Their services include cloud connectivity, network performance optimization, and multi-cloud services, specifically designed to enhance application performance and reduce latency across emerging markets. Zenlayer emphasizes intelligent routing and private global networking to improve user satisfaction and network efficiency. They serve industries such as gaming, blockchain, VPN, and cloud services worldwide.
β’ Own end-to-end responsibility for the platform's Token Performance β’ Continuously reduce cost per million tokens and increase per-GPU Goodput while meeting TTFT/TPOT SLOs β’ Prove the gain from every optimization with reproducible data β’ Establish a unified Token Performance metrics framework covering TTFT, TPOT, Goodput, GPU utilization, and per-token cost β’ Build load-testing benchmarks reflecting high-concurrency, long-context, and multi-turn Agent production workloads β’ Perform bottleneck attribution for DeepSeek, Kimi, GLM, Qwen, and MiniMax across compute, memory bandwidth, communication, scheduling, and queuing β’ Customize and contribute to vLLM, SGLang, and TensorRT-LLM on scheduler, Continuous Batching, Chunked Prefill, CUDA Graph, and KV block management paths β’ Define responsibility boundaries between inference engines and orchestration layers such as Dynamo and llm-d β’ Reduce tail latency through request routing and load balancing β’ Lead Prefill-Decode disaggregation design, including KV transfer via NIXL/RDMA/UCX, transfer-compute overlap, and phase-aware autoscaling β’ Define failure domains and recovery semantics for cross-instance KV transfer β’ Design hybrid TP/PP/DP/EP parallelism strategies and quantify EP/TP trade-offs β’ Address expert load imbalance and All-to-All communication overhead and drive Wide-EP into production β’ Write and tune CUDA and ROCm/HIP operators, including memory access optimization, kernel fusion, and Attention/MoE/communication kernels β’ Build a quantization-accuracy-throughput evaluation loop for FP8, FP4, INT4, AWQ, and GPTQ across engines and hardware
β’ First-principles understanding of Transformer inference: the compute vs. memory-bound nature of Prefill and Decode, the KV Cache memory model, the differences among MHA/GQA/MLA, and how MoE routing constrains parallelism β’ Source-level, in-depth experience with at least one mainstream inference engine, with real cases of identifying and fixing bottlenecks in scheduling, kernel selection, or KV management β’ CUDA kernel tuning skills (Nsight profiling, memory optimization, fusion, CUDA Graph) with hands-on practical experience β’ Bachelorβs degree in Computer Science, Electrical/Computer Engineering, or related field (HPC systems, ML Systems) β’ Minimum 6 years in systems/Performance Engineering, with at least 2-3 years directly on LLM or GPU performance work β’ Experience with Merged PRs in vLLM preferred, but not required β’ Experience operating at cluster scale (hundreds to thousands of GPUs) preferred, but not required
Apply NowImprove your chances of getting an interview by checking your resume score before you apply.
π October 28
Quality Assurance Engineer validating conversational AI, IVR, and voice customer experience solutions for global IT services company Miratech. Automating tests and ensuring reliable integrations across enterprise platforms.
πΊπΈ United States β Remote
π° Private Equity Round on 2022-04
β° Full Time
π‘ Mid-level
π Senior
π£οΈ LLM Engineer
π October 28
Quality Assurance Engineer validating conversational AI, IVR, and voice customer experiences at global IT services company Miratech. Creating automated tests and verifying integrations, workflows, and end-to-end quality.
πΊπΈ United States β Remote
π° Private Equity Round on 2022-04
β° Full Time
π Senior
π£οΈ LLM Engineer
π October 10
AI/LLM Developer building and deploying LLM-enabled applications for TechOp Solutions International. Supporting AI pilots from use-case definition through operational implementation.
πΊπΈ United States β Remote
π΅ $121k - $149k / year
β° Full Time
π‘ Mid-level
π Senior
π£οΈ LLM Engineer
π September 29
Senior Software Engineer building real-time conversational voice AI for automotive dealerships. Owning AWS infrastructure, telephony integrations, observability, and scalable production systems.
π September 10
Software Engineer building conversational interfaces, research agents, and AI data tools for Blue Rose Research. Helping Democrats win elections through product-focused engineering and UX design.
πΊπΈ United States β Remote
π΅ $110k - $210k / year
β° Full Time
π Senior
π£οΈ LLM Engineer