Technical Lead – GPU Infrastructure

🔥 4 minutes ago

🇪🇬 Egypt – Remote

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

👻 Ghost score 25%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Tether.to

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2014

₿ Crypto

💳 Fintech

💸 Finance

Crypto • Fintech • Finance

Tether. to is a leading digital asset company that pioneers the use of stablecoins in the blockchain space. As the most widely adopted stablecoin, Tether tokens are designed to be pegged 1-to-1 with fiat currencies, offering a stable digital asset option for users. The platform facilitates these token transactions across multiple blockchains, enhancing cross-border transactions while maintaining transparency with daily records of total assets and reserves. Tether's initiatives include educational programs promoting digital asset usage, especially targeting regions like the Middle East, Turkey, and the Philippines. Tether thus positions itself as a disruptor in the traditional financial system by enabling a stable, efficient method of handling transactions in the digital currency world.

📋 Description

• Own the end-to-end architecture of Tether Data's Cosmic AC GPU compute and managed inference platform • Lead architecture proposals, high-level and low-level designs, reviews, and baseline maintenance • Lead and line-manage approximately twelve distributed engineers across backend, frontend, DevOps, QA, and documentation • Design, build, and operate a managed Slurm service for research users • Own cluster bootstrap and lifecycle on partner-provided bare metal, NVIDIA GPU and Network Operators, VM-based GPU isolation, and day-2 operations • Own managed inference serving architecture, multi-GPU and multi-node parallelism, autoscaling, request routing, endpoint reliability, and confidential-compute-capable capacity • Establish metrics, logging, alerting, SLOs, incident response, post-incident reviews, and a sustainable on-call model • Serve as the primary technical interface to infrastructure partners and vendors; define specifications, acceptance tests, escalations, capacity planning, and hardware sourcing input • Translate research, model-training, and product workloads into platform requirements and broker capacity • Hire and complete the platform team and set the technical bar • Deliver the platform within a fixed six-month delivery window

🎯 Requirements

• Eight or more years of hands-on engineering experience • At least three years leading teams that build and operate infrastructure platforms other teams depend on • Bachelor's or Master's degree in computer science or engineering, or equivalent practical experience • Hands-on experience running Slurm at scale, including slurmctld and slurmdbd, partitions, QoS and priority, accounting, prolog and epilog, node health scripting, and upgrades with jobs on the system • Experience operating an HPC or GPU training cluster for a research population is ideally preferred • Bare-metal NVIDIA GPU fleet operation, including driver and CUDA lifecycle, Fabric Manager, NVSwitch, DCGM, MIG, node burn-in and acceptance • InfiniBand fabric and subnet configuration, RDMA, SR-IOV, and diagnosing multi-node NCCL performance problems • Linux systems expertise, including kernel modules and drivers, PCIe passthrough, vfio-pci, cgroups, namespaces, and performance tuning • Production Kubernetes operation, including control plane, upgrades, CNI, CSI, operators, custom controllers, and multi-tenancy design • HPC storage and data movement using shared filesystems such as VAST, Lustre, and NFS, node-local NVMe caching, and distribution of large model weights and datasets • Observability and operations with Prometheus, Grafana, Loki or equivalents, SLOs, incident response, and post-incident review • Working fluency in JavaScript and Node.js for reviewing and making architecture decisions on control plane, CLI, and worker services • Experience shipping a platform with real users, such as multi-tenant IaaS/PaaS or research computing service • People management across time zones, cross-track review, written architecture decisions, and ability to communicate technical decisions to partners and executives • Excellent written and spoken English • Desirable experience with Slurm operators, Kubernetes-native schedulers, modern serving stacks, VM/container isolation, confidential computing, Cluster API, kubeadm, Cilium, infrastructure as code, GitOps, GPU cloud/HPC/AI lab platforms, distributed systems, and hardware-provider partnerships

🏖️ Benefits

• Remote work • Occasional travel to partner sites and team events