Lead DevOps Engineer – AI, GPU

🔥 1 minute ago

🇮🇳 India – Remote

⏰ Full Time

🟠 Senior

⛑ DevOps & Site Reliability Engineer (SRE)

👻 Ghost score 11%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Zimperium

Zimperium

201 - 500 employees

Founded 2010

💼 Consulting

📦 Logistics

🔒 Cybersecurity

💰 $12M Venture Round on 2018-11

Consulting • Logistics • Cybersecurity

Zimperium is a leading company in the mobile security industry, specializing in mobile endpoint and application security. They provide advanced solutions to protect mobile devices and applications, allowing enterprises to secure their mobile endpoints and enable safe access to sensitive data and systems. Zimperium's platforms integrate with various environments, including cloud, on-premises, and air-gapped setups, ensuring continuous and persistent security during development and runtime. The company is recognized for its unique focus on mobile security, offering tools that help prevent data loss, fraud, and regulatory breaches in mobile apps.

📋 Description

• Build and operate CI/CD/CV pipelines for AI services, agents, and runtime components, including automated build, test, continuous verification, release, and rollback • Own governance and discovery for AI assets, including service registries, experiment tracking, model metadata, upstream registries, CVE/SBOM scanning, lineage contracts, and license management • Own resource and cost management, including quotas, rate limits, cost attribution, and utilization • Own the observability stack covering metrics, logs, traces, dashboards, LLM debugging/evaluation, and SLA/alert notifications • Own the OpenTelemetry collection layer, including multi-tenant receivers, exporters, queues, GPU telemetry, batching, and dynamic filtering • Automate GitOps-based delivery and continuous verification with quality, integrity, and cost gates • Use telemetry, evaluation, and cost signals to drive deployment decisions, progressive rollout, and automated rollback • Ensure cost and telemetry are identity-stamped and attributable per tenant end-to-end

🎯 Requirements

• Strong DevOps expertise in CI/CD/CV pipeline design, GitOps, continuous verification, and progressive/automated release and rollback for production workloads • Deep expertise operating model-serving and inference systems (Ray, vLLM/Triton/NIM) on GPUs at production scale • Deep observability skills in metrics, logs, traces, and OpenTelemetry • Ability to attribute, bound, and optimize AI consumption cost per tenant and workload • Familiarity with model/artifact governance, registries, CVE scanning, and license/lineage tracking • Experience operating across cloud, on-prem, edge, and air-gapped environments • Bachelor’s or Master’s degree in Computer Science or related technical field • 8+ years in DevOps, MLOps, platform, or observability engineering, with hands-on production ownership of AI or high-throughput services • Hands-on experience with ArgoCD, Helm, GitHub Actions/GitLab CI, or equivalents • Hands-on expertise with Ray Serve, vLLM, Triton, or NIM on GPU infrastructure • Experience with Prometheus, Grafana, Loki, Tempo/Jaeger, and OpenTelemetry • Experience with API gateways and request routing such as Envoy, including streaming responses • Experience with OpenCost, Kubecost, or equivalent, and quota/rate-limit enforcement • Familiarity with Harbor, MLflow, Trivy/SBOM, and supply-chain scanning • Experience operating AI or service infrastructure under compliance, security, or regulatory constraints • Ability to define ownership boundaries and consumption contracts with platform, trust, and data teams

Apply Now

Similar Jobs

🕒 2 days ago

Karat

201 - 500

👥 HR Tech

🏢 Enterprise

☁️ SaaS

Senior DevOps Engineer managing AWS infrastructure, CI/CD, and observability for Karat’s technical interviewing platform. Improving reliability, security, performance, and cost efficiency.

🕒 6 days ago

Akamai Technologies

5001 - 10000

🔒 Cybersecurity

Senior Site Reliability Engineer automating Linux infrastructure, monitoring, and deployments. Supporting Akamai’s globally distributed cloud and edge platform for reliable, secure digital experiences.

🕒 October 2

JumpCloud

201 - 500

☁️ SaaS

🔐 Security

🏢 Enterprise

Site Reliability Engineer strengthening AWS/GCP reliability, observability, Kubernetes, and disaster recovery. Supporting JumpCloud’s AI-powered unified IT management platform through automation and incident response.

🕒 October 2

JumpCloud

201 - 500

☁️ SaaS

🔐 Security

🏢 Enterprise

Senior SRE architecting multi-region cloud infrastructure, Kubernetes, disaster recovery, and observability for JumpCloud’s AI-powered IT management platform. Driving reliability, FinOps, automation, and incident management.

🕒 September 29

Akamai Technologies

5001 - 10000

🔒 Cybersecurity

Site Reliability Engineer resolving distributed-system reliability issues for Akamai's cloud and edge delivery platform. Automating diagnostics, incident response, and performance improvements across global infrastructure.