Member of Technical Staff – Inference Platform

Job not on LinkedIn

🔥 6 minutes ago

🇧🇷 Brazil – Remote

⏰ Full Time

🔴 Lead

🖥 Software Engineer

👻 Ghost score 12%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

avra

WebsiteLinkedInAll Job Openings

1 - 10 employees

💼 Consulting

💸 Finance

🤝 B2B

Consulting • Finance • B2B

Avra is a venture capital firm dedicated to empowering growth stage founders by providing the essential support needed to scale their companies after Series A funding. With a commitment to building a prosperous future together, Avra focuses on strategic investments that foster innovation and entrepreneurship.

📋 Description

• Own execution environments for models on the Platform team • Evolve Sophos, the online and batch inference runtime built on Kubernetes • Run large batch inference on ephemeral jobs using multi-dimensional admission control through Kueue • Build and extend the Sophos controller and Kubernetes custom resources • Optimize model inference engines and feature processing using vectorized, columnar operations • Serve graphs and data efficiently from Lance-based storage • Own training, post-training, and fine-tuning jobs in Avra's cloud and customer dataplanes • Drive autoscaling, GPU serving, performance, and cost optimization with telemetry for every model • Solve deterministic job sizing, checkpointing and recovery, customer encryption and isolation, input-file resilience, and automatic profiling • Achieve 99.9% serving availability, low online-inference latency, high batch throughput, optimized costs, GPU utilization, and reliable job completion

🎯 Requirements

• Experience running model serving or large-scale batch compute on Kubernetes • Experience building Kubernetes controllers or operators • Skill at profiling and optimizing data-heavy Python pipelines • Clear sense of cost and compute efficiency • Production-quality code and code review experience • Willingness to operate what you build • Nice-to-have: Ray, Ray Serve, or KubeRay in production • Nice-to-have: Kueue or other batch scheduling and admission-control systems • Nice-to-have: GPU serving and performance optimization • Nice-to-have: Arrow, Parquet, Lance, or other columnar formats • Nice-to-have: Shipping software to customer-hosted Kubernetes • Nice-to-have: GCP/AWS, GKE/EKS, and experience in financial services or regulated environments