Member of Technical Staff – Inference Platform

Job not on LinkedIn

🕒 September 23

🇧🇷 Brazil – Remote

⏰ Full Time

🟠 Senior

🖥 Software Engineer

Where this job comes from

Posted on avra's careers page ↗avra's careers page, not through a job board

First seen by Remote Rocketship September 23

Still open on avra's site. Checked 4 hours ago.

Apply Now
Logo of avra

avra

1 - 10 employees

💼 Consulting

💸 Finance

🤝 B2B

Consulting • Finance • B2B

Avra is a venture capital firm dedicated to empowering growth stage founders by providing the essential support needed to scale their companies after Series A funding. With a commitment to building a prosperous future together, Avra focuses on strategic investments that foster innovation and entrepreneurship.

📋 Description

• Own execution environments for models on the Platform team • Evolve Sophos, the online and batch inference runtime built on Kubernetes • Run large batch inference on ephemeral jobs using multi-dimensional admission control through Kueue • Build and extend the Sophos controller and Kubernetes custom resources • Optimize model inference engines and feature processing using vectorized, columnar operations • Serve graphs and data efficiently from Lance-based storage • Own training, post-training, and fine-tuning jobs in Avra's cloud and customer dataplanes • Drive autoscaling, GPU serving, performance, and cost optimization with telemetry for every model • Solve deterministic job sizing, checkpointing and recovery, customer encryption and isolation, input-file resilience, and automatic profiling • Achieve 99.9% serving availability, low online-inference latency, high batch throughput, optimized costs, GPU utilization, and reliable job completion

🎯 Requirements

• Experience running model serving or large-scale batch compute on Kubernetes • Experience building Kubernetes controllers or operators • Skill at profiling and optimizing data-heavy Python pipelines • Clear sense of cost and compute efficiency • Production-quality code and code review experience • Willingness to operate what you build • Nice-to-have: Ray, Ray Serve, or KubeRay in production • Nice-to-have: Kueue or other batch scheduling and admission-control systems • Nice-to-have: GPU serving and performance optimization • Nice-to-have: Arrow, Parquet, Lance, or other columnar formats • Nice-to-have: Shipping software to customer-hosted Kubernetes • Nice-to-have: GCP/AWS, GKE/EKS, and experience in financial services or regulated environments

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 September 17

IT2YOU- A TECNOLOGIA RECRUTANDO PARA VOCÊ

11 - 50

💼 Consulting

⚖️ Legal

🎯 Recruiter

Desenvolvedor SAP ABAP MDG Sênior na IT2YOU, atuando remotamente em desenvolvimento e customização SAP MDG. Integração com equipes internacionais em projeto de 12 meses.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 September 1

MTP Brasil

501 - 1000

💼 Consulting

🛡️ Insurance

📦 Logistics

Desenvolvedor Adobe Marketo Engage implementando campanhas, jornadas e integrações de automação de marketing na MTP. Atuando com Marketing, Produto, Arquitetura e Desenvolvimento.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 September 1

MTP Brasil

501 - 1000

💼 Consulting

🛡️ Insurance

📦 Logistics

Desenvolvedor sênior de Adobe Experience Platform implementando soluções de dados e integrações. MTP apoia grandes empresas em transformação digital e Digital Business Assurance.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 August 27

ROIT

51 - 200

💼 Consulting

⚖️ Legal

☁️ SaaS

Desenvolvedor AI First construindo sistemas internos e CRM para a ROIT, empresa de tecnologia e dados tributária. Integrando APIs, canais digitais e aplicações criadas com IA.

🗣️🇧🇷🇵🇹 Portuguese Required

🕒 August 27

CI&T

5001 - 10000

💼 Consulting

🏥 Healthcare

📣 Marketing

Senior Data Developer building pipelines, applications, and machine-learning solutions for CI&T’s enterprise supply-chain transformation clients. Working across BigQuery, SAP, Git, ETL, databases, and AI systems.

🇧🇷 Brazil – Remote

💰 $5.5M Venture Round on 2014-04

⏰ Full Time

🟡 Mid-level

🟠 Senior

🖥 Software Engineer

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok