Senior Software Engineer – Infra Agent Systems

🕒 August 25

🇮🇳 India – Remote

⏰ Full Time

🟠 Senior

🧑‍💻 Full-stack Engineer

👻 Ghost score 18%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Together AI

WebsiteLinkedInAll Job Openings

11 - 50 employees

🤖 Artificial Intelligence

☁️ SaaS

🏢 Enterprise

💰 $102.5M Series A on 2023-11

Artificial Intelligence • SaaS • Enterprise

Together AI is a company focused on accelerating the generative AI lifecycle by providing solutions for training, fine-tuning, and deploying AI models. They offer an end-to-end platform for leveraging pre-trained models, adapting them to specific needs, or building custom models from scratch. Together AI supports AI compute solutions with its Together Inference engine and Together GPU Clusters, allowing for scalable and efficient AI operations. Their infrastructure is powered by advanced GPUs and optimized software stacks for high performance in AI tasks.

📋 Description

• Design and build production AI agent systems that diagnose, investigate, and remediate infrastructure issues across one of the world’s largest GPU fleets • Build distributed services, orchestration frameworks, knowledge graphs, and retrieval systems that power infrastructure agents • Develop fleet intelligence systems combining telemetry, infrastructure state, operational knowledge, and historical incidents • Integrate with observability, incident management, ticketing, fleet inventory, source control, chat, and internal infrastructure systems through APIs • Own services end to end, including architecture, implementation, testing, deployment, observability, and production operations • Improve agent performance through evaluations, retrieval improvements, better tools, and production feedback loops • Turn agents’ production learnings into reliable, reviewed software and automation • Deliver, operate, and support software in production

🎯 Requirements

• 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms • Strong systems design skills and experience owning significant systems from design through production • Depth in at least one of: AI agent systems, orchestration, tool use, evaluation, or grounding; knowledge graphs or graph data modeling; search, retrieval, ranking, RAG, or semantic search systems • Strong backend engineering experience, including API design, service boundaries, data modeling, and integrations across complex systems • Experience with Kubernetes, GitOps such as ArgoCD, infrastructure-as-code, and cloud platforms • Comfortable working across Go, TypeScript, Python, or Rust • GPU infrastructure, datacenters, bare-metal systems, hardware failure modes, BMC/IPMI, or cluster schedulers is a plus • Graph databases is a plus • Event-driven systems and messaging platforms such as NATS or Kafka is a plus • Observability platforms such as Prometheus and Grafana is a plus • Building evaluation frameworks or improving the quality and reliability of LLM-powered systems is a plus