Senior Software Engineer, Agentic AI Systems

Job not on LinkedIn

🔥 0 minutes ago

☕ Washington – Remote

☕ Washington – Remote

💵 $45 / hour

⏳ Contract/Temporary

🟠 Senior

⚙️ Systems Engineer

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Siteup

WebsiteLinkedInAll Job Openings

1 - 10 employees

Founded 2024

Elevate your online presence with our innovative web and app development solutions and strategic digital marketing services. At SiteUp, we specialize in crafting custom websites and mobile apps that engage users and drive business growth. Explore our services and unleash the full potential of your digital presence today.

📋 Description

• Own End-to-End Delivery: Take a production LLM agent from requirement to production deploy, and defend the architecture and trade-offs directly with the client. • Agent Orchestration: Build and harden orchestration (LangGraph / LangChain or equivalent) — routing, tool-calling, planning, synthesis, and state management. • Tool & Retrieval Integration: Integrate tools over MCP and keep a growing tool surface fast and correct, including BM25, hybrid, or vector retrieval as scale demands. • AWS Bedrock & AgentCore: Run models on Bedrock and Bedrock AgentCore — model selection/routing, guardrails, memory, and regional residency profiles. • Evaluation & Observability: Build the eval harness (golden sets, LLM-as-judge, quality gates wired into CI) and instrument the system with OpenTelemetry for per-session token, cost, and latency attribution. • Cost, Latency & Resilience: Drive down cost and latency with real levers (model routing, prompt caching, payload pruning, parallelizing independent calls) behind a regression gate, and build in circuit breakers, fallbacks, and dead-letter handling. • Safe Write-Actions: Design and stage write-actions with least-privilege permissions, human-in-the-loop approval, plan versioning, audit trail, and rollback — released behind feature flags to a small cohort first.

🎯 Requirements

• 5+ Years in Software Engineering: At least 2 of them genuinely at a senior level, with strong Python in production and comfort picking up TypeScript or Go when a project calls for it. • Hands-On LLM Application Engineering: Prompt design, tool/function calling, structured output, context management, and token budgeting, in a system real users hit. • Agent Orchestration Experience: Built or operated orchestration with a framework like LangGraph or LangChain, or hand-rolled, beyond single-prompt calls. • Managed LLM/Agent Platform in Production: AWS Bedrock, Google Vertex AI, or Azure AI Foundry — model invocation, streaming, guardrails, and agent tooling. We use Bedrock and Bedrock AgentCore; equivalent depth on Vertex AI or Azure transfers directly. • Evaluation, Retrieval & Observability: Eval harnesses and golden/reference sets, vector or hybrid search in production, and OpenTelemetry-based distributed tracing with token/cost/latency attribution. • Production AWS, CI/CD & IaC: Real IAM, networking, storage, and observability experience, CI/CD pipelines versioned as code, and Terraform in production. • Working English: Comfortable defending system design and technical decisions directly on client calls.