LLM Systems – AI Agent Engineer

Job not on LinkedIn

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Smart Working

WebsiteLinkedInAll Job Openings

51 - 200 employees

💼 Consulting

🏥 Healthcare

📣 Marketing

Consulting • Healthcare • Marketing

Smart Working is a recruitment service specializing in sourcing and providing top-tier software developers from around the world to meet the needs of businesses. With a robust vetting process that includes technical assessments and background checks, Smart Working ensures that clients receive highly skilled developers adept in various programming languages and frameworks. The company focuses on flexible and remote hiring solutions, allowing businesses to efficiently scale their development teams while benefiting from significant cost savings.

📋 Description

• Build and evolve production AI agents on foundation models, currently AWS Bedrock • Develop and evolve orchestration for production AI agents • Apply context engineering to production LLM and agent systems • Build and maintain evaluation datasets and pipelines, including tool-selection, trajectory, and LLM-as-judge evaluations • Build and maintain production observability and monitoring for LLM and agent systems • Implement and work with tracing and instrumentation for production LLM systems • Work alongside the engineer leading the AI-agenting function as the first dedicated hire • Help determine whether to retain the custom orchestration layer or adopt a production framework such as LangGraph or LangChain • Work as part of a new three-person product team with the AI function lead and a Full Stack Engineer • Operate as an individual contributor rather than managing others • Take ownership of measurable deliverables immediately upon onboarding • Deliver similar AI/agent engineering work against roadmap timelines

🎯 Requirements

• 2+ years of experience building production LLM agents, including tool-calling agent loops, streaming, context management, structured outputs, and orchestration frameworks • Production experience with an agentic framework such as LangGraph, LangChain, or custom orchestration • 1.5+ years of experience with evaluation-driven development, including evaluation datasets and pipelines covering tool selection, trajectory evaluation, and LLM-as-judge • 1+ year of experience with LLM observability, tracing, and instrumentation using Langfuse, OpenTelemetry, or similar tooling • Genuine production agent-observability exposure; direct hands-on Langfuse experience is strongly preferred • 1+ year of experience with LLM cost optimization, including prompt caching, model selection and routing, and LLM FinOps • 5+ years of backend engineering proficiency, including TypeScript/Node, Postgres, and serverless AWS • Proven experience delivering similar work on similar timelines • Experience shipping agentic AI systems to production, speaking to concrete failure modes and mitigations, and operating end-to-end across the AI stack • Nice to have: 1+ year of AWS Bedrock experience or transferable production experience with OpenAI, Anthropic API, Azure OpenAI, or Vertex AI • Nice to have: 1+ year of experience with AI safety and guardrails, including prompt-injection screening, output validation, and handling untrusted input • Nice to have: 6+ months of familiarity with MCP and multi-agent patterns • Nice to have: familiarity with geospatial data

🏖️ Benefits

• Fixed shifts: 12:00 PM - 9:30 PM IST (Summer) | 1:00 PM - 10:30 PM IST (Winter) • No weekend work • Laptop provided from Day 1 • Full medical insurance provided from Day 1 • Mentorship, community, and forums where ideas are shared • Long-term career where contributions are valued