Senior Software Engineer, Python, AI Platform

🔥 0 minutes ago

🇺🇸 United States – Remote

💵 $195k - $260k / year

⏰ Full Time

🟠 Senior

🔙 Backend Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Smarsh

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2001

💼 Consulting

🏥 Healthcare

🛡️ Insurance

💰 Private Equity Round on 2016-01

Consulting • Healthcare • Insurance

Smarsh is the global leader in communications data and intelligence, focusing on digital communications compliance and risk management in regulated industries. With over two decades of experience, Smarsh delivers AI-enabled solutions to unlock business insights from communications data at scale. Trusted by 95% of top financial firms and managing billions of messages monthly, Smarsh offers services like chat capture, email archiving, and digital risk surveillance. Their platforms are designed to meet the diverse and evolving needs of financial services, government, healthcare, and other industries, enhancing productivity and ensuring compliance with digital communication governance challenges.

📋 Description

• Drive backend development for AI workflows using Python and FastAPI • Productionize LLM integrations, including Bedrock usage, quotas, retries, failover, cost controls, model configuration, and approval constraints • Design secure, compliant systems with tenant isolation, auditability, observability, and traceable AI outputs • Scale enterprise platform capabilities through async job orchestration, performance tuning, and data-layer optimization • Contribute to multi-tenant services, RBAC, SSO integration, and administrative/reporting capabilities • Improve reliability with monitoring, tracing, alerting, and operational tooling • Design real-time event delivery and pub/sub patterns for workflow state, notifications, and agent feedback • Partner on shared services, platform architecture, and integration boundaries • Translate evolving product and non-functional requirements into technical solutions with product, architecture, legal, and security stakeholders • Drive strong typing, automated testing, continuous integration, and schema-driven API contracts

🎯 Requirements

• 7+ years of professional software development experience, including 5+ years building Python services in production • Strong Python backend engineering with APIs, async processing, background jobs, and workflow orchestration • AWS cloud-native backend experience • Proven production distributed-systems experience with reliability, observability, retries, throughput, failure handling, and performance tuning • Strong PostgreSQL and large-scale data processing knowledge, including indexing, query tuning, and batch/stream tradeoffs • Required experience with retrieval-augmented generation (RAG), vector search, and embedding-based systems • Experience with multi-tenant systems, RBAC, audit logging, secure data handling, and regulated environments • Hands-on experience building LLM-driven workflows, including tool-calling, state machines, human-in-the-loop approvals, checkpoint/resume, and multi-step orchestration • Familiarity with LangGraph or equivalent • Experience with prompt engineering, evaluation design, and LLM cost optimization • Experience working with AI-native engineering teams • Product mindset and ability to make pragmatic, customer-grounded tradeoffs • Strong pluses: Bedrock, OpenAI, Anthropic, LangChain/LangGraph, SSO/SAML/OIDC, graph-shaped data, entity resolution, OpenTelemetry, Terraform, feature flags, canary deployments, and release strategies

🏖️ Benefits

• Applicable bonus programs discussed during the recruiting process • Opportunities for professional development • Diverse and inclusive culture • Collaboration-focused work environment