Senior Software Engineer II – AI Engineering

🔥 23 hours ago

🇺🇸 United States – Remote

💵 $175k - $245k / year

⏰ Full Time

🟠 Senior

🤖 AI Engineer

🦅 H1B Visa Sponsor

This company has sponsored H1B visas in the past.

👻 Ghost score 0%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Smartsheet

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 2005

💼 Consulting

🏥 Healthcare

📣 Marketing

Consulting • Healthcare • Marketing

Smartsheet is a platform designed to manage projects, automate workflows, and build solutions at scale. It offers a wide range of features including automation, team collaboration, dashboards and reporting, and integrations, allowing businesses to streamline their operations. The platform caters to diverse use cases such as project management, IT portfolio management, marketing management, and more, serving various industries including government, finance, and healthcare. Smartsheet also emphasizes security and data protection, ensuring users' data privacy. Additionally, it offers professional services like consulting, training, and implementation support to maximize the platform's capabilities.

📋 Description

• Design and build production-grade LLM-powered agents and workflows within Smartsheet • Make architecture decisions on system design, data pipelines, and deployment strategies • Develop and optimize prompts, RAG pipelines, and agent reasoning patterns • Build evaluation frameworks to measure accuracy, hallucination rates, and performance across model versions • Implement and manage end-to-end AI systems on AWS, GCP, or Azure • Monitor and optimize cloud-based AI systems and respond to incidents • Collaborate with Engineering, Product, and cross-functional teams to translate business requirements into technical AI solutions • Mentor and guide engineers on applied ML best practices, modern AI development patterns, and production considerations • Establish best practices and standards for AI development, model governance, and responsible AI • Evaluate emerging AI/LLM tools, frameworks, and techniques • Contribute to full-stack applications, both legacy and greenfield • Deliver measurable, validated quality improvements on SmartAssist agents • Expand evaluation coverage and establish a repeatable quality improvement methodology

🎯 Requirements

• 8+ years of software engineering experience, with at least 2 years working directly with LLMs in production • Deep, hands-on experience with prompt engineering and context engineering • Strong working knowledge of RAG architectures, including chunking strategies, embedding models, retrieval evaluation, and failure diagnosis • Experience building or extending LLM evaluation frameworks, including designing scorers and working with golden datasets • Fluency in agent system design and architectural tradeoffs • Strong Python skills • Comfortable working in data-heavy environments such as Databricks and Delta tables, or equivalent • Ability to communicate complex quality findings to technical and non-technical stakeholders • Strong cross-functional judgment • Bias for clarity in ambiguous situations • Legally eligible to work in the U.S. on an ongoing basis • BS or MS in Computer Science, a related field, or equivalent industry experience • Strong plus: experience with MLflow or similar experiment tracking platforms • Strong plus: familiarity with CI-integrated evaluation pipelines • Strong plus: experience with multi-agent orchestration frameworks • Strong plus: prior work in an Applied AI or LLMOps function within a product company

🏖️ Benefits

• Employer subsidized medical/vision and dental coverage for full-time employees • 401k Match to help you save for your future (50% of your contribution up to the first 6% of your eligible pay) • Monthly stipend to support your work and productivity • Flexible Time Away Program, plus Sick Time Off • US employees are automatically covered under Smartsheet-sponsored life insurance, short-term, and long-term disability plans • US employees receive 12 paid holidays per year • Up to 24 weeks of Parental Leave • Personal paid Volunteer Day to support our community • Opportunities for professional growth and development including access to Udemy online courses • Company Funded Perks, including a counseling membership, local retail discounts, and your own personal Smartsheet account • Teleworking options from any registered location in the U.S. (role specific) • Market competitive incentive opportunity