Applied AI Engineer

Job not on LinkedIn

🕒 6 days ago

🇨🇦 Canada – Remote

⏰ Full Time

🟠 Senior

🤖 AI Engineer

Where this job comes from

Posted on DistantJob's careers page ↗DistantJob's careers page, not through a job board

First seen by Remote Rocketship 6 days ago

Still open on DistantJob's site. Checked 51 minutes ago.

Apply Now
Logo of DistantJob

DistantJob

51 - 200 employees

🎯 Recruiter

👥 HR Tech

☁️ SaaS

Recruitment • HR Tech • SaaS

DistantJob is a remote staffing agency specializing in the recruitment of top-tier technical talent from around the world. Unlike traditional outsourcing firms or freelance sites, DistantJob focuses on offering headhunting services to find individuals who fit specific job requirements and company cultures. They provide cost-effective staffing solutions by sourcing talent from offshore locations while maintaining high quality and retention standards. DistantJob takes a tailored approach to recruitment, ensuring candidates have both the hard and soft skills needed for success, and facilitating a seamless integration into client companies.

📋 Description

• Turn scenario specs, decision models and assessment rubrics into prompts, application logic and testable behavior • Spot missing requirements and technical constraints, and raise them with Product, Engineering and SMEs • Define how AI models connect to application services and approved data sources, including APIs, tool interactions, data structures, validation, error handling and permitted actions • Design prompts, structured outputs and validation logic, and catch invalid responses before they reach learners • Build conversational runtimes with controlled personas, session state and explicit state transitions • Keep simulation behavior, assessment logic and feedback separate so feedback cannot change assessment results • Implement grounding and retrieval from approved knowledge sources, with source references where required • Keep code, prompts, schemas and evaluation assets under version control, and document them • Run bounded experiments with Product, with clear questions and success measures • Take validated prototypes into production with Engineering, and check behavior stays the same • Help build technical controls that keep AI features compliant with accreditation requirements, including issue flagging, review steps, disclosure and logging

🎯 Requirements

• Expert prompt and context engineering: system prompts, few-shot examples, prompt chaining, routing, breaking complex tasks into steps • Structured outputs with JSON Schema, function calling and validation layers, with retry and fallback logic • RAG design: chunking, metadata filtering, hybrid search, reranking, citation grounding • Managing token budgets, prompt caching, context compaction and long-session memory • Agentic systems: tool use, planner/executor patterns, multi-agent orchestration, state machines, human-in-the-loop checkpoints • Defining tool schemas, permission scopes and action limits for agents • AI evaluation: golden datasets, rubric-based scoring, LLM-as-judge calibrated against human raters, regression testing • LLM observability and tracing • LLM security: prompt injection, data leakage, jailbreaks, unsafe tool actions, and guardrails • Comparing prompting, retrieval and model options on quality, latency and cost • Python or TypeScript, including API integrations and automated testing • Git (e.g. Bitbucket), reproducible tests and CI • Works with AI coding agents by default • Explains technical trade-offs to non-technical colleagues • Sound judgment on privacy, human oversight and the limits of AI-generated assessment or advice • Hands-on experience building LLM applications with multi-step conversational workflows • Experience collaborating with subject-matter experts • Background in learning products, assessment, simulations or regulated professional content (Preferred)

🏖️ Benefits

• Fully remote, long-term opportunity • Collaboration with broadly distributed staff • Agile-first teams

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 November 13

clearer.io

201 - 500

🛍️ eCommerce

🤝 B2B

☁️ SaaS

Staff AI Engineer advancing agentic AI, commerce protocols and Shopify integrations for clearer.io’s eCommerce platform. Building prototypes and guiding production product development.

🕒 November 10

Veralto

10,000+ employees

🏥 Healthcare

🍽️ Food & Beverage

📦 Logistics

Staff AI Engineer leading production LLM and agentic systems at TraceGains, a supply-chain risk and compliance technology company. Shaping AI architecture, evaluation, and engineering practices.

🕒 November 9

Versaterm

201 - 500

💼 Consulting

🏥 Healthcare

⚖️ Legal

AI-native senior engineer architecting secure, scalable software for Versaterm’s public safety SaaS platform. Leading AI-assisted development, production reliability, and engineering innovation.

🕒 November 9

Bestpass

51 - 200

📦 Logistics

🚗 Transport

☁️ SaaS

Senior AI software engineer building production agents, context layers, and workflows for Fleetworthy’s fleet-readiness technology suite. Owning infrastructure, reliability, and agentic engineering practices.

🕒 November 9

Warner Music Group

1001 - 5000

📱 Media

Senior AI Research Engineer developing attribution, protection, and licensing infrastructure for AI use of music and media. Building original research into scalable enterprise products.

🇨🇦 Canada – Remote

💵 $110k - $145k / year

💰 Post-IPO Debt on 2021-10

⏰ Full Time

🟠 Senior

🤖 AI Engineer

Built by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok