Applied AI Engineer

🔥 4 minutes ago

🇨🇦 Canada – Remote

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

👻 Ghost score 10%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Velixo

WebsiteLinkedInAll Job Openings

11 - 50 employees

🔌 API

💸 Finance

⚡ Productivity

API • Finance • Productivity

Velixo is a company that provides a platform for real-time reporting, budgeting, and automation using Excel, specifically designed for ERP systems. Their solution enhances ERP functionalities by integrating deeply with Excel to deliver efficient, effective reporting and planning services. The platform offers features such as analyzing, budgeting, planning, and automating tasks all while maintaining governance and collaboration among users. Velixo integrates with various systems like Acumatica, Sage Intacct, and MYOB, among others. The platform is optimized for financial reporting, project forecasting, and operational analysis, making it a powerful tool for companies looking to improve their financial management processes.

📋 Description

• Build and maintain regression suites for GIQL query generation, writeback correctness, and tool selection • Define measurable quality standards for each action type • Run structured evaluations before model upgrades or prompt changes and recommend whether to ship • Track quality over time to detect degradation • Instrument Gateway actions for tokens, cache behavior, model, latency, and tenant • Establish and maintain cost-per-action baselines • Reduce costs through prompt compression, prompt caching, context pruning, and routing to smaller models • Identify expensive customers, query shapes, and failure or retry loops • Track new model releases and evaluate them against Velixo workloads • Maintain a view of the price and performance frontier • Recommend when to migrate, wait, or run models in parallel • Supply unit-cost data for credit pricing and plan allowances • Model margin impact of proposed pricing changes with the VP Finance • Flag product decisions that may change the cost curve • Deliver full Gateway instrumentation and a cost dashboard in the first 30 days • Deliver an evaluation suite and documented baseline by days 31–60 • Deliver a prioritized cost-reduction roadmap and at least one measured optimization by days 61–90

🎯 Requirements

• Substantial experience building on LLM APIs in production, not in demos or notebooks • Experience building an evaluation harness • Hands-on experience with tracing and observability platforms such as Langfuse • Experience with evaluation frameworks such as promptfoo • Knowledge of token accounting, context window management, and caching strategies • Strong analytical skills and fluency with data • Ability to write clearly about tradeoffs for a non-technical audience • Python or TypeScript proficiency • Nice to have: Experience with MCP or other tool-calling frameworks • Nice to have: Background in ERP, accounting, or financial systems • Nice to have: Prior exposure to usage-based or credit-based pricing models • Nice to have: Experience at a small company where you set your own priorities

🏖️ Benefits

• Fully remote position • Equal opportunity employer • Inclusive work environment

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume