Senior Applied Scientist

Job not on LinkedIn

🔥 0 minutes ago

🇨🇴 Colombia – Remote

⏰ Full Time

🟠 Senior

🧬 Research Scientist

👻 Ghost score 11%

infoinfo
Apply Now
Find Similar Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Logo of Caseware

Caseware

201 - 500 employees

💸 Finance

🏢 Enterprise

☁️ SaaS

Finance • Enterprise • SaaS

Caseware is a global leader in providing software solutions for accounting, auditing, and financial reporting. Their products, such as Caseware Cloud and Caseware Working Papers, are designed to modernize accounting practices, streamline audits, and provide robust financial reporting tools for accounting firms, corporations, and government entities. Caseware is renowned for integrating advanced technologies, including AI-driven tools, to enhance efficiency and insight for its users. Their offerings are localized to meet regional standards and cater to diverse sectors, including public and private organizations. With a focus on transformation through technology, Caseware supports over 500,000 accounting professionals in more than 130 countries.

📋 Description

• Design and run experiments measuring and improving the quality of LLM-based applications and agents • Own evaluation methodology including benchmarks, regression suites, scoring methods, acceptance thresholds, and offline/online performance comparisons • Partner with platform engineering on automated evaluation infrastructure, drift and regression alerts, and release gates • Build AI-based capabilities for Caseware’s end-to-end agent builder • Build synthetic data generation and evaluation-builder capabilities • Convert domain procedures into task-plus-verifier structures • Apply statistical methods and audit-domain knowledge to agentic memory • Define and validate memory promotion and demotion criteria • Advance self-learning and self-improving systems • Ensure memory criteria uphold legal and contractual obligations in partnership with Security, Legal, and Domain SMEs • Design evaluations showing agent quality improves with platform usage • Translate GenAI advances into practical, maintainable capabilities • Influence technical direction through RFCs and design reviews at staff level • Mentor scientists and engineers

🎯 Requirements

• 6+ years (senior) to 8+ years (staff) of professional experience in applied science, machine learning, research, or data-intensive engineering • 2+ years working on production GenAI or LLM-based systems • Proven experience designing and building evaluation frameworks for ML or LLM systems • Experience with metrics, benchmarks, scoring approaches, and rigorous experiment design • Strong experimentation mindset and ability to draw defensible conclusions from noisy, real-world data • Ability to build and operate production tooling and services, ideally on AWS • Strong understanding of GenAI tradeoffs including quality, latency, cost, reliability, and safety • Strong foundation in probability and statistics, including experimental design and significance testing • Strong English language communication and collaboration skills • Comfortable operating in fast-moving environments with ambiguity and evolving requirements • PhD or MS in a quantitative field preferred; equivalent industry experience welcome • Prior machine learning experience • Experience with AI guardrails, governance, or safety mechanisms • Experience with distributed, SaaS, cloud-native, multi-tenant platforms at scale • Familiarity with Infrastructure as Code, including CDK, CloudFormation, or Terraform • Experience in regulated or compliance-heavy domains • Familiarity with financial audit, accounting, or assurance workflows

🏖️ Benefits

• Contrato a termino Indefinido with all the legal benefits • Prepaid Medicine • Life insurance and funeral assistance • Internet allowance • Home office stipend • Competitive compensation — above the market average • 100% remote work environment and an excellent work-life balance • 5 Personal Time Off days per year • Sick Leave Top up to total 100% of salary paid by the employer from Day 3 to 90. • Recognition Award, additional paid time off in recognition of the corresponding year of service • Upgrade vacation starting at 5 years of service • Opportunity to work for a growing global SaaS leader company • A culture that promotes independence, innovation, trust, and accountability • Open space to be creative, innovative and strategize for the future • Mentorship by highly experienced professional • Budget for training • AI-first environment with modern tools, automation, and AI-driven ways of working • Flexible work options, remote opportunities, and generous time-off policies • Recognition programs, performance bonuses, and opportunities for career growth • International projects and collaboration with a diverse, global team

Apply Now