Senior Applied Scientist

Job not on LinkedIn

🔥 0 minutes ago

🇨🇴 Colombia – Remote

⏰ Full Time

🟠 Senior

🧬 Research Scientist

👻 Ghost score 11%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Caseware

WebsiteLinkedInAll Job Openings

201 - 500 employees

💸 Finance

🏢 Enterprise

☁️ SaaS

Finance • Enterprise • SaaS

Caseware is a global leader in providing software solutions for accounting, auditing, and financial reporting. Their products, such as Caseware Cloud and Caseware Working Papers, are designed to modernize accounting practices, streamline audits, and provide robust financial reporting tools for accounting firms, corporations, and government entities. Caseware is renowned for integrating advanced technologies, including AI-driven tools, to enhance efficiency and insight for its users. Their offerings are localized to meet regional standards and cater to diverse sectors, including public and private organizations. With a focus on transformation through technology, Caseware supports over 500,000 accounting professionals in more than 130 countries.

📋 Description

• Design and run experiments measuring and improving the quality of LLM-based applications and agents • Build and own evaluation methodologies, benchmarks, regression suites, scoring methods, acceptance thresholds, and release-gate signals • Partner with platform engineering on automated comparison infrastructure and drift or regression alerts • Build AI-based tools and capabilities for Caseware’s end-to-end agent builder • Build synthetic data generation and evaluation-builder capabilities • Convert domain procedures into task-plus-verifier structures • Advance applied science on agentic memory and define and validate memory promotion and demotion criteria • Develop self-learning, self-improving systems that improve offline and online • Ensure memory criteria uphold legal and contractual obligations, collaborating with Security, Legal, and Domain SMEs • Design evaluations demonstrating that agent quality improves with platform usage • Translate GenAI advances into practical, maintainable capabilities • At staff level, influence technical direction through RFCs and design reviews and mentor scientists and engineers

🎯 Requirements

• 6+ years (senior) to 8+ years (staff) of professional experience in applied science, machine learning, research, or data-intensive engineering • 2+ years working on production GenAI or LLM-based systems • Proven experience designing and building evaluation frameworks for ML or LLM systems, including metrics, benchmarks, scoring approaches, and rigorous experiment design • Strong experimentation mindset and ability to draw defensible conclusions from noisy, real-world data • Ability to build and operate production tooling and services, ideally on AWS • Strong understanding of GenAI tradeoffs including quality, latency, cost, reliability, and safety • Strong foundation in probability and statistics, including experimental design, significance testing, and reasoning under uncertainty • Strong English language communication and collaboration skills • Comfortable operating in fast-moving environments with ambiguity and evolving requirements • PhD or MS in a quantitative field preferred; equivalent industry experience welcome • Prior machine learning experience • Experience with AI guardrails, governance, or safety mechanisms • Experience with distributed, SaaS, cloud-native, multi-tenant platforms at scale • Familiarity with Infrastructure as Code, including CDK, CloudFormation, or Terraform • Experience in regulated or compliance-heavy domains • Familiarity with financial audit, accounting, or assurance workflows • TypeScript, NestJS, Python, AWS EKS, AWS Lambda, AWS Bedrock, AWS AgentCore, AWS OpenSearch, S3 Vectors, AWS Textract, DynamoDB, S3, LangFuse, LangSmith, LangChain, LangGraph, GitHub, GitHub Actions, and Nx Monorepo

🏖️ Benefits

• Contrato a termino Indefinido with all the legal benefits • Prepaid Medicine • Life insurance and funeral assistance • Internet allowance • Home office stipend • Competitive compensation — above the market average • 100% remote work environment and an excellent work-life balance • 5 Personal Time Off days per year • Sick Leave Top up to total 100% of salary paid by the employer from Day 3 to 90 • Recognition Award, additional paid time off in recognition of the corresponding year of service • Upgrade vacation starting at 5 years of service • Opportunity to work for a growing global SaaS leader company • A culture that promotes independence, innovation, trust, and accountability • Open space to be creative, innovative and strategize for the future • Mentorship by highly experienced professional • Budget for training • AI-first environment with modern tools, automation, and AI-driven ways of working • Flexible work options, remote opportunities, and generous time-off policies • Recognition programs, performance bonuses, and opportunities for career growth • International projects and collaboration with a diverse, global team