Applied Research Scientist

🕒 February 26

Apply Now

Find Similar Remote Jobs

Receive Emails For Remote Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Sully.ai

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2023

🤖 Artificial Intelligence

⚕️ Healthcare Insurance

☁️ SaaS

Artificial Intelligence • Healthcare Insurance • SaaS

Sully. ai is an innovative company that provides AI agents designed specifically for healthcare organizations. By utilizing AI technology, Sully. ai offers services that enhance various healthcare functions, such as clinical procedures, patient appointment management, medical billing, and patient care coordination. Their AI agents are built to be 10 times faster and 20 times cheaper than traditional healthcare employees, while ensuring safety, security, and compliance with industry standards like HIPAA. Healthcare providers across the country have embraced Sully. ai for its efficiency and effectiveness in improving patient care and operational workflows.

📋 Description

• Build and scale automated evaluation pipelines (LLM-as-judge + human review) with clinical-grade benchmarks. • Audit existing evaluation approaches for clinical and agentic tasks. • Define initial benchmarks and build early automated pipelines. • Partner with engineering to land first set of CI gates for accuracy, factuality, and safety. • Deliver a repeatable evaluation framework with automated pipelines in production. • Demonstrate measurable improvements in robustness, hallucination reduction, or safety. • Publish or present internal research findings that directly shape product reliability.

🎯 Requirements

• Proven experience designing agentic processes and LLM evaluation/benchmarking frameworks. • Strong Python and ML background (PyTorch/TensorFlow, Hugging Face, LangChain/LlamaIndex). • Demonstrated ability to design rigorous experiments and translate findings into production. • Track record of published research or deep applied work in LLMs and agent evaluation. • Strong communication and technical writing skills to articulate complex findings clearly.

🏖️ Benefits

• Speed matters - we operate with urgency, autonomy, and ownership • You’ll work on real, first-of-their-kind problems at the edge of AI and medicine • Your work helps doctors reclaim their time - and patients get better, faster care