Applied AI Engineer

🔥 10 hours ago

🇺🇸 United States – Remote

💵 $105k - $165k / year

⏰ Full Time

🟡 Mid-level

🟠 Senior

🤖 AI Engineer

👻 Ghost score 0%

What it means: the chance that no one is really hiring for this job.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

FICO

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1956

💼 Consulting

🛡️ Insurance

🏥 Healthcare

Consulting • Insurance • Healthcare

FICO is a leading analytics and software company renowned for its FICO® Score, a tool widely used by lenders to assess credit risk. The company offers a comprehensive platform that leverages data, AI, and machine learning to power intelligent decision-making and customer engagement across various industries. FICO's solutions span fraud detection, credit scoring, and customer lifecycle management, making it vital to sectors such as finance and telecommunications. Its innovative products help businesses optimize outcomes through real-time analytics, business composability, and scenario management.

📋 Description

• Own the quality, safety, and performance of AI-powered consumer features • Own and improve system prompts, tool descriptions, and evaluation prompts for Personalized Credit Insights and the AI chat assistant • Build and expand the LLM evaluation framework • Convert production failures into test cases and run regression suites before prompt or model changes • Report evaluation results to business stakeholders • Measure LLM-based evaluator reliability against human-labeled data using precision, recall, and agreement • Design, tune, and monitor guardrails including classifiers, PII redaction, prompt-injection defenses, and financial-advice compliance rules • Lead model upgrades by evaluating quality, cost, and latency and deploying safely through A/B tests • Reduce cost and latency through prompt caching, model routing, and context management • Build transcript viewers, labeling workflows, dashboards, and other tools for Conversation Analysts and QA engineers • Partner with Analytics, Legal, and Compliance on fairness and bias evaluation • Use AI coding assistants and agentic workflows to accelerate delivery while reviewing and refining generated output

🎯 Requirements

• Bachelor's or Master's in Computer Science, Engineering, or a related field, with demonstrated professional software engineering experience • Strong Python skills • Ability to read and contribute to Java (Spring Boot) microservices • Proven experience building and operating LLM-powered applications in production • Experience with prompt design, tool calling, structured outputs, and streaming • Experience building evaluations for LLM systems, including test sets, regression suites, LLM-as-judge approaches, and measuring evaluator quality against human labels • Working knowledge of Amazon Bedrock or a comparable managed LLM platform • Experience with AWS services such as S3, Lambda, and DynamoDB • Proficient SQL and comfort analyzing production data in a data warehouse such as Amazon Redshift • Production ownership including code review, CI/CD, release management, and on-call support • Experience working within Agile/Scrum teams • Strong written and verbal communication skills • Experience with guardrail tooling, LLM security testing, RAG and retrieval evaluation, fairness and bias evaluation, model migrations, Datadog, Tableau, or regulated domains is a plus

🏖️ Benefits

• Highly competitive compensation, benefits and rewards programs • Inclusive culture • Professional development and valuable learning experiences • Work/life balance • Employee resource groups • Social events • Equal employment and advancement opportunities

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume