Director – Senior Manager, AI Harness Engineering

Job not on LinkedIn

🔥 0 minutes ago

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

FICO

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1956

💼 Consulting

🛡️ Insurance

🏥 Healthcare

Consulting • Insurance • Healthcare

FICO is a leading analytics and software company renowned for its FICO® Score, a tool widely used by lenders to assess credit risk. The company offers a comprehensive platform that leverages data, AI, and machine learning to power intelligent decision-making and customer engagement across various industries. FICO's solutions span fraud detection, credit scoring, and customer lifecycle management, making it vital to sectors such as finance and telecommunications. Its innovative products help businesses optimize outcomes through real-time analytics, business composability, and scenario management.

📋 Description

• Design, build, and evolve the AI harness of guides, feedback loops, guardrails, and shared context • Contribute production code and build feedforward guides, reusable skills, architectural rules, reference documents, and codemods • Build feedback sensors including custom linters, architecture-fitness tests, verification loops, and LLM-as-judge reviewers • Own regional AI governance, agent authority boundaries, LLM testing infrastructure, and quality, safety, and compliance thresholds • Define and own cross-organizational QA and quality-gating standards • Run the steering loop to prevent recurring agent mistakes and continuously manage repository knowledge and drift • Decide where controls run across pre-commit, post-integration, and continuous monitoring stages • Establish observability into agent work and own engineering performance measures • Manage, coach, and grow a geographically distributed team of harness engineers • Partner with engineering leaders and product management to convert specifications and acceptance criteria into enforceable controls • Provide internal enablement, presentations, and thought leadership on agent-augmented engineering

🎯 Requirements

• Strong software engineering background with experience in large, complex codebases • Hands-on experience with AI coding agents such as Claude Code, Codex, or similar • Experience building engineering tooling across linters, static analysis, CI/CD pipelines, containerized build/test environments, and instrumentation/observability • Familiarity with agent instruction conventions such as AGENTS.md • Experience with spec-driven development, context engineering, agent orchestration, fitness functions, and developer-platform work • Ability to encode engineering quality into mechanical, repeatable rules • Judgement about deterministic computational controls versus inferential LLM-based controls and their cost, speed, and reliability trade-offs • Demonstrated experience owning AI governance and cross-organizational quality standards, including LLM testing infrastructure and quality gating for AI-generated artifacts • Working knowledge of autonomous-agent security, including prompt injection, tool/permission scoping, sandboxed execution, and audit trails • Strong experience managing geographically distributed, high-performing engineering teams • Excellent communication skills • Bachelor's/Master's in Computer Science or related discipline, or relevant experience in software architecture, design, development, and testing

🏖️ Benefits

• Highly competitive compensation, benefits and rewards programs • Work/life balance • Employee resource groups • Social events to promote interaction and camaraderie • Professional development through valuable learning experiences • Inclusive, people-first work environment • Equal employment and advancement opportunities