Associate Director, AI Product Engineer – Financial Institution Operations & Technology

🕒 4 dias atrás

🇺🇸 Estados Unidos – Remoto (EUA)

💵 $180.000 - $250.000 / ano

⏰ Tempo Integral

🟠 Sênior

🧑‍💻 Engenheiro Full-stack

👻 Score fantasma 1%

O que significa: a chance de ninguém estar realmente contratando para esta vaga.Como ler: 60% ou mais significa que achamos que é uma vaga fantasma. Pontuações mais baixas preocupam menos.Como pontuamos: tempo em aberto, republicações, vagas abertas vs tamanho do time, rapidez para fechar vagas, e se o salário está divulgado.Observação: é uma estimativa de dados públicos, não um julgamento da empresa. Vagas reais podem ter pontuação alta, então use como uma dica, não como um fato.

Candidatar-se

Encontrar Vagas Remotas Similares

Berkeley Research Group (BRG)

SiteLinkedInTodas as Vagas

1001 - 5000 funcionários

🏗️ Construção

📦 Logística

🎖️ Defesa

💰 Venture Round em 2020-07

Construction • Logistics • Defense

A BRG combina credenciais acadêmicas de renome mundial com expertise empresarial testada em campo, criada para agilidade e conectividade, o que nos diferencia e coloca nossos clientes à frente. Nossos especialistas de primeira linha incluem líderes experientes da indústria, acadêmicos renomados e cientistas de dados pioneiros. Juntos, eles trazem uma diversidade de experiências comprovadas do mundo real para economia, disputas e investigações; finanças corporativas; e serviços de melhoria de desempenho que abordam os desafios mais complexos para organizações ao redor do mundo. Nossa estrutura única nutre os relacionamentos interdisciplinares que nos dão a vantagem, estabelecendo as bases para insights mais informados e pensamentos mais originais e incisivos de perspectivas diversas que, quando combinados com nosso alcance e recursos globais, nos tornam exclusivamente capazes de enfrentar os desafios de nossos clientes.

Descrição

• Define what each product must get right, how errors could affect customers or operations, and what evidence is needed before use • Build reusable software that runs tests, scores results, and compares versions • Work with engineers to reproduce failures, identify causes, and verify fixes • Contribute product code to improve accuracy and control • Set pass criteria and scoring rules with business and risk teams • Maintain representative test cases, including incomplete records and rare, high-impact errors • Measure factual accuracy, missing information, incorrect additions, and support from cited sources • Check automated scoring against expert review • Compare product versions on the same tests and report results by task and error severity • Verify extracted facts against original records, including amounts, dates, totals, and citation support • Test when the product should answer, request clarification, or refer work to a person • Test for invented facts, unsupported recommendations, unfair outcomes, sensitive-information disclosure, and safeguard circumvention • Protect client data, restrict access and permitted actions, and use only approved services • Document repeatable test results, unresolved failures, and limitations • Recommend release, restricted use, or further development and support independent review and client approvals • Sample live outputs, track error rates and user corrections, and trigger investigation or suspension when quality falls below agreed standards • Explain findings, coach colleagues, develop reusable tests and controls, and support proposals, technical estimates, and recruiting

🎯 Requisitos

• Minimum 5 years of working experience, including a minimum of 1 year of experience in AI evaluation • Demonstrated ownership of AI evaluations that informed real release decisions, including test design, expert-reviewed answers, scoring, and failure investigation • Strong Python skills and experience building automated test software, connecting data sources, and recording repeatable results across product versions • Ability to select representative samples, interpret error rates and uncertainty, and distinguish genuine improvement from weak tests or inconsistent scoring • Experience building or improving AI products used in operations, with practical controls for sensitive data, output accuracy, and human review • Experience in financial services or another regulated environment, with ability to translate business requirements into practical tests and controls • Strong communication and teamwork skills, ability to mentor colleagues, and willingness to travel to client sites as needed • Preferred: banking experience in lending, payments, servicing, collections, or default operations • Preferred: experience independently evaluating AI products, checking automated scoring against expert judgment, or testing security and fairness in financial institutions • Preferred: experience evaluating document review, summaries, information search, or automated workflows, including comparisons across AI services and conventional software • Preferred: consulting or product delivery experience, including client discovery, implementation planning, and user adoption • Candidates must be able to verify their legal right to work in the United States without employer sponsorship now or in the future

🏖️ Benefícios

• Equal opportunity employment • Reasonable accommodation for essential job functions • Travel opportunities to client sites as needed

📊 Verifique sua pontuação de currículo para esta vaga

Melhore suas chances de conseguir uma entrevista verificando sua pontuação de currículo antes de se candidatar.

Enviar Currículo