AI Engineer – Governance Intelligence, Third Party

🕒 June 9

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Credo AI

WebsiteLinkedInAll Job Openings

11 - 50 employees

Founded 2020

💼 Consulting

🏥 Healthcare

📣 Marketing

💰 $12.8M Series A on 2022-05

Consulting • Healthcare • Marketing

Credo AI is a company specializing in AI governance solutions. Their platform helps enterprises adopt, scale, and govern artificial intelligence safely and effectively by aligning people, processes, and technology. Credo AI offers an advisory service, an AI Governance Academy for learning, and a comprehensive governance platform with tools such as an AI registry, risk center, and regulation automation. The company provides solutions tailored for various use cases, including generative AI guardrails and vendor risk assessments. With a focus on responsible AI, Credo AI aims to make AI a trusted competitive advantage for businesses by ensuring compliance with emerging regulations and standards such as Colorado SB21-169, EU AI Act Readiness, and ISO/EIC 42001.

📋 Description

• Build automated vendor intelligence pipelines that continuously collect and parse AI system cards, model benchmarks (MMLU, HumanEval, etc.), security disclosures, and public vendor documentation • Design synthesis systems that map disparate vendor information to our risk taxonomy—translating technical capabilities into governance-relevant risk signals • Implement quality evaluation for generated risk profiles, ensuring accuracy and detecting when vendor information conflicts or becomes stale • Create adaptive interpretation systems that adjust risk assessments based on organizational context and risk appetite • Research and prototype novel approaches to multi-source information synthesis and cross-vendor comparison

🎯 Requirements

• Strong track record building LLM-powered applications in production, from prototype to scale • Deep expertise in document understanding, information extraction, and structured content generation • Experience building data pipelines that handle diverse, evolving source formats—comfortable working with messy real-world data • Proficient with modern AI development stacks (LangChain, LlamaIndex) and RAG architectures • Strong understanding of prompt engineering, fine-tuning, and when to use each approach • Experience with knowledge representation - you've built systems that model complex domains • Demonstrated ability to ship fast - you can build an MVP in days and iterate based on user feedback • Fluent in AI-assisted development tools and practices - you know how to leverage AI to move faster • Deep familiarity with AI evaluation ecosystem: model benchmarks (SuperGLUE, BIG-Bench, HELM), safety evaluations (METR, Apollo), AI system card formats • Experience with vendor/third-party risk assessment in any domain (InfoSec, compliance, procurement) • Built multi-source aggregation systems that reconcile conflicting information and synthesize across documents • Built systems that handle document understanding at scale (10K+ documents) • Knowledge of ontologies, knowledge graphs, or semantic modeling • Track record of automating complex manual processes using AI

🏖️ Benefits

• Competitive Salary and Equity • Health: We offer health, dental, and vision coverage. We also offer an ergonomic benefit to cover the costs of equipment to help staff stay healthy while working, both in the office and at home. • Coworking: We will cover the cost of co-working spaces like WeWork and in-person meetups. • Unlimited PTO: Credo AI has unlimited time off to support our employees • Generous Parental Leave: We offer up to 12 weeks of paid parental leave. • 401(k) plan for employees (US only)