AI Risk Management Researcher - Offense/Defense Balances

April 24

Future of Life Institute (FLI)

WebsiteLinkedInAll Job Openings

Independent non-profit reducing extreme, large-scale risks from transformative technologies.

artificial intelligence • biotechnology • European Union • nuclear • climate change

11 - 50

💰 $482.5k Grant on 2021-11

Description

• Lead research on the offense/defense balances of advanced AI systems and their capabilities • Use methods from safety engineering, operational risk management, cybersecurity, and other disciplines to develop, critique, and make the case for new analytical methodologies with a focus on modeling societal impacts • Apply a security mindset to analyzing prospective AI proliferation and usage dynamics • Write papers explaining groundings for the risk estimation methods you will develop • Draft guidance for AI developers and auditors, appropriate as contributions to AI standards working groups

Requirements

• A M.Sc. or higher, or a B.Sc. plus 4 years of experience, in either Computer Science, Security Studies, Risk Management, AI Policy, Cybersecurity or a closely related field • A demonstrated focus on any one or more of: machine learning, AI, safety engineering, AI policy, complex systems, operations research, or operational risk management, or other relevant domains • Skilled in developing informal, semi-formal, and formal models • Relevant publications • Skilled in technical and expository writing

Benefits

• Fluidity in using the modern cognitive AI stack of LLMs, prompt engineering, and scaffolds • Experience with scalable graph models • Experience in probabilistic programming environments