Himalayas logo
Future of Life InstituteFI

Societal Defense Researcher

The Future of Life Institute (FLI) is a nonprofit organization dedicated to steering transformative technologies towards benefiting humanity and reducing large-scale risks.

Future of Life Institute

Employee count: 11-50

Salary: 85k-135k USD

United States only

Stay safe on Himalayas

Never send money to companies. Jobs on Himalayas will never require payment from applicants.

Job Summary

CARMA's Public Security Policy (PSP) Program is seeking a Policy Researcher to advance our work on AI governance, risk mitigation, and emergency response frameworks. This role will focus on disaster preparedness planning for AI-related crises across multiple jurisdictional levels (national, state/provincial, multinational, and alliance-based), vulnerability assessments of critical societal systems, and development of robust governance approaches. The researcher will help identify systemic weaknesses that could be exploited or exacerbated by advanced AI systems and contribute to designing resilience strategies. This requires a broad literacy in the sciences and (both physical and information) technologies. This position offers direct engagement with critical AI safety challenges and opportunities to shape policy responses to emerging risks from increasingly capable AI systems. This is a full-time position, with the expectation of it being long-term, but be aware that runway beyond nine months will require winning more grants. This role is 100% remote but requires occasional travel.

About CARMA

The Center for AI Risk Management & Alignment (CARMA) works to help society navigate the complex and potentially catastrophic risks arising from increasingly powerful AI systems. Our mission is specifically to lower the risks to humanity and the biosphere from transformative AI.
We focus on grounding AI risk management in rigorous analysis, developing policy frameworks that squarely address AGI, advancing technical safety approaches, and fostering global perspectives on durable safety. Through these complementary approaches, CARMA aims to provide critical support to society for managing the outsized risks from advanced AI before they materialize.
CARMA is a fiscally-sponsored project of Social & Environmental Entrepreneurs, Inc., a 501(c)(3) nonprofit public benefit corporation.

Core Responsibilities

  • Conduct rigorous policy research mapping the landscape of current and proposed AI governance approaches, identifying gaps and fragilities in existing frameworks
  • Assess societal vulnerabilities to advanced AI systems across critical infrastructure, physical safety, information ecosystems, and social institutions
  • Develop comprehensive AI disaster scenario plans adaptable to different jurisdictional contexts and governance structures
  • Research how to translate complex technical concepts and risk scenarios into clear, actionable policy recommendations for decision-makers
  • Draft compelling policy briefs, reports, and blog posts communicating AI governance challenges to diverse audiences
  • Develop realistic simulation materials and tabletop exercises that stress-test emergency response protocols for AI system failures
  • Identify early warning indicators and potential cascade failures in AI governance structures
  • Map institutional dependencies and coordination challenges in cross-jurisdictional disaster response
  • Analyze existing civil defense and disaster response frameworks for adaptability, or the lack thereof, to novel AI threats
  • Support PSP advocacy initiatives and strategic relationship development with policymakers

Requirements

  • Master's degree in Public Policy, Public Administration, Political Science, International Relations, Science and Technology Studies, or related field; OR bachelor's degree with substantial relevant professional experience
  • Demonstrated ability to conduct thorough policy analysis and produce high-quality written outputs for both academic and policy audiences
  • Exceptional writing abilities with experience translating complex technical concepts into accessible language for non-specialist audiences
  • Strong grasp of policy processes, political systems, and strategic approaches to effectuating policy change
  • Breadth of knowledge, curiosity, and literacy across the sciences and physical technologies
  • Working knowledge of international relations frameworks and governance structures relevant to emerging technology management
  • Demonstrated understanding of AI safety concerns, systemic risks, and the sociotechnical implications of increasingly capable AI systems
  • Self-directed with ability to manage complex projects in a remote team environment while maintaining high attention to detail

Preferred Qualifications

  • Experience in crisis response planning, disaster preparedness, or emergency management
  • Background in cybersecurity, biosecurity, critical infrastructure protection, or other relevant risk domains
  • Understanding of organizational response limits during acute crises
  • Familiarity with both technical and governance aspects of AI alignment challenges
  • Experience conducting vulnerability assessments of complex sociotechnical systems
  • Knowledge of civil defense planning, continuity of government operations, or supply chain resilience
  • Background in multi-stakeholder coordination across government agencies, private sector, and civil society
  • Some coursework, experience, or interest in the hard sciences
  • Experience with scenario planning methodologies and strategic foresight techniques
CARMA/SEE is proud to be an Equal Opportunity Employer. We will not discriminate on the basis of race, ethnicity, sex, age, religion, gender reassignment, partnership status, maternity, or sexual orientation. We are, by policy and action, an inclusive organization and actively promote equal opportunities for all humans with the right mix of talent, knowledge, skills, attitude, and potential, so hiring is only based on individual merit for the job. Our organization operates through a fiscal sponsor whose infrastructure only supports persons authorized to work in the U.S. as employees. Candidates outside the U.S. would be engaged as independent contractors with project-focused responsibilities. Note that we are unable to sponsor visas at this time.

About the job

Apply before

Posted on

Job type

Contractor

Experience level

Mid-level

Salary

Salary: 85k-135k USD

Location requirements

Hiring timezones

United States +/- 0 hours

About Future of Life Institute

Learn more about Future of Life Institute and their company culture.

View company profile

The Future of Life Institute's mission is to steer transformative technologies away from extreme, large-scale risks and towards benefiting life. Our work focuses on ensuring that these technologies serve humanity and mitigate potential adverse effects.

We are best known for developing the Asilomar AI governance principles, which guide the safe and beneficial development of AI technologies. We also curate a library of content to educate the public on issues related to transformative technology and the associated risks. Through collaboration with experts from various fields, we aim to create a roadmap for the safe advancement of technologies that could fundamentally change human life.

Claim this profileFuture of Life Institute logoFI

Future of Life Institute

View company profile

Similar remote jobs

Here are other jobs you might want to apply for.

View all remote jobs

5 remote jobs at Future of Life Institute

Explore the variety of open remote roles at Future of Life Institute, offering flexible work options across multiple disciplines and skill levels.

View all jobs at Future of Life Institute

Remote companies like Future of Life Institute

Find your next opportunity by exploring profiles of companies that are similar to Future of Life Institute. Compare culture, benefits, and job openings on Himalayas.

View all companies

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan
Future of Life Institute hiring Societal Defense Researcher • Remote (Work from Home) | Himalayas