AI Watch

Welcome! This is a website to track people and organizations working on AI safety. See the code repository for the source code and data of this website.

This website is developed by Issa Rice and has been partially funded by Vipul Naik.

If you like (or want to like) this website and have money: the current funder doesn't want to continue funding this project. As a result, it is currently mostly sitting around. If you want to bring this site to the next level, contact Issa at riceissa@gmail.com. What you get: site improvements, recognition in the site credits. What the site needs: money.

If you have time and want experience building websites: this website is looking for contributors. If you want to help out, contact Issa at riceissa@gmail.com. What you get: little or no pay (this could change if the site gets funding; see previous paragraph), recognition in the site credits, privilege of working with me, knowledge of the basics of web development (MySQL, PHP, Git). What the site needs: data collection/entry and website code improvements.

Last updated on 2019-05-22.

Table of contents

Agendas

Agenda name Associated people Associated organizations
Iterated amplification Paul Christiano, Buck Shlegeris, Dario Amodei OpenAI
Embedded agency Eliezer Yudkowsky, Scott Garrabrant, Abram Demski Machine Intelligence Research Institute
Comprehensive AI services Eric Drexler Future of Humanity Institute
Ambitious value learning Stuart Armstrong Future of Humanity Institute
Factored cognition Andreas Stuhlmüller Ought
Recursive reward modeling Jan Leike, David Krueger, Tom Everitt, Miljan Martic, Vishal Maini, Shane Legg Google DeepMind
Debate Paul Christiano OpenAI
Interpretability Christopher Olah
Inverse reinforcement learning
Preference learning
Cooperative inverse reinforcement learning
Imitation learning
Alignment for advanced machine learning systems Jessica Taylor, Eliezer Yudkowsky, Patrick LaVictoire, Andrew Critch Machine Intelligence Research Institute
Learning-theoretic AI alignment Vanessa Kosoy
Counterfactual reasoning Jacob Steinhardt

AI safety relation by subject

Note: as shown by the large number of “unknown” values, most of the positions haven’t been categorized by relation/subject so this table will only be useful in the future.

Subject UnknownAGI organizationGCR organizationposition Total
Unknown 1698 111 18 227 2054
background 0 0 0 20 20
general 0 0 2 8 10
grant investigation 0 0 0 3 3
policy 0 0 0 1 1
popularization 0 0 0 2 2
scientific advising 0 0 0 4 4
software engineering 0 2 0 10 12
strategy 0 0 0 1 1
technical research 0 0 0 34 34
Total 1698 113 20 310 2141

Positions summary by year

Note: as shown by the large number of “unknown” values, most of the positions haven’t been categorized by start/end dates so this table will only be useful in the future.

Year Start date End date
Unknown 1016 1441
2000 6 0
2002 1 1
2004 4 0
2005 10 2
2006 12 13
2007 17 6
2008 4 5
2009 19 7
2010 29 23
2011 28 36
2012 36 18
2013 52 44
2014 79 33
2015 149 110
2016 295 153
2017 219 120
2018 165 129

Positions grouped by person

Showing 638 people with positions.

Name Number of organizations List of organizations
Paul Christiano 8 AI Impacts, Future of Humanity Institute, Machine Intelligence Research Institute, Open Philanthropy Project, OpenAI, Ought, Theiss Research, University of California, Berkeley
Stuart Russell 7 Berkeley Existential Risk Initiative, Center for Human-Compatible AI, Centre for the Study of Existential Risk, Future of Life Institute, Leverhulme Centre for the Future of Intelligence, Machine Intelligence Research Institute, University of California, Berkeley
Nick Bostrom 6 Centre for the Study of Existential Risk, Future of Humanity Institute, Future of Life Institute, Google DeepMind, Leverhulme Centre for the Future of Intelligence, Machine Intelligence Research Institute
Heather Roff 5 Arizona State University, Leverhulme Centre for the Future of Intelligence, New America Foundation, University of Denver, University of Oxford
Andrew Critch 4 Berkeley Existential Risk Initiative, Center for Human-Compatible AI, Machine Intelligence Research Institute, University of California, Berkeley
Bas R. Steunebrink 4 IDSIA, NNAISENSE, SUPSI, Università della Svizzera italiana
Daniel Dewey 4 Future of Humanity Institute, Future of Life Institute, Machine Intelligence Research Institute, Open Philanthropy Project
Jaan Tallinn 4 Berkeley Existential Risk Initiative, Centre for the Study of Existential Risk, Future of Life Institute, Machine Intelligence Research Institute
Jan Leike 4 Australian National University, Future of Humanity Institute, Google DeepMind, Machine Intelligence Research Institute
Matthijs Maas 4 Global Catastrophic Risk Institute, Global Politics of Artificial Intelligence Research Group at Yale University and University of Oxford, Hague Centre for Strategic Studies, University of Copenhagen
Qiaochu Yuan 4 Berkeley Existential Risk Initiative, Center for Applied Rationality, Machine Intelligence Research Institute, University of California, Berkeley
Ryan Carey 4 Centre for the Study of Existential Risk, Future of Humanity Institute, Machine Intelligence Research Institute, Ought
Seán Ó hÉigeartaigh 4 Berkeley Existential Risk Initiative, Centre for the Study of Existential Risk, Future of Humanity Institute, Leverhulme Centre for the Future of Intelligence
Seth Baum 4 Centre for the Study of Existential Risk, Global Catastrophic Risk Institute, Machine Intelligence Research Institute, Social & Environmental Entrepreneurs
Adrian Weller 3 Centre for the Study of Existential Risk, Leverhulme Centre for the Future of Intelligence, University of Cambridge
Andrew Snyder-Beattie 3 Berkeley Existential Risk Initiative, Future of Humanity Institute, Leverhulme Centre for the Future of Intelligence
Bart Selman 3 Center for Human-Compatible AI, Cornell University, Machine Intelligence Research Institute
Christopher Olah 3 Google Brain, Open Philanthropy Project, OpenAI
Dario Amodei 3 Google Brain, Open Philanthropy Project, OpenAI
Eric Rogstad 3 Berkeley Existential Risk Initiative, Center for Applied Rationality, LessWrong 2.0
Francesca Rossi 3 Future of Life Institute, Leverhulme Centre for the Future of Intelligence, University of Padova
Huw Price 3 Centre for the Study of Existential Risk, Leverhulme Centre for the Future of Intelligence, University of Cambridge
Janos Kramar 3 Future of Life Institute, Machine Intelligence Research Institute, University of Montreal
Jeremy Schlatter 3 Berkeley Existential Risk Initiative, Machine Intelligence Research Institute, OpenAI
Jürgen Schmidhuber 3 IDSIA, SUPSI, Università della Svizzera italiana
Kaj Sotala 3 Foundational Research Institute, Machine Intelligence Research Institute, Theiss Research
Katja Grace 3 AI Impacts, Future of Humanity Institute, Machine Intelligence Research Institute
Laurent Orseau 3 AgroParisTech, Google DeepMind, INRA
Mark Ring 3 IDSIA, SUPSI, Università della Svizzera italiana
Martin Rees 3 Centre for the Study of Existential Risk, Future of Life Institute, Leverhulme Centre for the Future of Intelligence
Matthew Graves 3 Center for Applied Rationality, LessWrong 2.0, Machine Intelligence Research Institute
Max Tegmark 3 Centre for the Study of Existential Risk, Future of Life Institute, Machine Intelligence Research Institute
Oliver Habryka 3 Center for Applied Rationality, LessWrong 2.0, Machine Intelligence Research Institute
Owain Evans 3 Future of Humanity Institute, Ought, University of Oxford
Patrick LaVictoire 3 Machine Intelligence Research Institute, Quixey, University of Wisconsin–Madison
Pieter Abbeel 3 Center for Human-Compatible AI, OpenAI, University of California, Berkeley
Ramana Kumar 3 Data61, Machine Intelligence Research Institute, University of Cambridge
Robin Hanson 3 Future of Humanity Institute, George Mason University, Machine Intelligence Research Institute
Roman Yampolskiy 3 Global Catastrophic Risk Institute, Machine Intelligence Research Institute, University of Louisville
Ales Flidr 2 Centre for Effective Altruism, Future of Life Institute
Alexey Potapov 2 AIDEUS, ITMO University
Alison Gopnik 2 Centre for the Study of Existential Risk, Leverhulme Centre for the Future of Intelligence
Allan Dafoe 2 Future of Humanity Institute, Yale University
Anca Dragan 2 Center for Human-Compatible AI, University of California, Berkeley
Andreas Stuhlmüller 2 Ought, Stanford University
Anna Salamon 2 Center for Applied Rationality, Machine Intelligence Research Institute
Ben Goertzel 2 CogPrime, Machine Intelligence Research Institute
Ben Goldhaber 2 Center for Applied Rationality, Ought
Ben Weinstein-Raun 2 Machine Intelligence Research Institute, Ought
Benjamin Mann 2 Machine Intelligence Research Institute, OpenAI
Benya Fallenstein 2 Machine Intelligence Research Institute, University of Bristol
Beth Barnes 2 Center for Human-Compatible AI, Centre for the Study of Existential Risk
Carl Shulman 2 Future of Humanity Institute, Machine Intelligence Research Institute
Chris Maddison 2 Google DeepMind, University of Oxford
Christine Peterson 2 Foresight Institute, Machine Intelligence Research Institute
Christopher Cundy 2 Center for Human-Compatible AI, Future of Humanity Institute
Connor Flexman 2 AI Impacts, Machine Intelligence Research Institute
David Abel 2 Brown University, Future of Humanity Institute
Demis Hassabis 2 Google DeepMind, Leverhulme Centre for the Future of Intelligence
Elon Musk 2 Centre for the Study of Existential Risk, Future of Life Institute
Girish Sastry 2 Future of Humanity Institute, Ought
Gwern Branwen 2 Center for Applied Rationality, Machine Intelligence Research Institute
Holden Karnofsky 2 Open Philanthropy Project, OpenAI
Jacob Steinhardt 2 Open Philanthropy Project, Stanford University
Jelena Luketina 2 Aalto University, Université de Montréal
Jesse Galef 2 Future of Life Institute, Machine Intelligence Research Institute
Jimmy Rintjema 2 AI Impacts, Machine Intelligence Research Institute
Johannes Heidecke 2 AI Safety Camp, Road to AI Safety Excellence
John Salvatier 2 AI Impacts, Future of Humanity Institute
Jon Gauthier 2 Massachusetts Institute of Technology, OpenAI
Joseph Halpern 2 Center for Human-Compatible AI, Cornell University
Joshua Gans 2 National Bureau of Economic Research, University of Toronto
Justin Shovelain 2 Convergence Analysis, Machine Intelligence Research Institute
Kristinn R. Thórisson 2 Center for Analysis & Design of Intelligent Agents, Icelandic Institute for Intelligent Machines
Kyle Scott 2 Berkeley Existential Risk Initiative, Future of Humanity Institute
Malo Bourgon 2 Berkeley Existential Risk Initiative, Machine Intelligence Research Institute
Marcello Herreshoff 2 Google, Machine Intelligence Research Institute
Margaret Boden 2 Centre for the Study of Existential Risk, Leverhulme Centre for the Future of Intelligence
Martina Kunz 2 Centre for the Study of Existential Risk, Leverhulme Centre for the Future of Intelligence
Matthew Fallshaw 2 Berkeley Existential Risk Initiative, Machine Intelligence Research Institute
Max Daniel 2 Effective Altruism Foundation, Foundational Research Institute
Melody Guan 2 Future of Life Institute, Google Brain
Michael Keenan 2 Berkeley Existential Risk Initiative, Center for Applied Rationality
Michael Wellman 2 Center for Human-Compatible AI, University of Michigan
Mihaly Barasz 2 Machine Intelligence Research Institute, Nilcons
Miles Brundage 2 Arizona State University, Future of Humanity Institute
Murray Shanahan 2 Centre for the Study of Existential Risk, Leverhulme Centre for the Future of Intelligence
Neal Jean 2 Future of Humanity Institute, Ought
Ozzie Gooen 2 Convergence Analysis, Ought
Randall C. O’Reilly 2 eCortex, University of Colorado Boulder
Remmelt Ellen 2 AI Safety Camp, Road to AI Safety Excellence
Reuben Stern 2 Ludwig Maximilian University of Munich, University of Wisconsin–Madison
Sergey Rodionov 2 AIDEUS, Aix-Marseille University
Smitha Milli 2 OpenAI, University of California, Berkeley
Stephanie Zolayvar 2 AI Impacts, Center for Applied Rationality
Stephen Hawking 2 Centre for the Study of Existential Risk, Future of Life Institute
Steve Omohundro 2 Machine Intelligence Research Institute, Self-Aware Systems
Stuart Armstrong 2 Future of Humanity Institute, Machine Intelligence Research Institute
Tobias Baumann 2 Foundational Research Institute, University College London
Tom Brown 2 Google Brain, OpenAI
Tom Everitt 2 Australian National University, Google DeepMind
Tom McGrath 2 Future of Humanity Institute, Ought
Tsvi Benson-Tilsen 2 Center for Applied Rationality, Machine Intelligence Research Institute
Victoria Krakovna 2 Future of Life Institute, Google DeepMind
Will Sawin 2 Institute for Theoretical Studies at ETH Zurich, Princeton University
Yang Liu 2 Centre for the Study of Existential Risk, University of Cambridge
Zac Kenton 2 Montreal Institute for Learning Algorithms, Ought
Aaron Silverbook 1 Machine Intelligence Research Institute
Abraham Wolk 1 Machine Intelligence Research Institute
Abram Demski 1 Machine Intelligence Research Institute
Adam Scholl 1 Center for Applied Rationality
Aditi Raghunathan 1 Stanford University
Adom Hartell 1 Center for Applied Rationality
Adrien Matricon 1 FLOWERS
Alan Alda 1 Future of Life Institute
Alan Guth 1 Future of Life Institute
Alan Hájek 1 Australian National University
Alan Winfield 1 Leverhulme Centre for the Future of Intelligence
Alan Yan 1 Future of Life Institute
Alec Radford 1 OpenAI
Aleks Kamko 1 OpenAI
Aleksandra Orchowska 1 EthicsNet
Alex Aiken 1 Stanford University
Alex Altair 1 Machine Intelligence Research Institute
Alex Appel 1 Machine Intelligence Research Institute
Alex Mennen 1 Machine Intelligence Research Institute
Alex Nichol 1 OpenAI
Alex Ray 1 OpenAI
Alex Vermeer 1 Machine Intelligence Research Institute
Alex Zhu 1 Machine Intelligence Research Institute
Alexandra Delmas 1 FLOWERS
Alexandre Gepperth 1 FLOWERS
Allison Duettmann 1 Foresight Institute
Allison Taguchi 1 Machine Intelligence Research Institute
Alvaro Ovalle Castaneda 1 FLOWERS
Alyssa Vance 1 Machine Intelligence Research Institute
Amy Willey 1 Machine Intelligence Research Institute
Anders Sandberg 1 Future of Humanity Institute
Andre Platzer 1 Carnegie Mellon University
Andrej Karpathy 1 OpenAI
Andrew Hay 1 Machine Intelligence Research Institute
Andrew Lapinski-Barker 1 Machine Intelligence Research Institute
Andrew Lefrancq 1 Google DeepMind
Andrew MacFie 1 Carleton University
Andrew Rettek 1 Machine Intelligence Research Institute
Andrew Schreiber 1 Ought
Andrew Ware 1 University of New Hampshire
Andrew X Stewart 1 Convergence Analysis
Andriy Brodskyy 1 Machine Intelligence Research Institute
Angelo Frank De Bellis 1 University of Edinburgh
Anish Athalye 1 OpenAI
Anish Mohammed 1 EthicsNet
Anja Heinisch 1 Machine Intelligence Research Institute
Ankur Handa 1 OpenAI
Anna Alexandrova 1 Leverhulme Centre for the Future of Intelligence
Anna-Lisa Vollmer 1 FLOWERS
Anne Wissemann 1 AI Safety Camp
Anthony Aguirre 1 Future of Life Institute
Antonius Lourenço Kasbergen 1 Machine Intelligence Research Institute
Ariel Conn 1 Future of Life Institute
Arif Ahmed 1 University of Cambridge
Aruna Vassar 1 Machine Intelligence Research Institute
Aubrey de Grey 1 Machine Intelligence Research Institute
Aviv Tamar 1 OpenAI
Baobao Zhang 1 Future of Humanity Institute
Baptiste Busch 1 FLOWERS
Barney Pell 1 Machine Intelligence Research Institute
Ben Albert Pace 1 LessWrong 2.0
Ben Garfinkel 1 Future of Humanity Institute
Ben Hoffman 1 AI Impacts
Ben Hoskin 1 Machine Intelligence Research Institute
Ben Rachbach 1 Ought
Ben Sancetta 1 Center for Applied Rationality
Ben West 1 Ought
Benjamin Clément 1 FLOWERS
Benjamin Rubinstein 1 University of Melbourne
Beth Singler 1 Leverhulme Centre for the Future of Intelligence
Bill Hibbard 1 Machine Intelligence Research Institute
Blake Borgeson 1 Machine Intelligence Research Institute
Bob McGrew 1 OpenAI
Bobby Filar 1 Endgame
Bradly Stadie 1 OpenAI
Brewster Kahle 1 Internet Archive
Brian Atkins 1 Machine Intelligence Research Institute
Brian Tomasik 1 Foundational Research Institute
Brian Ziebart 1 University of Illinois at Chicago
Brooke Chan 1 OpenAI
Bruce Klein 1 Machine Intelligence Research Institute
Bryan Bishop 1 Machine Intelligence Research Institute
Buck Shlegeris 1 Machine Intelligence Research Institute
C. Colby Thomson 1 Machine Intelligence Research Institute
Cameron Taylor 1 Machine Intelligence Research Institute
Carolyn L. Burke 1 Machine Intelligence Research Institute
Carrick Flynn 1 Future of Humanity Institute
Carson Jones 1 Machine Intelligence Research Institute
Caspar Oesterheld 1 Foundational Research Institute
Catherine Olsson 1 OpenAI
Catrin Campbell-Moore 1 Munich Center for Mathematical Philosophy
Cecilia Tilli 1 Future of Humanity Institute
Céline Craye 1 FLOWERS
Cem Karaoguz 1 FLOWERS
Chase Moores 1 Future of Life Institute
Chelsea Guo 1 Future of Humanity Institute
Chris Cundy 1 Ought
Christian Rovner 1 Machine Intelligence Research Institute
Christiana Figueres 1 Google DeepMind
Christof Koch 1 Future of Life Institute
Christopher Berner 1 OpenAI
Christopher Hesse 1 OpenAI
Christy Dennison 1 OpenAI
Claire Abu-Assal 1 Convergence Analysis
Clare Lyle 1 Future of Humanity Institute
Colleen Gleason 1 Berkeley Existential Risk Initiative
Colm Ó Riain 1 Machine Intelligence Research Institute
Damien Caselli 1 FLOWERS
Dan Keys 1 Center for Applied Rationality
Dan Mané 1 Google Brain
Dana Scott 1 Centre for the Study of Existential Risk
Daniel Demski 1 Machine Intelligence Research Institute
Daniel Eth 1 Yale University
Daniel Filan 1 Future of Humanity Institute
Daniel Lewis 1 Machine Intelligence Research Institute
Daniel R. Miller 1 Future of Life Institute
Daniel Roth 1 Machine Intelligence Research Institute
Daniel Weld 1 University of Washington
David Chalmers 1 Centre for the Study of Existential Risk
David Danks 1 Carnegie Mellon University
David Farhi 1 OpenAI
David Filliat 1 FLOWERS
David Hart 1 Machine Intelligence Research Institute
David J. Jilk 1 eCortex
David Kristoffersson 1 Future of Humanity Institute
David Krueger 1 Future of Humanity Institute
David Luan 1 OpenAI
Dávid Natingga 1 Machine Intelligence Research Institute
David Parkes 1 Harvard University
David Runciman 1 Leverhulme Centre for the Future of Intelligence
David Simmons 1 Machine Intelligence Research Institute
David Stanley 1 Future of Life Institute
David Yu 1 Center for Human Success
Dennis Fan 1 Machine Intelligence Research Institute
Diane Coyle 1 Google DeepMind
Diane Yoon 1 OpenAI
Didier Roy 1 FLOWERS
Diego Caleiro 1 Machine Intelligence Research Institute
Dmitrii Krasheninnikov 1 Center for Human-Compatible AI
Doina Precup 1 Montreal Institute for Learning Algorithms
Duncan Sabien 1 Center for Applied Rationality
Durk Kingma 1 OpenAI
Dylan Hadfield-Menell 1 University of California, Berkeley
Edward Parson 1 UCLA School of Law
Edward W. Felten 1 Google DeepMind
Edwin Evans 1 Machine Intelligence Research Institute
Eli Tyre 1 Center for Applied Rationality
Eliezer Yudkowsky 1 Machine Intelligence Research Institute
Elizabeth Garrett 1 Center for Applied Rationality
Elizabeth Morningstar 1 Machine Intelligence Research Institute
Elliot Catt 1 Australian National University
Elman Mansimov 1 OpenAI
Emil Gilliam 1 Machine Intelligence Research Institute
Eric Drexler 1 Future of Humanity Institute
Eric Gastfriend 1 Future of Life Institute
Eric Price 1 OpenAI
Eric Sigler 1 OpenAI
Erica Edelman 1 Machine Intelligence Research Institute
Erik Brynjolfsson 1 Future of Life Institute
Erik Istre 1 Road to AI Safety Excellence
Erika Reinhardt 1 OpenAI
Evan Erickson 1 Machine Intelligence Research Institute
Evan Hubinger 1 Machine Intelligence Research Institute
Felix Berkenkamp 1 ETH Zurich
Filip Wolski 1 OpenAI
Finan Adamson 1 AI Impacts
Florian Golemo 1 FLOWERS
Frank Adamek 1 Machine Intelligence Research Institute
Frank Wilczek 1 Future of Life Institute
Frederick Eberhardt 1 California Institute of Technology
Freek Stulp 1 FLOWERS
Fuxin Li 1 Georgia Institute of Technology
Gary Drescher 1 Machine Intelligence Research Institute
Gary Lea 1 Australian National University
Gennaro Raiola 1 FLOWERS
Geoffrey Irving 1 OpenAI
George Church 1 Future of Life Institute
Gillian Hadfield 1 Center for Human-Compatible AI
Gina Stuessy 1 Berkeley Existential Risk Initiative
Grant Wilson 1 Global Catastrophic Risk Institute
Greg Brockman 1 OpenAI
Gregory C. Allen 1 Center for a New American Security
Grzegorz Orwiński 1 Future of Life Institute
Guillaume Duceux 1 FLOWERS
H. Orri Stefánsson 1 Institute for Future Studies
Harmanas Chopra 1 LessWrong 2.0
Harri Edwards 1 OpenAI
Harrison Willey 1 Machine Intelligence Research Institute
Haydn Belfield 1 Centre for the Study of Existential Risk
Helen Toner 1 Open Philanthropy Project
Henrik Jonsson 1 Machine Intelligence Research Institute
Henrique Pondé 1 OpenAI
Henry Shevlin 1 Leverhulme Centre for the Future of Intelligence
Hideyuki Nakashima 1 Whole Brain Architecture Initiative
Hiroshi Yamakawa 1 Whole Brain Architecture Initiative
Hiroyuki Morikawa 1 Whole Brain Architecture Initiative
Hyrum Anderson 1 Endgame
Ian Goodfellow 1 OpenAI
Igor Mordatch 1 OpenAI
Ilya Sutskever 1 OpenAI
Ioven Fables 1 Machine Intelligence Research Institute
Jack Carroll 1 Center for Applied Rationality
Jack Clark 1 OpenAI
Jack Gallagher 1 Machine Intelligence Research Institute
Jacob Beebe 1 Future of Life Institute
Jacob Trefethen 1 Future of Life Institute
Jacob Tsimerman 1 Berkeley Existential Risk Initiative
Jade Leung 1 Future of Humanity Institute
Jake Miller 1 Machine Intelligence Research Institute
Jake Moskowitz 1 Machine Intelligence Research Institute
Jakob Foerster 1 OpenAI
Jakub Pachocki 1 OpenAI
James M. Joyce 1 University of Michigan
James Manyika 1 Google DeepMind
James Miller 1 Machine Intelligence Research Institute
Jan Feyereisl 1 GoodAI
Jan Kulveit 1 AI Safety Camp
Jarryd Martin 1 Australian National University
Jasen Murray 1 Machine Intelligence Research Institute
Jason Levin 1 Machine Intelligence Research Institute
Jean Harb 1 OpenAI
Jed McCaleb 1 Machine Intelligence Research Institute
Jeff Alexander 1 Machine Intelligence Research Institute
Jeff Medina 1 Machine Intelligence Research Institute
Jeffrey D. Sachs 1 Google DeepMind
Jeffrey Ding 1 Future of Humanity Institute
Jenann Ismael 1 University of Arizona
Jeremy Miller 1 Machine Intelligence Research Institute
Jesse Liptrap 1 Machine Intelligence Research Institute
Jessica Cooper 1 AI Safety Camp
Jessica Taylor 1 Machine Intelligence Research Institute
Jie Tang 1 OpenAI
Jiji Zhang 1 Lingnan University
Jim Babcock 1 Cornell University
Jirí Nadvorník 1 AI Safety Camp
Joanna Bryson 1 University of Bath
Joelle Pineau 1 Montreal Institute for Learning Algorithms
Johannes Treutlein 1 Centre for Effective Altruism
John Schulman 1 OpenAI
John Shawe-Taylor 1 University College London
Jonas Lamis 1 Machine Intelligence Research Institute
Jonas Schneider 1 OpenAI
Jonathan Gray 1 OpenAI
Jonathan Ho 1 OpenAI
Jonathan Raiman 1 OpenAI
Jonathan Wang 1 Machine Intelligence Research Institute
Jonathan Yan 1 Real AI
Jordan Tirrell 1 Center for Applied Rationality
José Hernández-Orallo 1 Leverhulme Centre for the Future of Intelligence
Josh Jacobson 1 Berkeley Existential Risk Initiative
Josh Tobin 1 OpenAI
Joshua Fox 1 Machine Intelligence Research Institute
Julia Galef 1 OpenAI
Julia Haas 1 Washington University in St. Louis
Justis Mills 1 AI Impacts
Kanta Dihal 1 Leverhulme Centre for the Future of Intelligence
Karina Vold 1 Leverhulme Centre for the Future of Intelligence
Kate Miltenberger 1 OpenAI
Katie Steele 1 London School of Economics
Kay Firth-Butterfield 1 Leverhulme Centre for the Future of Intelligence
Kaya Stechly 1 Machine Intelligence Research Institute
Kazue Evans 1 Future of Life Institute
Keefe Roedersheimer 1 Machine Intelligence Research Institute
Kemal Eren 1 Machine Intelligence Research Institute
Kenji Doya 1 Whole Brain Architecture Initiative
Kenny Easwaran 1 Texas A&M University
Kenzi Amodei 1 Berkeley Existential Risk Initiative
Kevin Fischer 1 Machine Intelligence Research Institute
Kevin Frans 1 OpenAI
Kitano Hiroaki 1 Whole Brain Architecture Initiative
Koichi Takahashi 1 Whole Brain Architecture Initiative
Koji Morikawa 1 Whole Brain Architecture Initiative
Kristian Rönn 1 Convergence Analysis
Kristina Nemcova 1 AI Safety Camp
Kurt Brown 1 Machine Intelligence Research Institute
Larissa Schiavo 1 OpenAI
Lauren Lee 1 Center for Applied Rationality
Lerrel Pinto 1 OpenAI
Lila Rieber 1 Machine Intelligence Research Institute
Lincoln Quirk 1 Machine Intelligence Research Institute
Linda Linsefors 1 Machine Intelligence Research Institute
Linxi Fan 1 OpenAI
Liron Shapira 1 Machine Intelligence Research Institute
Loïc Dauphin 1 FLOWERS
Long Ouyang 1 Theiss Research
Louie Helm 1 Machine Intelligence Research Institute
Louis-Charles Caron 1 FLOWERS
Lucas Perry 1 Future of Life Institute
Lucy Cheke 1 Leverhulme Centre for the Future of Intelligence
Ludwig Pettersson 1 OpenAI
Lukas Gloor 1 Foundational Research Institute
Luke Grecki 1 Machine Intelligence Research Institute
Luke Muehlhauser 1 Machine Intelligence Research Institute
Luke Raskopf 1 Center for Applied Rationality
Manuel Lopes 1 FLOWERS
Manuela M. Veloso 1 Leverhulme Centre for the Future of Intelligence
Manuela Veloso 1 Carnegie Mellon University
Maran Nelson 1 OpenAI
Marcin Andrychowicz 1 OpenAI
Marcus Hutter 1 Australian National University
Marek Havrda 1 GoodAI
Marek Rosa 1 GoodAI
Mariah Wang 1 Machine Intelligence Research Institute
Mark Fusco 1 Global Catastrophic Risk Institute
Mark Nitzberg 1 Center for Human-Compatible AI
Mark S. Miller 1 Foresight Institute
Marta Halina 1 Leverhulme Centre for the Future of Intelligence
Maruan Al-Shedivat 1 OpenAI
Masaru Tomita 1 Whole Brain Architecture Initiative
Matthias Plappert 1 OpenAI
Matthieu Lapeyre 1 FLOWERS
Max Kesin 1 Future of Life Institute
Meia Chita-Tegmark 1 Future of Life Institute
Michael A. Osborne 1 Leverhulme Centre for the Future of Intelligence
Michael Anissimov 1 Machine Intelligence Research Institute
Michael Blume 1 Machine Intelligence Research Institute
Michael Janner 1 University of California, Berkeley
Michael Page 1 OpenAI
Michael Petrov 1 OpenAI
Michael Raimondi 1 Machine Intelligence Research Institute
Michael Roy Ames 1 Machine Intelligence Research Institute
Michael Smith 1 Center for Applied Rationality
Michaël Trazzi 1 Sorbonne University
Michael Vassar 1 Machine Intelligence Research Institute
Michael Webb 1 Stanford University
Michael Wilson 1 Machine Intelligence Research Institute
Michael Wooldridge 1 University of Oxford
Michael Wulfsohn 1 AI Impacts
Mikael Böörs 1 Linköping University
Milan Griffes 1 Ought
Miljan Martic 1 Google DeepMind
Minda Myers 1 Machine Intelligence Research Institute
Morgan Freeman 1 Future of Life Institute
Moshe Looks 1 Machine Intelligence Research Institute
Moshe Vardi 1 Rice University
Mustafa Suleyman 1 Google DeepMind
Na Li 1 Future of Life Institute
Nate Soares 1 Machine Intelligence Research Institute
Nate Thomas 1 Machine Intelligence Research Institute
Nathan Clark 1 Machine Intelligence Research Institute
Neil Jacobstein 1 Machine Intelligence Research Institute
Neil Lawrence 1 Leverhulme Centre for the Future of Intelligence
Nell Watson 1 EthicsNet
Nevin Freeman 1 Machine Intelligence Research Institute
Nick Tarleton 1 Machine Intelligence Research Institute
Nickolai Leschov 1 Machine Intelligence Research Institute
Nicolas Jahier 1 FLOWERS
Nicolas Papernot 1 OpenAI
Nicolas Rabault 1 FLOWERS
Niel Bowerman 1 Future of Humanity Institute
Nisan Stiennon 1 Machine Intelligence Research Institute
Noah D. Goodman 1 Stanford University
Noah Goodman 1 Ought
Noam Brown 1 Carnegie Mellon University
Oleg Klimov 1 OpenAI
Olga Afanasjeva 1 GoodAI
Owen Cotton-Barratt 1 Centre for Effective Altruism
Pamela Vagata 1 OpenAI
Panagiotis Papadakis 1 FLOWERS
Parnian Barekatain 1 OpenAI
Patrick Robotham 1 Machine Intelligence Research Institute
Paul Scharre 1 Center for a New American Security
Pedro A. Ortega 1 Google DeepMind
Pedro Chaves 1 Machine Intelligence Research Institute
Pei Wang 1 NARS
Pejman Makhfi 1 Machine Intelligence Research Institute
Percy Liang 1 Stanford University
Pete Michaud 1 Center for Applied Rationality
Peter Asaro 1 The New School
Peter Cheeseman 1 Machine Intelligence Research Institute
Peter Chen 1 OpenAI
Peter de Blanc 1 Machine Intelligence Research Institute
Peter Eckersley 1 Electronic Frontier Foundation
Peter Haas 1 Future of Life Institute
Peter Scheyer 1 Machine Intelligence Research Institute
Peter Thiel 1 Machine Intelligence Research Institute
Peter Welinder 1 OpenAI
Philip Pettit 1 Leverhulme Centre for the Future of Intelligence
Pierre Rouanet 1 FLOWERS
Pierre-Yves Oudeyer 1 FLOWERS
Prafulla Dhariwal 1 OpenAI
Preston Greene 1 Nanyang Technological University
Przemysław Dębiak 1 OpenAI
Quirin Fischer 1 OpenAI
Rachel Fong 1 OpenAI
Rafael Martinez-Galarza 1 Future of Life Institute
Rafał Józefowicz 1 OpenAI
Randal Koene 1 Machine Intelligence Research Institute
Ray Briggs 1 Stanford University
Ray Kurzweil 1 Machine Intelligence Research Institute
Raymond Arnold 1 LessWrong 2.0
Rebecca Crootof 1 Information Society Project
Rebecca Raible 1 Berkeley Existential Risk Initiative
Rein Houthooft 1 OpenAI
Remco Bloemen 1 EthicsNet
Richard Chen 1 OpenAI
Richard Loosemore 1 Susaro
Richard Mallah 1 Future of Life Institute
Richard Neal 1 Machine Intelligence Research Institute
Richard Re 1 UCLA School of Law
Rob Bensinger 1 Machine Intelligence Research Institute
Robert de Neufville 1 Global Catastrophic Risk Institute
Robert Miles 1 Road to AI Safety Excellence
Robert Mushkatblat 1 Machine Intelligence Research Institute
Robert V. Brazell 1 Machine Intelligence Research Institute
Robert Zahra 1 Machine Intelligence Research Institute
Rocky Duan 1 OpenAI
Roger Grosse 1 University of Toronto
Rohin Shah 1 Center for Human-Compatible AI
Roko Mijic 1 Machine Intelligence Research Institute
Roxanne Heston 1 Future of Humanity Institute
Rune Nyrup 1 Leverhulme Centre for the Future of Intelligence
Rupert McCallum 1 Road to AI Safety Excellence
Ruth Fong 1 University of Oxford
Ryan Lowe 1 OpenAI
Sabine Atkins 1 Machine Intelligence Research Institute
Sam Altman 1 OpenAI
Sam Bankman-Fried 1 Berkeley Existential Risk Initiative
Sam Eisenstat 1 Machine Intelligence Research Institute
Sandy Huang 1 OpenAI
Sarah Dillon 1 Leverhulme Centre for the Future of Intelligence
Satinder Singh Baveja 1 Center for Human-Compatible AI
Saul Perlmutter 1 Future of Life Institute
Scott Garrabrant 1 Machine Intelligence Research Institute
Scott Gray 1 OpenAI
Sean Holden 1 Centre for the Study of Existential Risk
Sean Legassick 1 Google DeepMind
Sebastian Farquhar 1 Future of Humanity Institute
Sebastian Nickel 1 Machine Intelligence Research Institute
Sébastien Forestier 1 FLOWERS
Sergey Levine 1 University of California, Berkeley
Seth Herd 1 University of Colorado
Seth J. Herd 1 eCortex
Shahar Avin 1 Centre for the Study of Existential Risk
Shane Legg 1 Google DeepMind
Shariq Hashme 1 OpenAI
Shimon Whiteson 1 OpenAI
Shivon Zilis 1 OpenAI
Shun Liao 1 OpenAI
Siddharth Srivastava 1 Center for Human-Compatible AI
Simon Beard 1 Centre for the Study of Existential Risk
Sören Mindermann 1 Future of Humanity Institute
Stan Franklin 1 Learning Intelligent Distribution Agent
Stanislas Sochacki 1 Machine Intelligence Research Institute
Stefano Ermon 1 Stanford University
Stephan Hartmann 1 Ludwig Maximilian University of Munich
Stéphanie Noirpoudre 1 FLOWERS
Stephen Barnes 1 Machine Intelligence Research Institute
Stephen Cave 1 Leverhulme Centre for the Future of Intelligence
Stephen J. Read 1 University of Southern California
Stephen John 1 Leverhulme Centre for the Future of Intelligence
Steve Rayhawk 1 Machine Intelligence Research Institute
Steven Kaas 1 Machine Intelligence Research Institute
Steven Umbrello 1 Institute of Ethics and Emerging Technologies
Susan Fonseca-Klein 1 Machine Intelligence Research Institute
Susan Gowans 1 Leverhulme Centre for the Future of Intelligence
Susan Zhang 1 OpenAI
Szymon Sidor 1 OpenAI
Taco Cohen 1 OpenAI
Tamas Madl 1 Learning Intelligent Distribution Agent
Tamay Besiroglu 1 Future of Humanity Institute
Tambet Matiisen 1 OpenAI
Tameem Adel 1 Leverhulme Centre for the Future of Intelligence
Tamim Asfour 1 OpenAI
Tania Lombrozo 1 Center for Human-Compatible AI
Théo Segonds 1 FLOWERS
Thibaut Munzer 1 FLOWERS
Thomas Colthurst 1 Machine Intelligence Research Institute
Thomas D. Grant 1 Leverhulme Centre for the Future of Intelligence
Thomas Dietterich 1 Oregon State University
Thomas Icard 1 Stanford University
Thomas McCabe 1 Machine Intelligence Research Institute
Thomas Zeitzoff 1 American University
Thore Graepel 1 Google DeepMind
Tim Crane 1 Centre for the Study of Existential Risk
Tim Czech 1 Machine Intelligence Research Institute
Tim Salimans 1 OpenAI
Timothy Telleen-Lawton 1 Center for Applied Rationality
Tobias Wängberg 1 Linköping University
Tom Griffiths 1 Center for Human-Compatible AI
Tom Kalil 1 University of California, Berkeley
Tomer Kagan 1 Machine Intelligence Research Institute
Tony Barrett 1 Global Catastrophic Risk Institute
Toon Alfrink 1 Road to AI Safety Excellence
Topher Brennan 1 Machine Intelligence Research Institute
Tor Lattimore 1 University of Alberta
Trapit Bansal 1 OpenAI
Trent Fowler 1 Road to AI Safety Excellence
Trevor Blackwell 1 OpenAI
Trevor White 1 Global Catastrophic Risk Institute
Tucker Davey 1 Future of Life Institute
Tyler Emerson 1 Machine Intelligence Research Institute
Ulrike Hahn 1 Birkbeck, University of London
Vanessa Kosoy 1 Machine Intelligence Research Institute
Veerle de Goederen 1 Road to AI Safety Excellence
Vera Koroleva 1 Future of Life Institute
Verity Harding 1 Google DeepMind
Vicki Cheung 1 OpenAI
Vikash Kumar 1 OpenAI
Vincent C. Müller 1 Future of Humanity Institute
Vincent Conitzer 1 Duke University
Vincent Fagot 1 Machine Intelligence Research Institute
Vipul Naik 1 Machine Intelligence Research Institute
Vishal Maini 1 Google DeepMind
Vladimir Nesov 1 Machine Intelligence Research Institute
Vladimir Shakirov 1 Moscow Institute of Physics and Technology
Vladimir Slepnev 1 Google
Wendell Wallach 1 Yale University
Will Newsome 1 Machine Intelligence Research Institute
William Saunders 1 Future of Humanity Institute
William Schueller 1 FLOWERS
Wlodek Rabinowicz 1 London School of Economics
Wojciech Zaremba 1 OpenAI
Wyatt Tessari 1 Center for Human Success
Xi Chen 1 OpenAI
Xin Wen 1 Future of Life Institute
Xue Bin Peng 1 OpenAI
Yan Duan 1 OpenAI
Yaroslav Bulatov 1 OpenAI
Yi Wu 1 OpenAI
Yishuai Du 1 Future of Life Institute
Yoan Mollard 1 FLOWERS
Yoshua Bengio 1 Montreal Institute for Learning Algorithms
Yuhuai Wu 1 OpenAI
Yura Burda 1 OpenAI
Yutaka Matsuo 1 Whole Brain Architecture Initiative
Zachary Miller 1 Ought
Zain Shah 1 OpenAI
Zara Yaqoob 1 Future of Life Institute
Zoubin Ghahramani 1 Leverhulme Centre for the Future of Intelligence
Angela P. 0

Positions grouped by organization

Showing 124 organizations.

Organization Number of people List of people
Machine Intelligence Research Institute 173 Alex Zhu, David Simmons, Alex Mennen, Linda Linsefors, Daniel Demski, Alex Appel, Ben Weinstein-Raun, Evan Hubinger, Qiaochu Yuan, Buck Shlegeris, Blake Borgeson, Jesse Liptrap, Kurt Brown, Tsvi Benson-Tilsen, Abram Demski, Sam Eisenstat, Benjamin Mann, Jeremy Schlatter, Jan Leike, Matthew Graves, Ryan Carey, Colm Ó Riain, Aaron Silverbook, Connor Flexman, Gary Drescher, Rob Bensinger, Malo Bourgon, Scott Garrabrant, Robin Hanson, Andrew Lapinski-Barker, Andrew Critch, Anna Salamon, Jessica Taylor, Vanessa Kosoy, Ramana Kumar, Jaan Tallinn, Jed McCaleb, Bart Selman, Stuart Russell, Jack Gallagher, Nate Thomas, Stuart Armstrong, Jake Moskowitz, Luke Muehlhauser, Jesse Galef, Matthew Fallshaw, Elizabeth Morningstar, Antonius Lourenço Kasbergen, Lila Rieber, Vipul Naik, Nate Soares, Jimmy Rintjema, Daniel Lewis, Richard Neal, Robert Mushkatblat, Dávid Natingga, Moshe Looks, Nathan Clark, James Miller, Randal Koene, Seth Baum, Evan Erickson, Sebastian Nickel, Oliver Habryka, Vladimir Nesov, Anja Heinisch, Joshua Fox, Nisan Stiennon, Patrick LaVictoire, Bill Hibbard (this list is partial)
OpenAI 106 Christopher Olah, Maran Nelson, Julia Galef, Alex Nichol, Matthias Plappert, Jean Harb, Benjamin Mann, Yaroslav Bulatov, Szymon Sidor, Shariq Hashme, Rachel Fong, Jonathan Gray, Jakub Pachocki, Erika Reinhardt, Christopher Berner, Bob McGrew, Ankur Handa, Alex Ray, Aleks Kamko, Michael Page, Peter Welinder, Paul Christiano, Jeremy Schlatter, Tambet Matiisen, Taco Cohen, Igor Mordatch, Harri Edwards, Catherine Olsson, Zain Shah, Scott Gray, Jack Clark, Filip Wolski, Dario Amodei, Prafulla Dhariwal, Jie Tang, Ludwig Pettersson, Kate Miltenberger, Rafał Józefowicz, Marcin Andrychowicz, Shivon Zilis, Jonas Schneider, Eric Price, Rein Houthooft, Jonathan Ho, Jon Gauthier, Linxi Fan, Rocky Duan, Peter Chen, Tim Salimans, Alec Radford, Ian Goodfellow, Yura Burda, Tom Brown, Ilya Sutskever, Pieter Abbeel, Andrej Karpathy, Pamela Vagata, Vicki Cheung, Trevor Blackwell, John Schulman, Wojciech Zaremba, Greg Brockman, Durk Kingma, Sam Altman, Holden Karnofsky, Yan Duan, Sandy Huang, Nicolas Papernot, Aviv Tamar, Yi Wu, Ryan Lowe, Bradly Stadie, Vikash Kumar, Anish Athalye, Tamim Asfour (this list is partial)
Future of Life Institute 45 Daniel Dewey, Jesse Galef, Jacob Trefethen, Chase Moores, Daniel R. Miller, Janos Kramar, Max Kesin, Peter Haas, Melody Guan, Ales Flidr, Zara Yaqoob, Yishuai Du, Xin Wen, Vera Koroleva, Rafael Martinez-Galarza, Na Li, Kazue Evans, Jacob Beebe, Grzegorz Orwiński, Eric Gastfriend, Alan Yan, David Stanley, Lucas Perry, Richard Mallah, Tucker Davey, Ariel Conn, Frank Wilczek, Stuart Russell, Francesca Rossi, Martin Rees, Saul Perlmutter, Elon Musk, Christof Koch, Stephen Hawking, Alan Guth, Morgan Freeman, George Church, Erik Brynjolfsson, Nick Bostrom, Alan Alda, Meia Chita-Tegmark, Anthony Aguirre, Victoria Krakovna, Max Tegmark, Jaan Tallinn
Future of Humanity Institute 41 Tom McGrath, Ryan Carey, Neal Jean, Girish Sastry, William Saunders, Tamay Besiroglu, David Kristoffersson, John Salvatier, David Abel, David Krueger, Allan Dafoe, Andrew Snyder-Beattie, Carrick Flynn, Daniel Dewey, Clare Lyle, Sebastian Farquhar, Sören Mindermann, Cecilia Tilli, Vincent C. Müller, Roxanne Heston, Baobao Zhang, Jeffrey Ding, Chelsea Guo, Jade Leung, Ben Garfinkel, Christopher Cundy, Seán Ó hÉigeartaigh, Katja Grace, Jan Leike, Anders Sandberg, Robin Hanson, Paul Christiano, Carl Shulman, Owain Evans, Miles Brundage, Eric Drexler, Stuart Armstrong, Nick Bostrom, Niel Bowerman, Daniel Filan, Kyle Scott
Leverhulme Centre for the Future of Intelligence 37 Kay Firth-Butterfield, Neil Lawrence, Alan Winfield, Michael A. Osborne, Lucy Cheke, Heather Roff, Beth Singler, José Hernández-Orallo, Tameem Adel, Kanta Dihal, Karina Vold, Henry Shevlin, Rune Nyrup, Sarah Dillon, Susan Gowans, Andrew Snyder-Beattie, Adrian Weller, Thomas D. Grant, Seán Ó hÉigeartaigh, David Runciman, Stephen John, Marta Halina, Anna Alexandrova, Murray Shanahan, Stuart Russell, Nick Bostrom, Stephen Cave, Zoubin Ghahramani, Huw Price, Demis Hassabis, Manuela M. Veloso, Francesca Rossi, Martin Rees, Philip Pettit, Alison Gopnik, Margaret Boden, Martina Kunz
FLOWERS 31 Alvaro Ovalle Castaneda, Florian Golemo, Benjamin Clément, Sébastien Forestier, William Schueller, Cem Karaoguz, Adrien Matricon, Céline Craye, Alexandra Delmas, Gennaro Raiola, Baptiste Busch, Panagiotis Papadakis, Thibaut Munzer, Guillaume Duceux, Louis-Charles Caron, Damien Caselli, Théo Segonds, Stéphanie Noirpoudre, Loïc Dauphin, Matthieu Lapeyre, Nicolas Rabault, Yoan Mollard, Pierre Rouanet, Nicolas Jahier, Didier Roy, Anna-Lisa Vollmer, Freek Stulp, Alexandre Gepperth, David Filliat, Manuel Lopes, Pierre-Yves Oudeyer
Centre for the Study of Existential Risk 25 Adrian Weller, Sean Holden, Stephen Hawking, Tim Crane, Max Tegmark, Murray Shanahan, Dana Scott, Stuart Russell, Elon Musk, Alison Gopnik, David Chalmers, Nick Bostrom, Margaret Boden, Ryan Carey, Martina Kunz, Seth Baum, Beth Barnes, Yang Liu, Jaan Tallinn, Martin Rees, Huw Price, Haydn Belfield, Shahar Avin, Seán Ó hÉigeartaigh, Simon Beard
Center for Applied Rationality 24 Luke Raskopf, Gwern Branwen, Tsvi Benson-Tilsen, Timothy Telleen-Lawton, Stephanie Zolayvar, Qiaochu Yuan, Oliver Habryka, Matthew Graves, Jordan Tirrell, Eric Rogstad, Ben Goldhaber, Michael Keenan, Eli Tyre, Ben Sancetta, Adam Scholl, Elizabeth Garrett, Adom Hartell, Jack Carroll, Lauren Lee, Dan Keys, Duncan Sabien, Michael Smith, Anna Salamon, Pete Michaud
Google DeepMind 21 Vishal Maini, Verity Harding, Sean Legassick, Pedro A. Ortega, Shane Legg, Mustafa Suleyman, Demis Hassabis, Thore Graepel, Laurent Orseau, Chris Maddison, Andrew Lefrancq, Tom Everitt, Jan Leike, Miljan Martic, Jeffrey D. Sachs, James Manyika, Christiana Figueres, Edward W. Felten, Diane Coyle, Nick Bostrom, Victoria Krakovna
Berkeley Existential Risk Initiative 19 Josh Jacobson, Sam Bankman-Fried, Matthew Fallshaw, Colleen Gleason, Jeremy Schlatter, Jaan Tallinn, Kyle Scott, Rebecca Raible, Kenzi Amodei, Jacob Tsimerman, Qiaochu Yuan, Eric Rogstad, Stuart Russell, Seán Ó hÉigeartaigh, Malo Bourgon, Andrew Snyder-Beattie, Michael Keenan, Gina Stuessy, Andrew Critch
Ought 18 Chris Cundy, Girish Sastry, Neal Jean, Ryan Carey, Zac Kenton, Tom McGrath, Ben Weinstein-Raun, Ozzie Gooen, Milan Griffes, Zachary Miller, Ben Goldhaber, Ben West, Andrew Schreiber, Ben Rachbach, Noah Goodman, Paul Christiano, Owain Evans, Andreas Stuhlmüller
Center for Human-Compatible AI 17 Beth Barnes, Dmitrii Krasheninnikov, Christopher Cundy, Siddharth Srivastava, Gillian Hadfield, Andrew Critch, Mark Nitzberg, Tania Lombrozo, Satinder Singh Baveja, Michael Wellman, Joseph Halpern, Bart Selman, Tom Griffiths, Anca Dragan, Pieter Abbeel, Stuart Russell, Rohin Shah
University of California, Berkeley 11 Andrew Critch, Tom Kalil, Michael Janner, Stuart Russell, Pieter Abbeel, Smitha Milli, Dylan Hadfield-Menell, Anca Dragan, Sergey Levine, Paul Christiano, Qiaochu Yuan
AI Impacts 10 Stephanie Zolayvar, Ben Hoffman, John Salvatier, Paul Christiano, Jimmy Rintjema, Justis Mills, Connor Flexman, Finan Adamson, Michael Wulfsohn, Katja Grace
Stanford University 10 Noah D. Goodman, Thomas Icard, Andreas Stuhlmüller, Ray Briggs, Aditi Raghunathan, Michael Webb, Stefano Ermon, Alex Aiken, Percy Liang, Jacob Steinhardt
Whole Brain Architecture Initiative 9 Koji Morikawa, Hideyuki Nakashima, Hiroyuki Morikawa, Masaru Tomita, Kitano Hiroaki, Kenji Doya, Koichi Takahashi, Yutaka Matsuo, Hiroshi Yamakawa
Global Catastrophic Risk Institute 8 Matthijs Maas, Trevor White, Roman Yampolskiy, Mark Fusco, Grant Wilson, Tony Barrett, Seth Baum, Robert de Neufville
Road to AI Safety Excellence 8 Remmelt Ellen, Trent Fowler, Erik Istre, Rupert McCallum, Robert Miles, Johannes Heidecke, Veerle de Goederen, Toon Alfrink
AI Safety Camp 7 Remmelt Ellen, Jessica Cooper, Kristina Nemcova, Jirí Nadvorník, Anne Wissemann, Jan Kulveit, Johannes Heidecke
Australian National University 7 Alan Hájek, Jan Leike, Marcus Hutter, Elliot Catt, Jarryd Martin, Tom Everitt, Gary Lea
Open Philanthropy Project 7 Daniel Dewey, Helen Toner, Holden Karnofsky, Dario Amodei, Christopher Olah, Jacob Steinhardt, Paul Christiano
Foundational Research Institute 6 Brian Tomasik, Max Daniel, Kaj Sotala, Caspar Oesterheld, Lukas Gloor, Tobias Baumann
LessWrong 2.0 6 Eric Rogstad, Harmanas Chopra, Raymond Arnold, Ben Albert Pace, Matthew Graves, Oliver Habryka
Convergence Analysis 5 Ozzie Gooen, Claire Abu-Assal, Kristian Rönn, Andrew X Stewart, Justin Shovelain
Google Brain 5 Melody Guan, Tom Brown, Dan Mané, Dario Amodei, Christopher Olah
University of Cambridge 5 Arif Ahmed, Huw Price, Yang Liu, Adrian Weller, Ramana Kumar
University of Oxford 5 Heather Roff, Ruth Fong, Chris Maddison, Michael Wooldridge, Owain Evans
Carnegie Mellon University 4 David Danks, Noam Brown, Manuela Veloso, Andre Platzer
EthicsNet 4 Aleksandra Orchowska, Remco Bloemen, Anish Mohammed, Nell Watson
GoodAI 4 Jan Feyereisl, Marek Havrda, Olga Afanasjeva, Marek Rosa
Montreal Institute for Learning Algorithms 4 Zac Kenton, Doina Precup, Joelle Pineau, Yoshua Bengio
Centre for Effective Altruism 3 Johannes Treutlein, Ales Flidr, Owen Cotton-Barratt
Cornell University 3 Joseph Halpern, Bart Selman, Jim Babcock
eCortex 3 Randall C. O’Reilly, Seth J. Herd, David J. Jilk
Foresight Institute 3 Christine Peterson, Mark S. Miller, Allison Duettmann
IDSIA 3 Mark Ring, Jürgen Schmidhuber, Bas R. Steunebrink
SUPSI 3 Mark Ring, Jürgen Schmidhuber, Bas R. Steunebrink
Theiss Research 3 Kaj Sotala, Long Ouyang, Paul Christiano
Università della Svizzera italiana 3 Mark Ring, Jürgen Schmidhuber, Bas R. Steunebrink
Yale University 3 Daniel Eth, Wendell Wallach, Allan Dafoe
AIDEUS 2 Sergey Rodionov, Alexey Potapov
Arizona State University 2 Heather Roff, Miles Brundage
Center for a New American Security 2 Gregory C. Allen, Paul Scharre
Center for Human Success 2 Wyatt Tessari, David Yu
Endgame 2 Hyrum Anderson, Bobby Filar
Google 2 Vladimir Slepnev, Marcello Herreshoff
Learning Intelligent Distribution Agent 2 Tamas Madl, Stan Franklin
Linköping University 2 Mikael Böörs, Tobias Wängberg
London School of Economics 2 Katie Steele, Wlodek Rabinowicz
Ludwig Maximilian University of Munich 2 Stephan Hartmann, Reuben Stern
UCLA School of Law 2 Richard Re, Edward Parson
University College London 2 John Shawe-Taylor, Tobias Baumann
University of Michigan 2 James M. Joyce, Michael Wellman
University of Toronto 2 Joshua Gans, Roger Grosse
University of Wisconsin–Madison 2 Reuben Stern, Patrick LaVictoire
1 Angela P.
Aalto University 1 Jelena Luketina
AgroParisTech 1 Laurent Orseau
Aix-Marseille University 1 Sergey Rodionov
American University 1 Thomas Zeitzoff
Birkbeck, University of London 1 Ulrike Hahn
Brown University 1 David Abel
California Institute of Technology 1 Frederick Eberhardt
Carleton University 1 Andrew MacFie
Center for Analysis & Design of Intelligent Agents 1 Kristinn R. Thórisson
CogPrime 1 Ben Goertzel
Data61 1 Ramana Kumar
Duke University 1 Vincent Conitzer
Effective Altruism Foundation 1 Max Daniel
Electronic Frontier Foundation 1 Peter Eckersley
ETH Zurich 1 Felix Berkenkamp
George Mason University 1 Robin Hanson
Georgia Institute of Technology 1 Fuxin Li
Global Politics of Artificial Intelligence Research Group at Yale University and University of Oxford 1 Matthijs Maas
Hague Centre for Strategic Studies 1 Matthijs Maas
Harvard University 1 David Parkes
Icelandic Institute for Intelligent Machines 1 Kristinn R. Thórisson
Information Society Project 1 Rebecca Crootof
INRA 1 Laurent Orseau
Institute for Future Studies 1 H. Orri Stefánsson
Institute for Theoretical Studies at ETH Zurich 1 Will Sawin
Institute of Ethics and Emerging Technologies 1 Steven Umbrello
Internet Archive 1 Brewster Kahle
ITMO University 1 Alexey Potapov
Lingnan University 1 Jiji Zhang
Massachusetts Institute of Technology 1 Jon Gauthier
Moscow Institute of Physics and Technology 1 Vladimir Shakirov
Munich Center for Mathematical Philosophy 1 Catrin Campbell-Moore
Nanyang Technological University 1 Preston Greene
NARS 1 Pei Wang
National Bureau of Economic Research 1 Joshua Gans
New America Foundation 1 Heather Roff
Nilcons 1 Mihaly Barasz
NNAISENSE 1 Bas R. Steunebrink
Oregon State University 1 Thomas Dietterich
Princeton University 1 Will Sawin
Quixey 1 Patrick LaVictoire
Real AI 1 Jonathan Yan
Rice University 1 Moshe Vardi
Self-Aware Systems 1 Steve Omohundro
Social & Environmental Entrepreneurs 1 Seth Baum
Sorbonne University 1 Michaël Trazzi
Susaro 1 Richard Loosemore
Texas A&M University 1 Kenny Easwaran
The New School 1 Peter Asaro
Université de Montréal 1 Jelena Luketina
University of Alberta 1 Tor Lattimore
University of Arizona 1 Jenann Ismael
University of Bath 1 Joanna Bryson
University of Bristol 1 Benya Fallenstein
University of Colorado 1 Seth Herd
University of Colorado Boulder 1 Randall C. O’Reilly
University of Copenhagen 1 Matthijs Maas
University of Denver 1 Heather Roff
University of Edinburgh 1 Angelo Frank De Bellis
University of Illinois at Chicago 1 Brian Ziebart
University of Louisville 1 Roman Yampolskiy
University of Melbourne 1 Benjamin Rubinstein
University of Montreal 1 Janos Kramar
University of New Hampshire 1 Andrew Ware
University of Padova 1 Francesca Rossi
University of Southern California 1 Stephen J. Read
University of Washington 1 Daniel Weld
Washington University in St. Louis 1 Julia Haas

Individuals not affiliated with any organization

Showing 20 people.

Organization Website Source
Wei Dai http://www.weidai.com/ [1], [2]
Iceman [3], [4], [5], [6], [7]
Max Harms http://raelifin.com/ [8], [7]
Jeff Kaufman https://www.jefftk.com [9], [7]
Federico Pistono http://federicopistono.org/ [10]
Chris Pasek [11], [12]
Sune Kristian Jakobsen
Amanda Askell http://www.amandaaskell.com [13]
Hilary Greaves [13]
Sophie-Charlotte Fischer [14]
Alexey Turchin https://avturchin.livejournal.com/ [15], [16], [17], [18]
Dustin Juliano http://dustinjuliano.com/ [19], [20]
Matteo Turchetta [21]
Angela P. Schoellig [21]
Andreas Krause [21]
Jim O’Neill [22]
Alex Flint http://www.alexflint.io/ [23]
Gordon Irlam http://www.gordoni.com/ [24]
Nandi Schoots [12]
John Maxwell [25]

Products

This section lists AI safety-related “products”: interactive tools, websites, flowcharts, datasets, etc. Unlike documents, products tend to be interactive, are updated continually, or require inputs from the consumer.

Showing 32 products.

Name Type Creator Creation date Description
AI Alignment Forum blog LessWrong 2.0 2018-07-10 A group blog for discussion of technical aspects of AI alignment. The forum is built using the same software as LessWrong 2.0, and is integrated with LessWrong 2.0. For creation date, see [26].
AI Safety Research Camp workshop Tom McGrath, Remmelt Ellen, Linda Linsefors, Nandi Schoots, David Kristoffersson, Chris Pasek 2018-02-01 A research camp to take place in Gran Canaria in April 2018 and in the United Kingdom in July–August 2018. Facebook group at [27]. The creation date is the date of announcement on LessWrong 2.0.
“Levels of defense” in AI safety flowchart Alexey Turchin 2017-12-12 A flowchart applying multilevel defense to AI safety. There is an accompanying post on LessWrong at [28].
AI Alignment Prize contest Zvi Mowshowitz, Vladimir Slepnev, Paul Christiano 2017-11-03 A prize for work that advances understanding in alignment of smarter-than-human artificial intelligence. Winners for the first round, as well as announcement of the second round, can be found at [25]. Winners for the second round, as well as announcement of the third round, can be found at [29].
AI Watch interactive application Issa Rice 2017-10-23 A website to track people and organizations working on AI safety.
AI Safety Open Discussion discussion group Mati Roy 2017-10-23 A Facebook discussion group about AI safety. This is an open group.
AI safety resources list Victoria Krakovna 2017-10-01 A list of resources for long-term AI safety. Seems to have been first announced at [30].
Map of the AI Safety Community graphic Søren Elverlin 2017-09-26 A pictorial map that lists organizations and individuals in the AI safety community.
Open Philanthropy Project AI Fellows Program fellowship Open Philanthropy Project 2017-09-12 A fellowship to support PhD students in AI and machine learning. For the creation date, see [31].
LessWrong 2.0 blog LessWrong 2.0 2017-06-18 A community blog about rationality, decision theory, AI, the rationality community, and other topics relevant to AI safety. This is a re-launch/modernization of the original LessWrong. For the launch date, the date of the welcome post [32] is used.
Road to AI Safety Excellence course Toon Alfrink 2017-06-15 A proposed course that is designed to produce AI safety researchers. It used to be called “Accelerating AI Safety Adoption in Academia” and was announced on LessWrong at [33]. The Facebook group was created on 2017-06-30 [34].
Annotated bibliography of recommended materials list Center for Human-Compatible AI 2016-12-01 An annotated and interactive bibliography of AI safety-related course materials, textbooks, videos, papers, etc.
Extinction Risk from Artificial Intelligence blog Michael Cohen 2016-06-01 A series of pages exploring arguments for and against working on AI safety. The creation date is inferred from the URLs of images (example: [35]).
AI Alignment blog Paul Christiano 2016-05-28 Paul Christiano’s blog about AI alignment.
AISafety.com Reading Group discussion group Søren Elverlin, Erik B. Jacobsen, Volkan Erdogan 2016-05-24 A weekly reading group covering topics in AI safety.
Cause prioritization app interactive application Michael Dickens, Buck Shlegeris 2016-05-18 An interactive app for quantitative cause prioritization. The app includes a section [36] on AI safety intervention. The creation date is the date of the first commit in the Git repository [37].
Arbital AI alignment domain wiki Arbital, Eliezer Yudkowsky 2016-03-04 A collection of wiki-like pages on topics in AI alignment. The creation date is the date of the launch announcement for Arbital [38]; it’s unclear when the AI alignment domain itself was created.
Introductory resources on AI safety research list Victoria Krakovna 2016-02-28 A list of readings on long-term AI safety. Mirrored at [39]. There is an updated list at [40].
AI Safety Discussion discussion group Victoria Krakovna 2016-02-21 A Facebook discussion group about AI safety. This is a closed group so one needs to request access to see posts.
Reinforce.js implementation of Stuart Armstrong’s toy control problem interactive application Gwern Branwen, FeepingCreature 2016-02-03 A live demo of Stuart Armstrong’s toy control problem [41]. gwern introduced the demo in a LessWrong comment [42].
AI Policies Wiki wiki Gordon Irlam 2015-12-14 A wiki on AI policy. The wiki creation date can be seen in the revision history of the main page [43].
The Control Problem discussion group CyberPersona 2015-08-29 A subreddit about AI safety and control. For the subreddit creation date, see [44].
AGI Failures Modes and Levels map flowchart Alexey Turchin 2015-01-01 A flowchart about failure modes of artificial general intelligence, grouped by the stage of development. There is an accompanying post on LessWrong at [18].
AGI Safety Solutions Map flowchart Alexey Turchin 2015-01-01 A flowchart on potential solutions to AI safety. There is an accompanying post on LessWrong at [45].
Intelligent Agent Foundations Forum discussion group Machine Intelligence Research Institute 2014-11-04 A forum for technical AI safety research. The source code is hosted on GitHub [46]. The timestamp on the introductory post [47] gives the launch date.
A flowchart of AI safety considerations flowchart Eliezer Yudkowsky 2014-11-02 The flowchart was posted to Eliezer Yudkowsky’s Essays (a Facebook group) and has no title.
Effective Altruism Forum blog Centre for Effective Altruism, Rethink Charity, Ryan Carey 2014-09-10 A community blog about effective altruism which often has posts about AI safety. The forum was announced on LessWrong by Ryan Carey [48].
How to study superintelligence strategy list Luke Muehlhauser 2014-07-03 A list of project ideas in superintelligence strategy.
Ordinary Ideas blog Paul Christiano 2011-12-21 Paul Christiano’s blog about “weird AI stuff” [49].
The Uncertain Future interactive application Machine Intelligence Research Institute 2009-10-01 A tool to model future technology and its effect on civilization. For more about the history of the site, see [50].
LessWrong Wiki wiki Machine Intelligence Research Institute 2009-03-12 A companion wiki to the community blog LessWrong. The wiki has pages about AI safety.
LessWrong blog Machine Intelligence Research Institute 2009-02-01 A community blog about rationality, decision theory, AI, updates to MIRI, among other topics.