AI Watch

Welcome! This is a website to track people and organizations working on AI safety. See the code repository for the source code and data of this website.

This website is developed by Issa Rice and has been partially funded by Vipul Naik.

If you like (or want to like) this website and have money: the current funder doesn't want to continue funding this project. As a result, it is currently mostly sitting around. If you want to bring this site to the next level, contact Issa at riceissa@gmail.com. What you get: site improvements, recognition in the site credits. What the site needs: money.

If you have time and want experience building websites: this website is looking for contributors. If you want to help out, contact Issa at riceissa@gmail.com. What you get: little or no pay (this could change if the site gets funding; see previous paragraph), recognition in the site credits, privilege of working with me, knowledge of the basics of web development (MySQL, PHP, Git). What the site needs: data collection/entry and website code improvements.

Last updated on 2019-09-14.

Table of contents

Agendas

Agenda name Associated people Associated organizations
Iterated amplification Paul Christiano, Buck Shlegeris, Dario Amodei OpenAI
Embedded agency Eliezer Yudkowsky, Scott Garrabrant, Abram Demski Machine Intelligence Research Institute
Comprehensive AI services Eric Drexler Future of Humanity Institute
Ambitious value learning Stuart Armstrong Future of Humanity Institute
Factored cognition Andreas Stuhlmüller Ought
Recursive reward modeling Jan Leike, David Krueger, Tom Everitt, Miljan Martic, Vishal Maini, Shane Legg Google DeepMind
Debate Paul Christiano OpenAI
Interpretability Christopher Olah
Inverse reinforcement learning
Preference learning
Cooperative inverse reinforcement learning
Imitation learning
Alignment for advanced machine learning systems Jessica Taylor, Eliezer Yudkowsky, Patrick LaVictoire, Andrew Critch Machine Intelligence Research Institute
Learning-theoretic AI alignment Vanessa Kosoy
Counterfactual reasoning Jacob Steinhardt

AI safety relation by subject

Note: as shown by the large number of “unknown” values, most of the positions haven’t been categorized by relation/subject so this table will only be useful in the future.

Subject UnknownAGI organizationGCR organizationposition Total
Unknown 1740 238 20 243 2241
background 0 0 0 25 25
general 0 0 2 8 10
grant investigation 0 0 0 3 3
policy 0 0 0 1 1
popularization 0 0 0 2 2
scientific advising 0 0 0 4 4
software engineering 0 2 0 10 12
strategy 0 0 0 1 1
technical research 0 0 0 34 34
Total 1740 240 22 331 2333

Positions summary by year

Note: as shown by the large number of “unknown” values, most of the positions haven’t been categorized by start/end dates so this table will only be useful in the future.

Year Start date End date
Unknown 1003 1475
2000 6 0
2002 1 1
2004 4 0
2005 10 2
2006 12 13
2007 17 6
2008 4 5
2009 19 7
2010 29 23
2011 28 36
2012 36 18
2013 52 44
2014 80 33
2015 149 110
2016 312 164
2017 251 161
2018 260 185
2019 60 50

Positions grouped by person

Showing 760 people with positions.

Name Number of organizations List of organizations
Paul Christiano 8 AI Impacts, Future of Humanity Institute, Machine Intelligence Research Institute, Open Philanthropy Project, OpenAI, Ought, Theiss Research, University of California, Berkeley
Stuart Russell 7 Berkeley Existential Risk Initiative, Center for Human-Compatible AI, Centre for the Study of Existential Risk, Future of Life Institute, Leverhulme Centre for the Future of Intelligence, Machine Intelligence Research Institute, University of California, Berkeley
Nick Bostrom 6 Centre for the Study of Existential Risk, Future of Humanity Institute, Future of Life Institute, Google DeepMind, Leverhulme Centre for the Future of Intelligence, Machine Intelligence Research Institute
Heather Roff 5 Arizona State University, Leverhulme Centre for the Future of Intelligence, New America Foundation, University of Denver, University of Oxford
Ryan Carey 5 Centre for the Study of Existential Risk, Future of Humanity Institute, Machine Intelligence Research Institute, OpenAI, Ought
Andrew Critch 4 Berkeley Existential Risk Initiative, Center for Human-Compatible AI, Machine Intelligence Research Institute, University of California, Berkeley
Bas R. Steunebrink 4 IDSIA, NNAISENSE, SUPSI, Università della Svizzera italiana
Daniel Dewey 4 Future of Humanity Institute, Future of Life Institute, Machine Intelligence Research Institute, Open Philanthropy Project
Jaan Tallinn 4 Berkeley Existential Risk Initiative, Centre for the Study of Existential Risk, Future of Life Institute, Machine Intelligence Research Institute
Jan Leike 4 Australian National University, Future of Humanity Institute, Google DeepMind, Machine Intelligence Research Institute
Matthijs Maas 4 Global Catastrophic Risk Institute, Global Politics of Artificial Intelligence Research Group at Yale University and University of Oxford, Hague Centre for Strategic Studies, University of Copenhagen
Qiaochu Yuan 4 Berkeley Existential Risk Initiative, Center for Applied Rationality, Machine Intelligence Research Institute, University of California, Berkeley
Seán Ó hÉigeartaigh 4 Berkeley Existential Risk Initiative, Centre for the Study of Existential Risk, Future of Humanity Institute, Leverhulme Centre for the Future of Intelligence
Seth Baum 4 Centre for the Study of Existential Risk, Global Catastrophic Risk Institute, Machine Intelligence Research Institute, Social & Environmental Entrepreneurs
Adrian Weller 3 Centre for the Study of Existential Risk, Leverhulme Centre for the Future of Intelligence, University of Cambridge
Andrew Snyder-Beattie 3 Berkeley Existential Risk Initiative, Future of Humanity Institute, Leverhulme Centre for the Future of Intelligence
Bart Selman 3 Center for Human-Compatible AI, Cornell University, Machine Intelligence Research Institute
Christopher Olah 3 Google Brain, Open Philanthropy Project, OpenAI
Dario Amodei 3 Google Brain, Open Philanthropy Project, OpenAI
Eric Rogstad 3 Berkeley Existential Risk Initiative, Center for Applied Rationality, LessWrong 2.0
Francesca Rossi 3 Future of Life Institute, Leverhulme Centre for the Future of Intelligence, University of Padova
Huw Price 3 Centre for the Study of Existential Risk, Leverhulme Centre for the Future of Intelligence, University of Cambridge
Janos Kramar 3 Future of Life Institute, Machine Intelligence Research Institute, University of Montreal
Jeremy Schlatter 3 Berkeley Existential Risk Initiative, Machine Intelligence Research Institute, OpenAI
Jürgen Schmidhuber 3 IDSIA, SUPSI, Università della Svizzera italiana
Kaj Sotala 3 Foundational Research Institute, Machine Intelligence Research Institute, Theiss Research
Katja Grace 3 AI Impacts, Future of Humanity Institute, Machine Intelligence Research Institute
Laurent Orseau 3 AgroParisTech, Google DeepMind, INRA
Mark Ring 3 IDSIA, SUPSI, Università della Svizzera italiana
Martin Rees 3 Centre for the Study of Existential Risk, Future of Life Institute, Leverhulme Centre for the Future of Intelligence
Matthew Graves 3 Center for Applied Rationality, LessWrong 2.0, Machine Intelligence Research Institute
Max Tegmark 3 Centre for the Study of Existential Risk, Future of Life Institute, Machine Intelligence Research Institute
Miles Brundage 3 Arizona State University, Future of Humanity Institute, OpenAI
Oliver Habryka 3 Center for Applied Rationality, LessWrong 2.0, Machine Intelligence Research Institute
Owain Evans 3 Future of Humanity Institute, Ought, University of Oxford
Patrick LaVictoire 3 Machine Intelligence Research Institute, Quixey, University of Wisconsin–Madison
Pieter Abbeel 3 Center for Human-Compatible AI, OpenAI, University of California, Berkeley
Ramana Kumar 3 Data61, Machine Intelligence Research Institute, University of Cambridge
Robin Hanson 3 Future of Humanity Institute, George Mason University, Machine Intelligence Research Institute
Roman Yampolskiy 3 Global Catastrophic Risk Institute, Machine Intelligence Research Institute, University of Louisville
Victoria Krakovna 3 Future of Life Institute, Google DeepMind, Machine Intelligence Research Institute
Yang Liu 3 Centre for the Study of Existential Risk, OpenAI, University of Cambridge
Ales Flidr 2 Centre for Effective Altruism, Future of Life Institute
Alexey Potapov 2 AIDEUS, ITMO University
Alison Gopnik 2 Centre for the Study of Existential Risk, Leverhulme Centre for the Future of Intelligence
Allan Dafoe 2 Future of Humanity Institute, Yale University
Anca Dragan 2 Center for Human-Compatible AI, University of California, Berkeley
Andreas Stuhlmüller 2 Ought, Stanford University
Anna Salamon 2 Center for Applied Rationality, Machine Intelligence Research Institute
Ben Goertzel 2 CogPrime, Machine Intelligence Research Institute
Ben Goldhaber 2 Center for Applied Rationality, Ought
Ben Weinstein-Raun 2 Machine Intelligence Research Institute, Ought
Benjamin Mann 2 Machine Intelligence Research Institute, OpenAI
Benya Fallenstein 2 Machine Intelligence Research Institute, University of Bristol
Beth Barnes 2 Center for Human-Compatible AI, Centre for the Study of Existential Risk
Carl Shulman 2 Future of Humanity Institute, Machine Intelligence Research Institute
Chris Maddison 2 Google DeepMind, University of Oxford
Christine Peterson 2 Foresight Institute, Machine Intelligence Research Institute
Christopher Cundy 2 Center for Human-Compatible AI, Future of Humanity Institute
Connor Flexman 2 AI Impacts, Machine Intelligence Research Institute
David Abel 2 Brown University, Future of Humanity Institute
Demis Hassabis 2 Google DeepMind, Leverhulme Centre for the Future of Intelligence
Elon Musk 2 Centre for the Study of Existential Risk, Future of Life Institute
Gillian Hadfield 2 Center for Human-Compatible AI, OpenAI
Girish Sastry 2 Future of Humanity Institute, Ought
Gwern Branwen 2 Center for Applied Rationality, Machine Intelligence Research Institute
Helen Toner 2 Open Philanthropy Project, OpenAI
Holden Karnofsky 2 Open Philanthropy Project, OpenAI
Jacob Steinhardt 2 Open Philanthropy Project, Stanford University
Jelena Luketina 2 Aalto University, Université de Montréal
Jesse Galef 2 Future of Life Institute, Machine Intelligence Research Institute
Jimmy Rintjema 2 AI Impacts, Machine Intelligence Research Institute
Johannes Heidecke 2 AI Safety Camp, Road to AI Safety Excellence
John Salvatier 2 AI Impacts, Future of Humanity Institute
Jon Gauthier 2 Massachusetts Institute of Technology, OpenAI
Joseph Halpern 2 Center for Human-Compatible AI, Cornell University
Joshua Gans 2 National Bureau of Economic Research, University of Toronto
Justin Shovelain 2 Convergence Analysis, Machine Intelligence Research Institute
Kristinn R. Thórisson 2 Center for Analysis & Design of Intelligent Agents, Icelandic Institute for Intelligent Machines
Kyle Scott 2 Berkeley Existential Risk Initiative, Future of Humanity Institute
Malo Bourgon 2 Berkeley Existential Risk Initiative, Machine Intelligence Research Institute
Marcello Herreshoff 2 Google, Machine Intelligence Research Institute
Margaret Boden 2 Centre for the Study of Existential Risk, Leverhulme Centre for the Future of Intelligence
Martina Kunz 2 Centre for the Study of Existential Risk, Leverhulme Centre for the Future of Intelligence
Matthew Fallshaw 2 Berkeley Existential Risk Initiative, Machine Intelligence Research Institute
Max Daniel 2 Effective Altruism Foundation, Foundational Research Institute
Melody Guan 2 Future of Life Institute, Google Brain
Michael Keenan 2 Berkeley Existential Risk Initiative, Center for Applied Rationality
Michael Wellman 2 Center for Human-Compatible AI, University of Michigan
Mihaly Barasz 2 Machine Intelligence Research Institute, Nilcons
Murray Shanahan 2 Centre for the Study of Existential Risk, Leverhulme Centre for the Future of Intelligence
Neal Jean 2 Future of Humanity Institute, Ought
Ozzie Gooen 2 Convergence Analysis, Ought
Randall C. O’Reilly 2 eCortex, University of Colorado Boulder
Remmelt Ellen 2 AI Safety Camp, Road to AI Safety Excellence
Reuben Stern 2 Ludwig Maximilian University of Munich, University of Wisconsin–Madison
Sergey Rodionov 2 AIDEUS, Aix-Marseille University
Smitha Milli 2 OpenAI, University of California, Berkeley
Stephanie Zolayvar 2 AI Impacts, Center for Applied Rationality
Stephen Hawking 2 Centre for the Study of Existential Risk, Future of Life Institute
Steve Omohundro 2 Machine Intelligence Research Institute, Self-Aware Systems
Stuart Armstrong 2 Future of Humanity Institute, Machine Intelligence Research Institute
Tobias Baumann 2 Foundational Research Institute, University College London
Tom Brown 2 Google Brain, OpenAI
Tom Everitt 2 Australian National University, Google DeepMind
Tom McGrath 2 Future of Humanity Institute, Ought
Tsvi Benson-Tilsen 2 Center for Applied Rationality, Machine Intelligence Research Institute
Will Sawin 2 Institute for Theoretical Studies at ETH Zurich, Princeton University
Zac Kenton 2 Montreal Institute for Learning Algorithms, Ought
Aaron Silverbook 1 Machine Intelligence Research Institute
Abraham Wolk 1 Machine Intelligence Research Institute
Abram Demski 1 Machine Intelligence Research Institute
Adam D’Angelo 1 OpenAI
Adam Scholl 1 Center for Applied Rationality
Aditi Raghunathan 1 Stanford University
Aditya Grover 1 OpenAI
Adom Hartell 1 Center for Applied Rationality
Adrien Matricon 1 FLOWERS
Alan Alda 1 Future of Life Institute
Alan Guth 1 Future of Life Institute
Alan Hájek 1 Australian National University
Alan Winfield 1 Leverhulme Centre for the Future of Intelligence
Alan Yan 1 Future of Life Institute
Alec Radford 1 OpenAI
Aleks Kamko 1 OpenAI
Aleksandar Botev 1 OpenAI
Aleksandra Orchowska 1 EthicsNet
Alex Aiken 1 Stanford University
Alex Altair 1 Machine Intelligence Research Institute
Alex Appel 1 Machine Intelligence Research Institute
Alex Flint 1 Berkeley Existential Risk Initiative
Alex Mennen 1 Machine Intelligence Research Institute
Alex Nichol 1 OpenAI
Alex Paino 1 OpenAI
Alex Ray 1 OpenAI
Alex Vermeer 1 Machine Intelligence Research Institute
Alex Zhu 1 Machine Intelligence Research Institute
Alexander Skidanov 1 OpenAI
Alexandra Delmas 1 FLOWERS
Alexandre Gepperth 1 FLOWERS
Allison Duettmann 1 Foresight Institute
Allison Taguchi 1 Machine Intelligence Research Institute
Alvaro Ovalle Castaneda 1 FLOWERS
Alyssa Vance 1 Machine Intelligence Research Institute
Amanda Askell 1 OpenAI
Amy Willey 1 Machine Intelligence Research Institute
Anders Sandberg 1 Future of Humanity Institute
Andre Platzer 1 Carnegie Mellon University
Andrej Karpathy 1 OpenAI
Andrew Hay 1 Machine Intelligence Research Institute
Andrew Lapinski-Barker 1 Machine Intelligence Research Institute
Andrew Lefrancq 1 Google DeepMind
Andrew MacFie 1 Carleton University
Andrew Rettek 1 Machine Intelligence Research Institute
Andrew Schreiber 1 Ought
Andrew Ware 1 University of New Hampshire
Andrew X Stewart 1 Convergence Analysis
Andriy Brodskyy 1 Machine Intelligence Research Institute
Angelo Frank De Bellis 1 University of Edinburgh
Anish Athalye 1 OpenAI
Anish Mohammed 1 EthicsNet
Anja Heinisch 1 Machine Intelligence Research Institute
Ankur Handa 1 OpenAI
Anna Alexandrova 1 Leverhulme Centre for the Future of Intelligence
Anna-Lisa Vollmer 1 FLOWERS
Anne Wissemann 1 AI Safety Camp
Anthony Aguirre 1 Future of Life Institute
Antonius Lourenço Kasbergen 1 Machine Intelligence Research Institute
Aravind Srinivas 1 OpenAI
Ariel Conn 1 Future of Life Institute
Arif Ahmed 1 University of Cambridge
Art Chaidarun 1 OpenAI
Arthur Petron 1 OpenAI
Aruna Vassar 1 Machine Intelligence Research Institute
Ashley C. Pilipiszyn 1 OpenAI
Asya Bergal 1 AI Impacts
Aubrey de Grey 1 Machine Intelligence Research Institute
Aviv Tamar 1 OpenAI
Baobao Zhang 1 Future of Humanity Institute
Baptiste Busch 1 FLOWERS
Barney Pell 1 Machine Intelligence Research Institute
Ben Albert Pace 1 LessWrong 2.0
Ben Chess 1 OpenAI
Ben Garfinkel 1 Future of Humanity Institute
Ben Hoffman 1 AI Impacts
Ben Hoskin 1 Machine Intelligence Research Institute
Ben Rachbach 1 Ought
Ben Sancetta 1 Center for Applied Rationality
Ben West 1 Ought
Benjamin Clément 1 FLOWERS
Benjamin Rubinstein 1 University of Melbourne
Beth Singler 1 Leverhulme Centre for the Future of Intelligence
Bianca Martin 1 OpenAI
Bill Hibbard 1 Machine Intelligence Research Institute
Blake Borgeson 1 Machine Intelligence Research Institute
Bob McGrew 1 OpenAI
Bobby Filar 1 Endgame
Bowen Baker 1 OpenAI
Brad Lightcap 1 OpenAI
Bradly Stadie 1 OpenAI
Brewster Kahle 1 Internet Archive
Brian Atkins 1 Machine Intelligence Research Institute
Brian Tomasik 1 Foundational Research Institute
Brian Ziebart 1 University of Illinois at Chicago
Brienne Strohl 1 Center for Applied Rationality
Brooke Chan 1 OpenAI
Bruce Klein 1 Machine Intelligence Research Institute
Bryan Bishop 1 Machine Intelligence Research Institute
Buck Shlegeris 1 Machine Intelligence Research Institute
C. Colby Thomson 1 Machine Intelligence Research Institute
Cameron Taylor 1 Machine Intelligence Research Institute
Carolyn L. Burke 1 Machine Intelligence Research Institute
Carrick Flynn 1 Future of Humanity Institute
Carson Jones 1 Machine Intelligence Research Institute
Caspar Oesterheld 1 Foundational Research Institute
Catherine Olsson 1 OpenAI
Cathy Wu 1 OpenAI
Catrin Campbell-Moore 1 Munich Center for Mathematical Philosophy
Cecilia Tilli 1 Future of Humanity Institute
Céline Craye 1 FLOWERS
Cem Karaoguz 1 FLOWERS
Chase Moores 1 Future of Life Institute
Chelsea Guo 1 Future of Humanity Institute
Chris Clark 1 OpenAI
Chris Cundy 1 Ought
Christian Rovner 1 Machine Intelligence Research Institute
Christiana Figueres 1 Google DeepMind
Christina Hendrickson 1 OpenAI
Christine McLeavey Payne 1 OpenAI
Christof Koch 1 Future of Life Institute
Christopher Berner 1 OpenAI
Christopher Hesse 1 OpenAI
Christos Louizos 1 OpenAI
Christy Dennison 1 OpenAI
Claire Abu-Assal 1 Convergence Analysis
Clare Lyle 1 Future of Humanity Institute
Clemens Winter 1 OpenAI
Colleen Gleason 1 Berkeley Existential Risk Initiative
Colm Ó Riain 1 Machine Intelligence Research Institute
Craig Quiter 1 OpenAI
Damien Caselli 1 FLOWERS
Dan Keys 1 Center for Applied Rationality
Dan Mané 1 Google Brain
Dana Scott 1 Centre for the Study of Existential Risk
Daniel Demski 1 Machine Intelligence Research Institute
Daniel Eth 1 Yale University
Daniel Filan 1 Future of Humanity Institute
Daniel Kokotajlo 1 AI Impacts
Daniel Lewis 1 Machine Intelligence Research Institute
Daniel R. Miller 1 Future of Life Institute
Daniel Roth 1 Machine Intelligence Research Institute
Daniel Weld 1 University of Washington
Daniel Ziegler 1 OpenAI
Daniela Amodei 1 OpenAI
Danielle Buma 1 OpenAI
Danny Hernandez 1 OpenAI
David Chalmers 1 Centre for the Study of Existential Risk
David Danks 1 Carnegie Mellon University
David Farhi 1 OpenAI
David Filliat 1 FLOWERS
David Hart 1 Machine Intelligence Research Institute
David J. Jilk 1 eCortex
David Kristoffersson 1 Future of Humanity Institute
David Krueger 1 Future of Humanity Institute
David Lansky 1 OpenAI
David Luan 1 OpenAI
Dávid Natingga 1 Machine Intelligence Research Institute
David Parkes 1 Harvard University
David Runciman 1 Leverhulme Centre for the Future of Intelligence
David Simmons 1 Machine Intelligence Research Institute
David Stanley 1 Future of Life Institute
David Yu 1 Center for Human Success
Dennis Fan 1 Machine Intelligence Research Institute
Desmond Henderson 1 OpenAI
Diane Coyle 1 Google DeepMind
Diane Yoon 1 OpenAI
Didier Roy 1 FLOWERS
Diego Caleiro 1 Machine Intelligence Research Institute
Dmitrii Krasheninnikov 1 Center for Human-Compatible AI
Doina Precup 1 Montreal Institute for Learning Algorithms
Dolapo Martins 1 OpenAI
Duncan Sabien 1 Center for Applied Rationality
Durk Kingma 1 OpenAI
Dustin Tran 1 OpenAI
Dylan Hadfield-Menell 1 University of California, Berkeley
Edgar Barraza 1 OpenAI
Edward Kmett 1 Machine Intelligence Research Institute
Edward Parson 1 UCLA School of Law
Edward W. Felten 1 Google DeepMind
Edwin Evans 1 Machine Intelligence Research Institute
Elena Chatziathanasiadou 1 OpenAI
Eli Tyre 1 Center for Applied Rationality
Eliezer Yudkowsky 1 Machine Intelligence Research Institute
Elizabeth Garrett 1 Center for Applied Rationality
Elizabeth Morningstar 1 Machine Intelligence Research Institute
Elliot Catt 1 Australian National University
Elman Mansimov 1 OpenAI
Elynn Chen 1 OpenAI
Emil Gilliam 1 Machine Intelligence Research Institute
Eric Drexler 1 Future of Humanity Institute
Eric Gastfriend 1 Future of Life Institute
Eric Price 1 OpenAI
Eric Sigler 1 OpenAI
Erica Edelman 1 Machine Intelligence Research Institute
Erik Brynjolfsson 1 Future of Life Institute
Erik Istre 1 Road to AI Safety Excellence
Erika Reinhardt 1 OpenAI
Erin Grant 1 OpenAI
Ethan Knight 1 OpenAI
Evan Erickson 1 Machine Intelligence Research Institute
Evan Hubinger 1 Machine Intelligence Research Institute
Fatma Tarlaci 1 OpenAI
Felix Berkenkamp 1 ETH Zurich
Filip Wolski 1 OpenAI
Finan Adamson 1 AI Impacts
Florian Golemo 1 FLOWERS
Frank Adamek 1 Machine Intelligence Research Institute
Frank Wilczek 1 Future of Life Institute
Frederick Eberhardt 1 California Institute of Technology
Freek Stulp 1 FLOWERS
Fuxin Li 1 Georgia Institute of Technology
G Gordon Worley III 1 Phenomenological AI Safety Research Institute
Gary Drescher 1 Machine Intelligence Research Institute
Gary Lea 1 Australian National University
Gavan Woolery 1 OpenAI
Gennaro Raiola 1 FLOWERS
Geoffrey Irving 1 OpenAI
George Church 1 Future of Life Institute
Gina Stuessy 1 Berkeley Existential Risk Initiative
Glenn Powell 1 OpenAI
Grant Wilson 1 Global Catastrophic Risk Institute
Greg Brockman 1 OpenAI
Gregory C. Allen 1 Center for a New American Security
Grzegorz Orwiński 1 Future of Life Institute
Guillaume Duceux 1 FLOWERS
H. Orri Stefánsson 1 Institute for Future Studies
Han Zhang 1 OpenAI
Hanjun Dai 1 OpenAI
Hannah Davis 1 OpenAI
Harmanas Chopra 1 LessWrong 2.0
Harri Edwards 1 OpenAI
Harrison Willey 1 Machine Intelligence Research Institute
Haydn Belfield 1 Centre for the Study of Existential Risk
Helen (Mengxin) Ji 1 OpenAI
Henrik Jonsson 1 Machine Intelligence Research Institute
Henrique Pondé 1 OpenAI
Henry Shevlin 1 Leverhulme Centre for the Future of Intelligence
Hideyuki Nakashima 1 Whole Brain Architecture Initiative
Hiroshi Yamakawa 1 Whole Brain Architecture Initiative
Hiroyuki Morikawa 1 Whole Brain Architecture Initiative
Holly Grimm 1 OpenAI
Hyrum Anderson 1 Endgame
Ian Atha 1 OpenAI
Ian Goodfellow 1 OpenAI
Ifu Aniemeka 1 OpenAI
Igor Mordatch 1 OpenAI
Ilge Akkaya 1 OpenAI
Ilya Sutskever 1 OpenAI
Ingmar Kanitscheider 1 OpenAI
Ioven Fables 1 Machine Intelligence Research Institute
Jack Carroll 1 Center for Applied Rationality
Jack Clark 1 OpenAI
Jack Gallagher 1 Machine Intelligence Research Institute
Jacob Beebe 1 Future of Life Institute
Jacob Hilton 1 OpenAI
Jacob Jackson 1 OpenAI
Jacob Trefethen 1 Future of Life Institute
Jacob Tsimerman 1 Berkeley Existential Risk Initiative
Jade Leung 1 Future of Humanity Institute
Jake Miller 1 Machine Intelligence Research Institute
Jake Moskowitz 1 Machine Intelligence Research Institute
Jakob Foerster 1 OpenAI
Jakub Pachocki 1 OpenAI
James M. Joyce 1 University of Michigan
James Manyika 1 Google DeepMind
James Miller 1 Machine Intelligence Research Institute
James Payor 1 Machine Intelligence Research Institute
Jan Feyereisl 1 GoodAI
Jan Kulveit 1 AI Safety Camp
Janet Brown 1 OpenAI
Janine Korovesis 1 OpenAI
Jarryd Martin 1 Australian National University
Jasen Murray 1 Machine Intelligence Research Institute
Jason Levin 1 Machine Intelligence Research Institute
Jason Peng 1 OpenAI
Jean Harb 1 OpenAI
Jed McCaleb 1 Machine Intelligence Research Institute
Jeff Alexander 1 Machine Intelligence Research Institute
Jeff Arnold 1 OpenAI
Jeff Medina 1 Machine Intelligence Research Institute
Jeffrey D. Sachs 1 Google DeepMind
Jeffrey Ding 1 Future of Humanity Institute
Jeffrey Wu 1 OpenAI
Jenann Ismael 1 University of Arizona
Jeremy Miller 1 Machine Intelligence Research Institute
Jerry Tworek 1 OpenAI
Jesse Liptrap 1 Machine Intelligence Research Institute
Jessica Cooper 1 AI Safety Camp
Jessica Taylor 1 Machine Intelligence Research Institute
Jiaming Song 1 OpenAI
Jie Tang 1 OpenAI
Jiji Zhang 1 Lingnan University
Jim Babcock 1 Cornell University
Jirí Nadvorník 1 AI Safety Camp
Joanna Bryson 1 University of Bath
Joelle Pineau 1 Montreal Institute for Learning Algorithms
Johannes Otterbach 1 OpenAI
Johannes Treutlein 1 Centre for Effective Altruism
John Schulman 1 OpenAI
John Shawe-Taylor 1 University College London
Jonas Lamis 1 Machine Intelligence Research Institute
Jonas Schneider 1 OpenAI
Jonathan Gray 1 OpenAI
Jonathan Hernandez 1 OpenAI
Jonathan Ho 1 OpenAI
Jonathan Michaux 1 OpenAI
Jonathan Raiman 1 OpenAI
Jonathan Wang 1 Machine Intelligence Research Institute
Jonathan Yan 1 Real AI
Jordan Tirrell 1 Center for Applied Rationality
José Hernández-Orallo 1 Leverhulme Centre for the Future of Intelligence
Josh Jacobson 1 Berkeley Existential Risk Initiative
Josh Meier 1 OpenAI
Josh Tobin 1 OpenAI
Joshua Achiam 1 OpenAI
Joshua Fox 1 Machine Intelligence Research Institute
Julia Galef 1 OpenAI
Julia Haas 1 Washington University in St. Louis
Justin Wang 1 OpenAI
Justis Mills 1 AI Impacts
Kaleo Hao 1 OpenAI
Kanta Dihal 1 Leverhulme Centre for the Future of Intelligence
Karina Vold 1 Leverhulme Centre for the Future of Intelligence
Karl Cobbe 1 OpenAI
Karson Elmgren 1 OpenAI
Karthik Narasimhan 1 OpenAI
Kate Miltenberger 1 OpenAI
Katie Steele 1 London School of Economics
Kay Firth-Butterfield 1 Leverhulme Centre for the Future of Intelligence
Kaya Stechly 1 Machine Intelligence Research Institute
Kazue Evans 1 Future of Life Institute
Keefe Roedersheimer 1 Machine Intelligence Research Institute
Kemal Eren 1 Machine Intelligence Research Institute
Kenji Doya 1 Whole Brain Architecture Initiative
Kenny Easwaran 1 Texas A&M University
Kenzi Amodei 1 Berkeley Existential Risk Initiative
Kevin Fischer 1 Machine Intelligence Research Institute
Kevin Frans 1 OpenAI
Kevin Wong 1 OpenAI
Kitano Hiroaki 1 Whole Brain Architecture Initiative
Koichi Takahashi 1 Whole Brain Architecture Initiative
Koji Morikawa 1 Whole Brain Architecture Initiative
Kristian Rönn 1 Convergence Analysis
Kristina Nemcova 1 AI Safety Camp
Kurt Brown 1 Machine Intelligence Research Institute
Larissa Schiavo 1 OpenAI
Lauren Lee 1 Center for Applied Rationality
Lei Zhang 1 OpenAI
Lerrel Pinto 1 OpenAI
Lila Rieber 1 Machine Intelligence Research Institute
Lilian Weng 1 OpenAI
Lincoln Quirk 1 Machine Intelligence Research Institute
Linda Linsefors 1 Machine Intelligence Research Institute
Linxi Fan 1 OpenAI
Liron Shapira 1 Machine Intelligence Research Institute
Loïc Dauphin 1 FLOWERS
Long Ouyang 1 Theiss Research
Louie Helm 1 Machine Intelligence Research Institute
Louis-Charles Caron 1 FLOWERS
Louise Cabansay 1 OpenAI
Lucas Perry 1 Future of Life Institute
Lucy Cheke 1 Leverhulme Centre for the Future of Intelligence
Ludwig Pettersson 1 OpenAI
Lukas Gloor 1 Foundational Research Institute
Luke Grecki 1 Machine Intelligence Research Institute
Luke Muehlhauser 1 Machine Intelligence Research Institute
Luke Raskopf 1 Center for Applied Rationality
Maciej Chociej 1 OpenAI
Maddie Hall 1 OpenAI
Manuel Lopes 1 FLOWERS
Manuel Sherbakoff 1 OpenAI
Manuela M. Veloso 1 Leverhulme Centre for the Future of Intelligence
Manuela Veloso 1 Carnegie Mellon University
Maran Nelson 1 OpenAI
Marcin Andrychowicz 1 OpenAI
Marcus Hutter 1 Australian National University
Marek Havrda 1 GoodAI
Marek Rosa 1 GoodAI
Mariah Wang 1 Machine Intelligence Research Institute
Marie La 1 OpenAI
Marika Allely 1 OpenAI
Mark Fusco 1 Global Catastrophic Risk Institute
Mark Nitzberg 1 Center for Human-Compatible AI
Mark S. Miller 1 Foresight Institute
Marta Halina 1 Leverhulme Centre for the Future of Intelligence
Maruan Al-Shedivat 1 OpenAI
Masaru Tomita 1 Whole Brain Architecture Initiative
Mateusz Litwin 1 OpenAI
Mathew Shrwed 1 OpenAI
Matt Krisiloff 1 OpenAI
Matthias Plappert 1 OpenAI
Matthieu Lapeyre 1 FLOWERS
Max Kesin 1 Future of Life Institute
Maxim Sokolov 1 OpenAI
Meia Chita-Tegmark 1 Future of Life Institute
Meredith Blankenship 1 OpenAI
Michael A. Osborne 1 Leverhulme Centre for the Future of Intelligence
Michael Anissimov 1 Machine Intelligence Research Institute
Michael Blume 1 Machine Intelligence Research Institute
Michael Janner 1 University of California, Berkeley
Michael Page 1 OpenAI
Michael Petrov 1 OpenAI
Michael Raimondi 1 Machine Intelligence Research Institute
Michael Roy Ames 1 Machine Intelligence Research Institute
Michael Smith 1 Center for Applied Rationality
Michaël Trazzi 1 Sorbonne University
Michael Vassar 1 Machine Intelligence Research Institute
Michael Webb 1 Stanford University
Michael Wilson 1 Machine Intelligence Research Institute
Michael Wooldridge 1 University of Oxford
Michael Wulfsohn 1 AI Impacts
Michał Staniszewski 1 OpenAI
Mikael Böörs 1 Linköping University
Mikhail Pavlov 1 OpenAI
Milan Griffes 1 Ought
Miljan Martic 1 Google DeepMind
Minda Myers 1 Machine Intelligence Research Institute
Mira Murati 1 OpenAI
Mor Katz 1 OpenAI
Morgan Freeman 1 Future of Life Institute
Moshe Looks 1 Machine Intelligence Research Institute
Moshe Vardi 1 Rice University
Munashe Shumba 1 OpenAI
Mustafa Suleyman 1 Google DeepMind
Na Li 1 Future of Life Institute
Nadja Rhodes 1 OpenAI
Nancy Otero 1 OpenAI
Nate Soares 1 Machine Intelligence Research Institute
Nate Thomas 1 Machine Intelligence Research Institute
Nathan Clark 1 Machine Intelligence Research Institute
Neil Jacobstein 1 Machine Intelligence Research Institute
Neil Lawrence 1 Leverhulme Centre for the Future of Intelligence
Nell Watson 1 EthicsNet
Nevin Freeman 1 Machine Intelligence Research Institute
Nick Tarleton 1 Machine Intelligence Research Institute
Nickolai Leschov 1 Machine Intelligence Research Institute
Nicolas Jahier 1 FLOWERS
Nicolas Papernot 1 OpenAI
Nicolas Rabault 1 FLOWERS
Niel Bowerman 1 Future of Humanity Institute
Nikhil Mishra 1 OpenAI
Nikolas Tezak 1 OpenAI
Nisan Stiennon 1 Machine Intelligence Research Institute
Noah D. Goodman 1 Stanford University
Noah Goodman 1 Ought
Noam Brown 1 Carnegie Mellon University
Oleg Klimov 1 OpenAI
Olga Afanasjeva 1 GoodAI
Owen Cotton-Barratt 1 Centre for Effective Altruism
Pamela Vagata 1 OpenAI
Panagiotis Papadakis 1 FLOWERS
Parnian Barekatain 1 OpenAI
Patrick Robotham 1 Machine Intelligence Research Institute
Paul Scharre 1 Center for a New American Security
Pedro A. Ortega 1 Google DeepMind
Pedro Chaves 1 Machine Intelligence Research Institute
Pei Wang 1 NARS
Pejman Makhfi 1 Machine Intelligence Research Institute
Percy Liang 1 Stanford University
Pete Michaud 1 Center for Applied Rationality
Peter Asaro 1 The New School
Peter Cheeseman 1 Machine Intelligence Research Institute
Peter Chen 1 OpenAI
Peter de Blanc 1 Machine Intelligence Research Institute
Peter Eckersley 1 Electronic Frontier Foundation
Peter Haas 1 Future of Life Institute
Peter Scheyer 1 Machine Intelligence Research Institute
Peter Thiel 1 Machine Intelligence Research Institute
Peter Welinder 1 OpenAI
Peter Zhokhov 1 OpenAI
Philip Pettit 1 Leverhulme Centre for the Future of Intelligence
Phillip Isola 1 OpenAI
Pierre Rouanet 1 FLOWERS
Pierre-Yves Oudeyer 1 FLOWERS
Prafulla Dhariwal 1 OpenAI
Preston Greene 1 Nanyang Technological University
Przemysław Dębiak 1 OpenAI
Qiming Yuan 1 OpenAI
Quirin Fischer 1 OpenAI
Rachel Fong 1 OpenAI
Rafael Martinez-Galarza 1 Future of Life Institute
Rafał Józefowicz 1 OpenAI
Randal Koene 1 Machine Intelligence Research Institute
Ray Briggs 1 Stanford University
Ray Kurzweil 1 Machine Intelligence Research Institute
Raymond Arnold 1 LessWrong 2.0
Rebecca Crootof 1 Information Society Project
Rebecca Raible 1 Berkeley Existential Risk Initiative
Reid Hoffman 1 OpenAI
Rein Houthooft 1 OpenAI
Remco Bloemen 1 EthicsNet
Remco Zwetsloot 1 OpenAI
Rewon Child 1 OpenAI
Richard Chen 1 OpenAI
Richard Loosemore 1 Susaro
Richard Mallah 1 Future of Life Institute
Richard Neal 1 Machine Intelligence Research Institute
Richard Re 1 UCLA School of Law
Rick Korzekwa 1 AI Impacts
Rob Bensinger 1 Machine Intelligence Research Institute
Robert de Neufville 1 Global Catastrophic Risk Institute
Robert Miles 1 Road to AI Safety Excellence
Robert Mushkatblat 1 Machine Intelligence Research Institute
Robert V. Brazell 1 Machine Intelligence Research Institute
Robert Zahra 1 Machine Intelligence Research Institute
Rocky Duan 1 OpenAI
Roger Grosse 1 University of Toronto
Rohin Shah 1 Center for Human-Compatible AI
Roko Mijic 1 Machine Intelligence Research Institute
Ronja Lutz 1 AI Impacts
Roxanne Heston 1 Future of Humanity Institute
Rune Nyrup 1 Leverhulme Centre for the Future of Intelligence
Rupert McCallum 1 Road to AI Safety Excellence
Ruth Fong 1 University of Oxford
Ryan Lowe 1 OpenAI
Sabine Atkins 1 Machine Intelligence Research Institute
Sadhika Malladi 1 OpenAI
Sam Altman 1 OpenAI
Sam Bankman-Fried 1 Berkeley Existential Risk Initiative
Sam Eisenstat 1 Machine Intelligence Research Institute
Sam McCandlish 1 OpenAI
Sandy Huang 1 OpenAI
Sarah Dillon 1 Leverhulme Centre for the Future of Intelligence
Satinder Singh Baveja 1 Center for Human-Compatible AI
Saul Perlmutter 1 Future of Life Institute
Scott Garrabrant 1 Machine Intelligence Research Institute
Scott Gray 1 OpenAI
Sean Holden 1 Centre for the Study of Existential Risk
Sean Legassick 1 Google DeepMind
Sebastian Farquhar 1 Future of Humanity Institute
Sebastian Nickel 1 Machine Intelligence Research Institute
Sébastien Forestier 1 FLOWERS
Sergey Levine 1 University of California, Berkeley
Seth Herd 1 University of Colorado
Seth J. Herd 1 eCortex
Shahar Avin 1 Centre for the Study of Existential Risk
Shane Legg 1 Google DeepMind
Shariq Hashme 1 OpenAI
Shimon Whiteson 1 OpenAI
Shivon Zilis 1 OpenAI
Shun Liao 1 OpenAI
Siddharth Srivastava 1 Center for Human-Compatible AI
Simon Beard 1 Centre for the Study of Existential Risk
Sofia Davis-Fogel 1 Berkeley Existential Risk Initiative
Sophia Arakelyan 1 OpenAI
Sören Mindermann 1 Future of Humanity Institute
Stan Franklin 1 Learning Intelligent Distribution Agent
Stanislas Sochacki 1 Machine Intelligence Research Institute
Stefano Ermon 1 Stanford University
Stephan Hartmann 1 Ludwig Maximilian University of Munich
Stéphanie Noirpoudre 1 FLOWERS
Stephen Barnes 1 Machine Intelligence Research Institute
Stephen Cave 1 Leverhulme Centre for the Future of Intelligence
Stephen J. Read 1 University of Southern California
Stephen John 1 Leverhulme Centre for the Future of Intelligence
Steve Rayhawk 1 Machine Intelligence Research Institute
Steven Kaas 1 Machine Intelligence Research Institute
Steven Umbrello 1 Institute of Ethics and Emerging Technologies
Sue Yoon 1 OpenAI
Susan Fonseca-Klein 1 Machine Intelligence Research Institute
Susan Gowans 1 Leverhulme Centre for the Future of Intelligence
Susan Zhang 1 OpenAI
Szymon Sidor 1 OpenAI
Taco Cohen 1 OpenAI
Taehoon Kim 1 OpenAI
Tamas Madl 1 Learning Intelligent Distribution Agent
Tamay Besiroglu 1 Future of Humanity Institute
Tambet Matiisen 1 OpenAI
Tameem Adel 1 Leverhulme Centre for the Future of Intelligence
Tamim Asfour 1 OpenAI
Tania Lombrozo 1 Center for Human-Compatible AI
Tasha McCauley 1 OpenAI
Tegan McCaslin 1 AI Impacts
Théo Segonds 1 FLOWERS
Thibaut Munzer 1 FLOWERS
Thomas Anthony 1 OpenAI
Thomas Colthurst 1 Machine Intelligence Research Institute
Thomas D. Grant 1 Leverhulme Centre for the Future of Intelligence
Thomas Dietterich 1 Oregon State University
Thomas Icard 1 Stanford University
Thomas McCabe 1 Machine Intelligence Research Institute
Thomas Zeitzoff 1 American University
Thore Graepel 1 Google DeepMind
Tim Crane 1 Centre for the Study of Existential Risk
Tim Czech 1 Machine Intelligence Research Institute
Tim Salimans 1 OpenAI
Tim Shi 1 OpenAI
Timothy Telleen-Lawton 1 Center for Applied Rationality
Tobias Wängberg 1 Linköping University
Todor Markov 1 OpenAI
Tom Griffiths 1 Center for Human-Compatible AI
Tom Kalil 1 University of California, Berkeley
Tomer Kagan 1 Machine Intelligence Research Institute
Tony Barrett 1 Global Catastrophic Risk Institute
Toon Alfrink 1 Road to AI Safety Excellence
Topher Brennan 1 Machine Intelligence Research Institute
Tor Lattimore 1 University of Alberta
Trapit Bansal 1 OpenAI
Trent Fowler 1 Road to AI Safety Excellence
Trevor Blackwell 1 OpenAI
Trevor White 1 Global Catastrophic Risk Institute
Tucker Davey 1 Future of Life Institute
Tyler Emerson 1 Machine Intelligence Research Institute
Tyler Neylon 1 OpenAI
Ulrike Hahn 1 Birkbeck, University of London
Vanessa Kosoy 1 Machine Intelligence Research Institute
Veerle de Goederen 1 Road to AI Safety Excellence
Vera Koroleva 1 Future of Life Institute
Verity Harding 1 Google DeepMind
Vicki Cheung 1 OpenAI
Vikash Kumar 1 OpenAI
Vincent C. Müller 1 Future of Humanity Institute
Vincent Conitzer 1 Duke University
Vincent Fagot 1 Machine Intelligence Research Institute
Vipul Naik 1 Machine Intelligence Research Institute
Vishal Maini 1 Google DeepMind
Vladimir Nesov 1 Machine Intelligence Research Institute
Vladimir Shakirov 1 Moscow Institute of Physics and Technology
Vladimir Slepnev 1 Google
Wendell Wallach 1 Yale University
Will Grathwohl 1 OpenAI
Will Newsome 1 Machine Intelligence Research Institute
Will Rice 1 OpenAI
William Saunders 1 Future of Humanity Institute
William Schueller 1 FLOWERS
Wlodek Rabinowicz 1 London School of Economics
Wojciech Zaremba 1 OpenAI
Wyatt Tessari 1 Center for Human Success
Xavier Prospero 1 Center for Applied Rationality
Xi Chen 1 OpenAI
Xin Wen 1 Future of Life Institute
Xingyou (Richard) Song 1 OpenAI
Xue Bin Peng 1 OpenAI
Yan Duan 1 OpenAI
Yaroslav Bulatov 1 OpenAI
Yi Wu 1 OpenAI
Yilun Du 1 OpenAI
Yishuai Du 1 Future of Life Institute
Yoan Mollard 1 FLOWERS
Yoshua Bengio 1 Montreal Institute for Learning Algorithms
Yuhao Wan 1 OpenAI
Yuhuai Wu 1 OpenAI
Yuping Luo 1 OpenAI
Yura Burda 1 OpenAI
Yutaka Matsuo 1 Whole Brain Architecture Initiative
Zachary Miller 1 Ought
Zain Shah 1 OpenAI
Zara Yaqoob 1 Future of Life Institute
Zoubin Ghahramani 1 Leverhulme Centre for the Future of Intelligence
Angela P. 0

Positions grouped by organization

Showing 125 organizations.

Organization Number of people List of people
OpenAI 221 Alex Paino, Ilge Akkaya, Jerry Tworek, Mor Katz, Nikolas Tezak, Karson Elmgren, Maxim Sokolov, Edgar Barraza, Janet Brown, Yuhao Wan, Helen (Mengxin) Ji, Elynn Chen, Nancy Otero, Jonathan Michaux, Fatma Tarlaci, Christina Hendrickson, Danny Hernandez, Bianca Martin, Ben Chess, Qiming Yuan, Mateusz Litwin, Justin Wang, Janine Korovesis, Clemens Winter, Amanda Askell, Todor Markov, Ian Atha, Lei Zhang, Christopher Olah, Mikhail Pavlov, Jacob Hilton, Taehoon Kim, Maddie Hall, Sue Yoon, Jacob Jackson, Jeffrey Wu, Arthur Petron, Brad Lightcap, Ingmar Kanitscheider, Gillian Hadfield, Michał Staniszewski, Sophia Arakelyan, Nadja Rhodes, Munashe Shumba, Ifu Aniemeka, Holly Grimm, Hannah Davis, Dolapo Martins, Mira Murati, Xingyou (Richard) Song, Johannes Otterbach, Josh Meier, Yilun Du, Karl Cobbe, Christine McLeavey Payne, Ethan Knight, Will Rice, Sam McCandlish, Daniel Ziegler, Susan Zhang, Michael Petrov, Hanjun Dai, Sadhika Malladi, Aravind Srinivas, Erin Grant, Will Grathwohl, Peter Zhokhov, Thomas Anthony, Aleksandar Botev, Elena Chatziathanasiadou, Rewon Child, Eric Sigler (this list is partial)
Machine Intelligence Research Institute 176 James Payor, Edward Kmett, Victoria Krakovna, Ben Weinstein-Raun, Alex Zhu, David Simmons, Alex Mennen, Linda Linsefors, Evan Hubinger, Daniel Demski, Alex Appel, Colm Ó Riain, Alex Vermeer, Qiaochu Yuan, Buck Shlegeris, Blake Borgeson, Nick Tarleton, Kurt Brown, Jesse Liptrap, Benjamin Mann, Tsvi Benson-Tilsen, Abram Demski, Sam Eisenstat, Jeremy Schlatter, Jan Leike, Andrew Critch, Matthew Graves, Ryan Carey, Connor Flexman, Aaron Silverbook, Gary Drescher, Malo Bourgon, Katja Grace, Scott Garrabrant, Andrew Lapinski-Barker, Robin Hanson, Jack Gallagher, Vanessa Kosoy, Ramana Kumar, Jaan Tallinn, Jed McCaleb, Bart Selman, Stuart Russell, Nate Thomas, Stuart Armstrong, Jake Moskowitz, Jessica Taylor, Luke Muehlhauser, Jesse Galef, Matthew Fallshaw, Eliezer Yudkowsky, Elizabeth Morningstar, Antonius Lourenço Kasbergen, Lila Rieber, Vipul Naik, Nate Soares, Jimmy Rintjema, Daniel Lewis, Richard Neal, Rob Bensinger, Robert Mushkatblat, Dávid Natingga, Nathan Clark, Roman Yampolskiy, Moshe Looks, James Miller, Randal Koene, Seth Baum, Steve Omohundro, Evan Erickson (this list is partial)
Future of Life Institute 45 Daniel Dewey, Jacob Trefethen, Chase Moores, Daniel R. Miller, Janos Kramar, Max Kesin, Peter Haas, Melody Guan, Jesse Galef, Ales Flidr, Zara Yaqoob, Yishuai Du, Xin Wen, Vera Koroleva, Rafael Martinez-Galarza, Na Li, Kazue Evans, Jacob Beebe, Grzegorz Orwiński, Eric Gastfriend, Alan Yan, David Stanley, Lucas Perry, Richard Mallah, Tucker Davey, Ariel Conn, Frank Wilczek, Stuart Russell, Francesca Rossi, Martin Rees, Saul Perlmutter, Elon Musk, Christof Koch, Stephen Hawking, Alan Guth, Morgan Freeman, George Church, Erik Brynjolfsson, Nick Bostrom, Alan Alda, Meia Chita-Tegmark, Anthony Aguirre, Victoria Krakovna, Max Tegmark, Jaan Tallinn
Future of Humanity Institute 41 Tom McGrath, Ryan Carey, Neal Jean, Girish Sastry, William Saunders, Tamay Besiroglu, David Kristoffersson, David Krueger, John Salvatier, David Abel, Allan Dafoe, Andrew Snyder-Beattie, Carrick Flynn, Daniel Dewey, Daniel Filan, Kyle Scott, Anders Sandberg, Clare Lyle, Sebastian Farquhar, Cecilia Tilli, Vincent C. Müller, Chelsea Guo, Ben Garfinkel, Seán Ó hÉigeartaigh, Katja Grace, Jan Leike, Robin Hanson, Paul Christiano, Carl Shulman, Roxanne Heston, Owain Evans, Baobao Zhang, Miles Brundage, Jeffrey Ding, Eric Drexler, Jade Leung, Stuart Armstrong, Christopher Cundy, Nick Bostrom, Niel Bowerman, Sören Mindermann
Leverhulme Centre for the Future of Intelligence 37 Martina Kunz, Kay Firth-Butterfield, Neil Lawrence, Alan Winfield, Michael A. Osborne, Lucy Cheke, Heather Roff, Beth Singler, José Hernández-Orallo, Tameem Adel, Kanta Dihal, Karina Vold, Henry Shevlin, Rune Nyrup, Sarah Dillon, Susan Gowans, Andrew Snyder-Beattie, Adrian Weller, Thomas D. Grant, Seán Ó hÉigeartaigh, David Runciman, Stephen John, Marta Halina, Anna Alexandrova, Murray Shanahan, Stuart Russell, Nick Bostrom, Stephen Cave, Zoubin Ghahramani, Huw Price, Demis Hassabis, Manuela M. Veloso, Francesca Rossi, Martin Rees, Philip Pettit, Alison Gopnik, Margaret Boden
FLOWERS 31 Alvaro Ovalle Castaneda, Florian Golemo, Benjamin Clément, Sébastien Forestier, William Schueller, Cem Karaoguz, Adrien Matricon, Céline Craye, Alexandra Delmas, Gennaro Raiola, Baptiste Busch, Panagiotis Papadakis, Thibaut Munzer, Guillaume Duceux, Louis-Charles Caron, Damien Caselli, Théo Segonds, Stéphanie Noirpoudre, Loïc Dauphin, Matthieu Lapeyre, Nicolas Rabault, Yoan Mollard, Pierre Rouanet, Nicolas Jahier, Didier Roy, Anna-Lisa Vollmer, Freek Stulp, Alexandre Gepperth, David Filliat, Manuel Lopes, Pierre-Yves Oudeyer
Center for Applied Rationality 26 Xavier Prospero, Brienne Strohl, Luke Raskopf, Gwern Branwen, Tsvi Benson-Tilsen, Timothy Telleen-Lawton, Stephanie Zolayvar, Qiaochu Yuan, Oliver Habryka, Matthew Graves, Jordan Tirrell, Eric Rogstad, Ben Goldhaber, Michael Keenan, Eli Tyre, Ben Sancetta, Adam Scholl, Elizabeth Garrett, Adom Hartell, Jack Carroll, Lauren Lee, Dan Keys, Duncan Sabien, Michael Smith, Anna Salamon, Pete Michaud
Centre for the Study of Existential Risk 25 Martin Rees, Huw Price, Haydn Belfield, Shahar Avin, Seán Ó hÉigeartaigh, Simon Beard, Adrian Weller, Sean Holden, Stephen Hawking, Tim Crane, Max Tegmark, Murray Shanahan, Dana Scott, Stuart Russell, Elon Musk, Alison Gopnik, David Chalmers, Nick Bostrom, Margaret Boden, Ryan Carey, Martina Kunz, Seth Baum, Beth Barnes, Yang Liu, Jaan Tallinn
Berkeley Existential Risk Initiative 21 Sofia Davis-Fogel, Alex Flint, Josh Jacobson, Sam Bankman-Fried, Matthew Fallshaw, Colleen Gleason, Jeremy Schlatter, Jaan Tallinn, Kyle Scott, Rebecca Raible, Kenzi Amodei, Jacob Tsimerman, Qiaochu Yuan, Eric Rogstad, Stuart Russell, Seán Ó hÉigeartaigh, Malo Bourgon, Andrew Snyder-Beattie, Michael Keenan, Gina Stuessy, Andrew Critch
Google DeepMind 21 Vishal Maini, Verity Harding, Sean Legassick, Pedro A. Ortega, Shane Legg, Mustafa Suleyman, Demis Hassabis, Andrew Lefrancq, Tom Everitt, Jan Leike, Miljan Martic, Jeffrey D. Sachs, James Manyika, Christiana Figueres, Edward W. Felten, Diane Coyle, Nick Bostrom, Victoria Krakovna, Laurent Orseau, Chris Maddison, Thore Graepel
Ought 18 Chris Cundy, Girish Sastry, Neal Jean, Ryan Carey, Zac Kenton, Tom McGrath, Ben Weinstein-Raun, Ozzie Gooen, Milan Griffes, Zachary Miller, Ben Goldhaber, Ben West, Andrew Schreiber, Ben Rachbach, Noah Goodman, Paul Christiano, Owain Evans, Andreas Stuhlmüller
Center for Human-Compatible AI 17 Beth Barnes, Dmitrii Krasheninnikov, Christopher Cundy, Rohin Shah, Siddharth Srivastava, Gillian Hadfield, Andrew Critch, Mark Nitzberg, Tania Lombrozo, Satinder Singh Baveja, Michael Wellman, Joseph Halpern, Bart Selman, Tom Griffiths, Anca Dragan, Pieter Abbeel, Stuart Russell
AI Impacts 15 Asya Bergal, Rick Korzekwa, Ronja Lutz, Daniel Kokotajlo, Tegan McCaslin, Stephanie Zolayvar, Ben Hoffman, John Salvatier, Paul Christiano, Jimmy Rintjema, Justis Mills, Connor Flexman, Finan Adamson, Michael Wulfsohn, Katja Grace
University of California, Berkeley 11 Andrew Critch, Pieter Abbeel, Smitha Milli, Dylan Hadfield-Menell, Anca Dragan, Sergey Levine, Paul Christiano, Qiaochu Yuan, Michael Janner, Tom Kalil, Stuart Russell
Stanford University 10 Stefano Ermon, Alex Aiken, Percy Liang, Jacob Steinhardt, Noah D. Goodman, Andreas Stuhlmüller, Thomas Icard, Ray Briggs, Aditi Raghunathan, Michael Webb
Whole Brain Architecture Initiative 9 Koji Morikawa, Hideyuki Nakashima, Hiroyuki Morikawa, Masaru Tomita, Kitano Hiroaki, Kenji Doya, Koichi Takahashi, Yutaka Matsuo, Hiroshi Yamakawa
Global Catastrophic Risk Institute 8 Matthijs Maas, Trevor White, Roman Yampolskiy, Mark Fusco, Grant Wilson, Tony Barrett, Seth Baum, Robert de Neufville
Road to AI Safety Excellence 8 Remmelt Ellen, Trent Fowler, Erik Istre, Rupert McCallum, Robert Miles, Johannes Heidecke, Veerle de Goederen, Toon Alfrink
AI Safety Camp 7 Remmelt Ellen, Jessica Cooper, Kristina Nemcova, Jirí Nadvorník, Anne Wissemann, Jan Kulveit, Johannes Heidecke
Australian National University 7 Tom Everitt, Gary Lea, Alan Hájek, Jan Leike, Marcus Hutter, Elliot Catt, Jarryd Martin
Open Philanthropy Project 7 Daniel Dewey, Helen Toner, Holden Karnofsky, Dario Amodei, Christopher Olah, Jacob Steinhardt, Paul Christiano
Foundational Research Institute 6 Brian Tomasik, Max Daniel, Kaj Sotala, Caspar Oesterheld, Lukas Gloor, Tobias Baumann
LessWrong 2.0 6 Eric Rogstad, Harmanas Chopra, Raymond Arnold, Ben Albert Pace, Matthew Graves, Oliver Habryka
Convergence Analysis 5 Ozzie Gooen, Claire Abu-Assal, Kristian Rönn, Andrew X Stewart, Justin Shovelain
Google Brain 5 Dan Mané, Dario Amodei, Christopher Olah, Melody Guan, Tom Brown
University of Cambridge 5 Ramana Kumar, Arif Ahmed, Huw Price, Yang Liu, Adrian Weller
University of Oxford 5 Owain Evans, Heather Roff, Ruth Fong, Chris Maddison, Michael Wooldridge
Carnegie Mellon University 4 Andre Platzer, David Danks, Noam Brown, Manuela Veloso
EthicsNet 4 Aleksandra Orchowska, Remco Bloemen, Anish Mohammed, Nell Watson
GoodAI 4 Jan Feyereisl, Marek Havrda, Olga Afanasjeva, Marek Rosa
Montreal Institute for Learning Algorithms 4 Zac Kenton, Doina Precup, Joelle Pineau, Yoshua Bengio
Centre for Effective Altruism 3 Johannes Treutlein, Ales Flidr, Owen Cotton-Barratt
Cornell University 3 Jim Babcock, Joseph Halpern, Bart Selman
eCortex 3 Randall C. O’Reilly, Seth J. Herd, David J. Jilk
Foresight Institute 3 Christine Peterson, Mark S. Miller, Allison Duettmann
IDSIA 3 Jürgen Schmidhuber, Bas R. Steunebrink, Mark Ring
SUPSI 3 Jürgen Schmidhuber, Bas R. Steunebrink, Mark Ring
Theiss Research 3 Long Ouyang, Paul Christiano, Kaj Sotala
Università della Svizzera italiana 3 Jürgen Schmidhuber, Bas R. Steunebrink, Mark Ring
Yale University 3 Allan Dafoe, Daniel Eth, Wendell Wallach
AIDEUS 2 Sergey Rodionov, Alexey Potapov
Arizona State University 2 Heather Roff, Miles Brundage
Center for a New American Security 2 Gregory C. Allen, Paul Scharre
Center for Human Success 2 Wyatt Tessari, David Yu
Endgame 2 Hyrum Anderson, Bobby Filar
Google 2 Marcello Herreshoff, Vladimir Slepnev
Learning Intelligent Distribution Agent 2 Tamas Madl, Stan Franklin
Linköping University 2 Mikael Böörs, Tobias Wängberg
London School of Economics 2 Katie Steele, Wlodek Rabinowicz
Ludwig Maximilian University of Munich 2 Stephan Hartmann, Reuben Stern
UCLA School of Law 2 Richard Re, Edward Parson
University College London 2 John Shawe-Taylor, Tobias Baumann
University of Michigan 2 James M. Joyce, Michael Wellman
University of Toronto 2 Roger Grosse, Joshua Gans
University of Wisconsin–Madison 2 Reuben Stern, Patrick LaVictoire
1 Angela P.
Aalto University 1 Jelena Luketina
AgroParisTech 1 Laurent Orseau
Aix-Marseille University 1 Sergey Rodionov
American University 1 Thomas Zeitzoff
Birkbeck, University of London 1 Ulrike Hahn
Brown University 1 David Abel
California Institute of Technology 1 Frederick Eberhardt
Carleton University 1 Andrew MacFie
Center for Analysis & Design of Intelligent Agents 1 Kristinn R. Thórisson
CogPrime 1 Ben Goertzel
Data61 1 Ramana Kumar
Duke University 1 Vincent Conitzer
Effective Altruism Foundation 1 Max Daniel
Electronic Frontier Foundation 1 Peter Eckersley
ETH Zurich 1 Felix Berkenkamp
George Mason University 1 Robin Hanson
Georgia Institute of Technology 1 Fuxin Li
Global Politics of Artificial Intelligence Research Group at Yale University and University of Oxford 1 Matthijs Maas
Hague Centre for Strategic Studies 1 Matthijs Maas
Harvard University 1 David Parkes
Icelandic Institute for Intelligent Machines 1 Kristinn R. Thórisson
Information Society Project 1 Rebecca Crootof
INRA 1 Laurent Orseau
Institute for Future Studies 1 H. Orri Stefánsson
Institute for Theoretical Studies at ETH Zurich 1 Will Sawin
Institute of Ethics and Emerging Technologies 1 Steven Umbrello
Internet Archive 1 Brewster Kahle
ITMO University 1 Alexey Potapov
Lingnan University 1 Jiji Zhang
Massachusetts Institute of Technology 1 Jon Gauthier
Moscow Institute of Physics and Technology 1 Vladimir Shakirov
Munich Center for Mathematical Philosophy 1 Catrin Campbell-Moore
Nanyang Technological University 1 Preston Greene
NARS 1 Pei Wang
National Bureau of Economic Research 1 Joshua Gans
New America Foundation 1 Heather Roff
Nilcons 1 Mihaly Barasz
NNAISENSE 1 Bas R. Steunebrink
Oregon State University 1 Thomas Dietterich
Phenomenological AI Safety Research Institute 1 G Gordon Worley III
Princeton University 1 Will Sawin
Quixey 1 Patrick LaVictoire
Real AI 1 Jonathan Yan
Rice University 1 Moshe Vardi
Self-Aware Systems 1 Steve Omohundro
Social & Environmental Entrepreneurs 1 Seth Baum
Sorbonne University 1 Michaël Trazzi
Susaro 1 Richard Loosemore
Texas A&M University 1 Kenny Easwaran
The New School 1 Peter Asaro
Université de Montréal 1 Jelena Luketina
University of Alberta 1 Tor Lattimore
University of Arizona 1 Jenann Ismael
University of Bath 1 Joanna Bryson
University of Bristol 1 Benya Fallenstein
University of Colorado 1 Seth Herd
University of Colorado Boulder 1 Randall C. O’Reilly
University of Copenhagen 1 Matthijs Maas
University of Denver 1 Heather Roff
University of Edinburgh 1 Angelo Frank De Bellis
University of Illinois at Chicago 1 Brian Ziebart
University of Louisville 1 Roman Yampolskiy
University of Melbourne 1 Benjamin Rubinstein
University of Montreal 1 Janos Kramar
University of New Hampshire 1 Andrew Ware
University of Padova 1 Francesca Rossi
University of Southern California 1 Stephen J. Read
University of Washington 1 Daniel Weld
Washington University in St. Louis 1 Julia Haas

Individuals not affiliated with any organization

Showing 18 people.

Organization Website Source
Wei Dai http://www.weidai.com/ [1], [2]
Iceman [3], [4], [5], [6], [7]
Max Harms http://raelifin.com/ [8], [7]
Jeff Kaufman https://www.jefftk.com [9], [7]
Federico Pistono http://federicopistono.org/ [10]
Chris Pasek [11], [12]
Sune Kristian Jakobsen
Hilary Greaves [13]
Sophie-Charlotte Fischer [14]
Alexey Turchin https://avturchin.livejournal.com/ [15], [16], [17], [18]
Dustin Juliano http://dustinjuliano.com/ [19], [20]
Matteo Turchetta [21]
Angela P. Schoellig [21]
Andreas Krause [21]
Jim O’Neill [22]
Gordon Irlam http://www.gordoni.com/ [23]
Nandi Schoots [12]
John Maxwell [24]

Products

This section lists AI safety-related “products”: interactive tools, websites, flowcharts, datasets, etc. Unlike documents, products tend to be interactive, are updated continually, or require inputs from the consumer.

Showing 33 products.

Name Type Creator Creation date Description
Clarifying some key hypotheses in AI alignment diagram Ben Cottier, Rohin Shah 2019-08-15 A diagram collecting several hypotheses in AI alignment and their relationships to existing research agendas.
AI Alignment Forum blog LessWrong 2.0 2018-07-10 A group blog for discussion of technical aspects of AI alignment. The forum is built using the same software as LessWrong 2.0, and is integrated with LessWrong 2.0. For creation date, see [25].
AI Safety Research Camp workshop Tom McGrath, Remmelt Ellen, Linda Linsefors, Nandi Schoots, David Kristoffersson, Chris Pasek 2018-02-01 A research camp to take place in Gran Canaria in April 2018 and in the United Kingdom in July–August 2018. Facebook group at [26]. The creation date is the date of announcement on LessWrong 2.0.
“Levels of defense” in AI safety flowchart Alexey Turchin 2017-12-12 A flowchart applying multilevel defense to AI safety. There is an accompanying post on LessWrong at [27].
AI Alignment Prize contest Zvi Mowshowitz, Vladimir Slepnev, Paul Christiano 2017-11-03 A prize for work that advances understanding in alignment of smarter-than-human artificial intelligence. Winners for the first round, as well as announcement of the second round, can be found at [24]. Winners for the second round, as well as announcement of the third round, can be found at [28].
AI Watch interactive application Issa Rice 2017-10-23 A website to track people and organizations working on AI safety.
AI Safety Open Discussion discussion group Mati Roy 2017-10-23 A Facebook discussion group about AI safety. This is an open group.
AI safety resources list Victoria Krakovna 2017-10-01 A list of resources for long-term AI safety. Seems to have been first announced at [29].
Map of the AI Safety Community graphic Søren Elverlin 2017-09-26 A pictorial map that lists organizations and individuals in the AI safety community.
Open Philanthropy Project AI Fellows Program fellowship Open Philanthropy Project 2017-09-12 A fellowship to support PhD students in AI and machine learning. For the creation date, see [30].
LessWrong 2.0 blog LessWrong 2.0 2017-06-18 A community blog about rationality, decision theory, AI, the rationality community, and other topics relevant to AI safety. This is a re-launch/modernization of the original LessWrong. For the launch date, the date of the welcome post [31] is used.
Road to AI Safety Excellence course Toon Alfrink 2017-06-15 A proposed course that is designed to produce AI safety researchers. It used to be called “Accelerating AI Safety Adoption in Academia” and was announced on LessWrong at [32]. The Facebook group was created on 2017-06-30 [33].
Annotated bibliography of recommended materials list Center for Human-Compatible AI 2016-12-01 An annotated and interactive bibliography of AI safety-related course materials, textbooks, videos, papers, etc.
Extinction Risk from Artificial Intelligence blog Michael Cohen 2016-06-01 A series of pages exploring arguments for and against working on AI safety. The creation date is inferred from the URLs of images (example: [34]).
AI Alignment blog Paul Christiano 2016-05-28 Paul Christiano’s blog about AI alignment.
AISafety.com Reading Group discussion group Søren Elverlin, Erik B. Jacobsen, Volkan Erdogan 2016-05-24 A weekly reading group covering topics in AI safety.
Cause prioritization app interactive application Michael Dickens, Buck Shlegeris 2016-05-18 An interactive app for quantitative cause prioritization. The app includes a section [35] on AI safety intervention. The creation date is the date of the first commit in the Git repository [36].
Arbital AI alignment domain wiki Arbital, Eliezer Yudkowsky 2016-03-04 A collection of wiki-like pages on topics in AI alignment. The creation date is the date of the launch announcement for Arbital [37]; it’s unclear when the AI alignment domain itself was created.
Introductory resources on AI safety research list Victoria Krakovna 2016-02-28 A list of readings on long-term AI safety. Mirrored at [38]. There is an updated list at [39].
AI Safety Discussion discussion group Victoria Krakovna 2016-02-21 A Facebook discussion group about AI safety. This is a closed group so one needs to request access to see posts.
Reinforce.js implementation of Stuart Armstrong’s toy control problem interactive application Gwern Branwen, FeepingCreature 2016-02-03 A live demo of Stuart Armstrong’s toy control problem [40]. gwern introduced the demo in a LessWrong comment [41].
AI Policies Wiki wiki Gordon Irlam 2015-12-14 A wiki on AI policy. The wiki creation date can be seen in the revision history of the main page [42].
The Control Problem discussion group CyberPersona 2015-08-29 A subreddit about AI safety and control. For the subreddit creation date, see [43].
AGI Failures Modes and Levels map flowchart Alexey Turchin 2015-01-01 A flowchart about failure modes of artificial general intelligence, grouped by the stage of development. There is an accompanying post on LessWrong at [18].
AGI Safety Solutions Map flowchart Alexey Turchin 2015-01-01 A flowchart on potential solutions to AI safety. There is an accompanying post on LessWrong at [44].
Intelligent Agent Foundations Forum discussion group Machine Intelligence Research Institute 2014-11-04 A forum for technical AI safety research. The source code is hosted on GitHub [45]. The timestamp on the introductory post [46] gives the launch date.
A flowchart of AI safety considerations flowchart Eliezer Yudkowsky 2014-11-02 The flowchart was posted to Eliezer Yudkowsky’s Essays (a Facebook group) and has no title.
Effective Altruism Forum blog Centre for Effective Altruism, Rethink Charity, Ryan Carey 2014-09-10 A community blog about effective altruism which often has posts about AI safety. The forum was announced on LessWrong by Ryan Carey [47].
How to study superintelligence strategy list Luke Muehlhauser 2014-07-03 A list of project ideas in superintelligence strategy.
Ordinary Ideas blog Paul Christiano 2011-12-21 Paul Christiano’s blog about “weird AI stuff” [48].
The Uncertain Future interactive application Machine Intelligence Research Institute 2009-10-01 A tool to model future technology and its effect on civilization. For more about the history of the site, see [49].
LessWrong Wiki wiki Machine Intelligence Research Institute 2009-03-12 A companion wiki to the community blog LessWrong. The wiki has pages about AI safety.
LessWrong blog Machine Intelligence Research Institute 2009-02-01 A community blog about rationality, decision theory, AI, updates to MIRI, among other topics.