AI Watch

Welcome! This is a website to track people and organizations working on AI safety. See the code repository for the source code and data of this website.

This website is developed by Issa Rice and has been partially funded by Vipul Naik.

If you like (or want to like) this website and have money: the current funder doesn't want to continue funding this project. As a result, it is currently mostly sitting around. If you want to bring this site to the next level, contact Issa at riceissa@gmail.com. What you get: site improvements, recognition in the site credits. What the site needs: money.

If you have time and want experience building websites: this website is looking for contributors. If you want to help out, contact Issa at riceissa@gmail.com. What you get: little or no pay (this could change if the site gets funding; see previous paragraph), recognition in the site credits, privilege of working with me, knowledge of the basics of web development (MySQL, PHP, Git). What the site needs: data collection/entry and website code improvements.

Last updated on 2019-06-25.

Table of contents

Agendas

Agenda name Associated people Associated organizations
Iterated amplification Paul Christiano, Buck Shlegeris, Dario Amodei OpenAI
Embedded agency Eliezer Yudkowsky, Scott Garrabrant, Abram Demski Machine Intelligence Research Institute
Comprehensive AI services Eric Drexler Future of Humanity Institute
Ambitious value learning Stuart Armstrong Future of Humanity Institute
Factored cognition Andreas Stuhlmüller Ought
Recursive reward modeling Jan Leike, David Krueger, Tom Everitt, Miljan Martic, Vishal Maini, Shane Legg Google DeepMind
Debate Paul Christiano OpenAI
Interpretability Christopher Olah
Inverse reinforcement learning
Preference learning
Cooperative inverse reinforcement learning
Imitation learning
Alignment for advanced machine learning systems Jessica Taylor, Eliezer Yudkowsky, Patrick LaVictoire, Andrew Critch Machine Intelligence Research Institute
Learning-theoretic AI alignment Vanessa Kosoy
Counterfactual reasoning Jacob Steinhardt

Positions grouped by person

Showing 250 people with positions.

Name Number of organizations List of organizations
Paul Christiano 6 AI Impacts, Machine Intelligence Research Institute, Open Philanthropy Project, OpenAI, Ought, Theiss Research
Oliver Habryka 3 Center for Applied Rationality, LessWrong 2.0, Machine Intelligence Research Institute
Ryan Carey 3 Centre for the Study of Existential Risk, Machine Intelligence Research Institute, Ought
Andrew Critch 2 Berkeley Existential Risk Initiative, Machine Intelligence Research Institute
Ben Weinstein-Raun 2 Machine Intelligence Research Institute, Ought
Beth Barnes 2 Center for Human-Compatible AI, Centre for the Study of Existential Risk
Chris Maddison 2 Google DeepMind, University of Oxford
Christopher Olah 2 Open Philanthropy Project, OpenAI
Connor Flexman 2 AI Impacts, Machine Intelligence Research Institute
Daniel Dewey 2 Machine Intelligence Research Institute, Open Philanthropy Project
Dario Amodei 2 Open Philanthropy Project, OpenAI
Eric Rogstad 2 Berkeley Existential Risk Initiative, LessWrong 2.0
Jaan Tallinn 2 Centre for the Study of Existential Risk, Machine Intelligence Research Institute
Jeremy Schlatter 2 Berkeley Existential Risk Initiative, Machine Intelligence Research Institute
Jimmy Rintjema 2 AI Impacts, Machine Intelligence Research Institute
Johannes Heidecke 2 AI Safety Camp, Road to AI Safety Excellence
Kaj Sotala 2 Foundational Research Institute, Machine Intelligence Research Institute
Katja Grace 2 AI Impacts, Machine Intelligence Research Institute
Matthew Fallshaw 2 Berkeley Existential Risk Initiative, Machine Intelligence Research Institute
Matthew Graves 2 LessWrong 2.0, Machine Intelligence Research Institute
Nick Bostrom 2 Centre for the Study of Existential Risk, Machine Intelligence Research Institute
Qiaochu Yuan 2 Berkeley Existential Risk Initiative, Machine Intelligence Research Institute
Remmelt Ellen 2 AI Safety Camp, Road to AI Safety Excellence
Stuart Russell 2 Centre for the Study of Existential Risk, Machine Intelligence Research Institute
Tom McGrath 2 Future of Humanity Institute, Ought
Aaron Silverbook 1 Machine Intelligence Research Institute
Abraham Wolk 1 Machine Intelligence Research Institute
Abram Demski 1 Machine Intelligence Research Institute
Aditi Raghunathan 1 Stanford University
Adom Hartell 1 Center for Applied Rationality
Adrian Weller 1 Centre for the Study of Existential Risk
Aleksandra Orchowska 1 EthicsNet
Alex Altair 1 Machine Intelligence Research Institute
Alex Appel 1 Machine Intelligence Research Institute
Alex Mennen 1 Machine Intelligence Research Institute
Alex Vermeer 1 Machine Intelligence Research Institute
Alex Zhu 1 Machine Intelligence Research Institute
Alexey Potapov 1 AIDEUS
Alison Gopnik 1 Centre for the Study of Existential Risk
Alyssa Vance 1 Machine Intelligence Research Institute
Amy Willey 1 Machine Intelligence Research Institute
Anders Sandberg 1 Future of Humanity Institute
Andreas Stuhlmüller 1 Ought
Andrew Hay 1 Machine Intelligence Research Institute
Andrew Lapinski-Barker 1 Machine Intelligence Research Institute
Andrew Rettek 1 Machine Intelligence Research Institute
Andrew Schreiber 1 Ought
Andriy Brodskyy 1 Machine Intelligence Research Institute
Anish Mohammed 1 EthicsNet
Anna Salamon 1 Machine Intelligence Research Institute
Anne Wissemann 1 AI Safety Camp
Antonius Lourenço Kasbergen 1 Machine Intelligence Research Institute
Bart Selman 1 Machine Intelligence Research Institute
Ben Albert Pace 1 LessWrong 2.0
Ben Goertzel 1 Machine Intelligence Research Institute
Ben Goldhaber 1 Ought
Ben Hoffman 1 AI Impacts
Ben Hoskin 1 Machine Intelligence Research Institute
Ben Rachbach 1 Ought
Ben West 1 Ought
Benjamin Mann 1 Machine Intelligence Research Institute
Benya Fallenstein 1 Machine Intelligence Research Institute
Bill Hibbard 1 Machine Intelligence Research Institute
Blake Borgeson 1 Machine Intelligence Research Institute
Brian Tomasik 1 Foundational Research Institute
Brienne Strohl 1 Center for Applied Rationality
Bryan Bishop 1 Machine Intelligence Research Institute
Buck Shlegeris 1 Machine Intelligence Research Institute
Cameron Taylor 1 Machine Intelligence Research Institute
Carl Shulman 1 Machine Intelligence Research Institute
Carson Jones 1 Machine Intelligence Research Institute
Caspar Oesterheld 1 Foundational Research Institute
Chris Cundy 1 Ought
Christine Peterson 1 Machine Intelligence Research Institute
Christopher Cundy 1 Center for Human-Compatible AI
Colleen Gleason 1 Berkeley Existential Risk Initiative
Colm Ó Riain 1 Machine Intelligence Research Institute
Dana Scott 1 Centre for the Study of Existential Risk
Daniel Demski 1 Machine Intelligence Research Institute
Daniel Lewis 1 Machine Intelligence Research Institute
Daniel Roth 1 Machine Intelligence Research Institute
Daniel Ziegler 1 OpenAI
David Chalmers 1 Centre for the Study of Existential Risk
Dávid Natingga 1 Machine Intelligence Research Institute
David Simmons 1 Machine Intelligence Research Institute
Dennis Fan 1 Machine Intelligence Research Institute
Diego Caleiro 1 Machine Intelligence Research Institute
Dmitrii Krasheninnikov 1 Center for Human-Compatible AI
Edward Kmett 1 Machine Intelligence Research Institute
Eliezer Yudkowsky 1 Machine Intelligence Research Institute
Elizabeth Morningstar 1 Machine Intelligence Research Institute
Elon Musk 1 Centre for the Study of Existential Risk
Erica Edelman 1 Machine Intelligence Research Institute
Erik Istre 1 Road to AI Safety Excellence
Ethan Knight 1 OpenAI
Evan Erickson 1 Machine Intelligence Research Institute
Evan Hubinger 1 Machine Intelligence Research Institute
Felix Berkenkamp 1 ETH Zurich
Finan Adamson 1 AI Impacts
Frank Adamek 1 Machine Intelligence Research Institute
Gary Drescher 1 Machine Intelligence Research Institute
Geoffrey Irving 1 OpenAI
Girish Sastry 1 Ought
Gwern Branwen 1 Machine Intelligence Research Institute
Harmanas Chopra 1 LessWrong 2.0
Harrison Willey 1 Machine Intelligence Research Institute
Haydn Belfield 1 Centre for the Study of Existential Risk
Henrik Jonsson 1 Machine Intelligence Research Institute
Holden Karnofsky 1 Open Philanthropy Project
Huw Price 1 Centre for the Study of Existential Risk
Jack Gallagher 1 Machine Intelligence Research Institute
Jacob Steinhardt 1 Open Philanthropy Project
Jake Miller 1 Machine Intelligence Research Institute
Jake Moskowitz 1 Machine Intelligence Research Institute
James Payor 1 Machine Intelligence Research Institute
Jan Kulveit 1 AI Safety Camp
Jan Leike 1 Machine Intelligence Research Institute
Janos Kramar 1 Machine Intelligence Research Institute
Jarryd Martin 1 Australian National University
Jasen Murray 1 Machine Intelligence Research Institute
Jason Levin 1 Machine Intelligence Research Institute
Jed McCaleb 1 Machine Intelligence Research Institute
Jeff Alexander 1 Machine Intelligence Research Institute
Jeffrey Wu 1 OpenAI
Jeremy Miller 1 Machine Intelligence Research Institute
Jesse Galef 1 Machine Intelligence Research Institute
Jesse Liptrap 1 Machine Intelligence Research Institute
Jessica Cooper 1 AI Safety Camp
Jessica Taylor 1 Machine Intelligence Research Institute
Jirí Nadvorník 1 AI Safety Camp
Johannes Treutlein 1 Centre for Effective Altruism
John Salvatier 1 AI Impacts
Jon Gauthier 1 Massachusetts Institute of Technology
Jonathan Wang 1 Machine Intelligence Research Institute
Josh Jacobson 1 Berkeley Existential Risk Initiative
Joshua Achiam 1 OpenAI
Justin Shovelain 1 Machine Intelligence Research Institute
Justis Mills 1 AI Impacts
Kaya Stechly 1 Machine Intelligence Research Institute
Keefe Roedersheimer 1 Machine Intelligence Research Institute
Kemal Eren 1 Machine Intelligence Research Institute
Kevin Fischer 1 Machine Intelligence Research Institute
Kristina Nemcova 1 AI Safety Camp
Kurt Brown 1 Machine Intelligence Research Institute
Lila Rieber 1 Machine Intelligence Research Institute
Lincoln Quirk 1 Machine Intelligence Research Institute
Linda Linsefors 1 Machine Intelligence Research Institute
Liron Shapira 1 Machine Intelligence Research Institute
Louie Helm 1 Machine Intelligence Research Institute
Lukas Gloor 1 Foundational Research Institute
Luke Grecki 1 Machine Intelligence Research Institute
Luke Muehlhauser 1 Machine Intelligence Research Institute
Luke Raskopf 1 Center for Applied Rationality
Malo Bourgon 1 Machine Intelligence Research Institute
Marcello Herreshoff 1 Machine Intelligence Research Institute
Margaret Boden 1 Centre for the Study of Existential Risk
Mariah Wang 1 Machine Intelligence Research Institute
Martin Rees 1 Centre for the Study of Existential Risk
Martina Kunz 1 Centre for the Study of Existential Risk
Max Tegmark 1 Centre for the Study of Existential Risk
Michael Anissimov 1 Machine Intelligence Research Institute
Michael Blume 1 Machine Intelligence Research Institute
Michael Janner 1 University of California, Berkeley
Michaël Trazzi 1 Sorbonne University
Michael Wulfsohn 1 AI Impacts
Mihaly Barasz 1 Machine Intelligence Research Institute
Milan Griffes 1 Ought
Minda Myers 1 Machine Intelligence Research Institute
Mor Katz 1 OpenAI
Moshe Looks 1 Machine Intelligence Research Institute
Murray Shanahan 1 Centre for the Study of Existential Risk
Nate Soares 1 Machine Intelligence Research Institute
Nate Thomas 1 Machine Intelligence Research Institute
Nathan Clark 1 Machine Intelligence Research Institute
Neal Jean 1 Ought
Nell Watson 1 EthicsNet
Nevin Freeman 1 Machine Intelligence Research Institute
Nick Tarleton 1 Machine Intelligence Research Institute
Nickolai Leschov 1 Machine Intelligence Research Institute
Nisan Stiennon 1 Machine Intelligence Research Institute
Noah Goodman 1 Ought
Noam Brown 1 Carnegie Mellon University
Owain Evans 1 Ought
Ozzie Gooen 1 Ought
Patrick LaVictoire 1 Machine Intelligence Research Institute
Patrick Robotham 1 Machine Intelligence Research Institute
Pedro A. Ortega 1 Google DeepMind
Pedro Chaves 1 Machine Intelligence Research Institute
Peter de Blanc 1 Machine Intelligence Research Institute
Peter Scheyer 1 Machine Intelligence Research Institute
Peter Thiel 1 Machine Intelligence Research Institute
Ramana Kumar 1 Machine Intelligence Research Institute
Ray Kurzweil 1 Machine Intelligence Research Institute
Raymond Arnold 1 LessWrong 2.0
Remco Bloemen 1 EthicsNet
Richard Neal 1 Machine Intelligence Research Institute
Rob Bensinger 1 Machine Intelligence Research Institute
Robert Miles 1 Road to AI Safety Excellence
Robert Mushkatblat 1 Machine Intelligence Research Institute
Robin Hanson 1 Machine Intelligence Research Institute
Roger Grosse 1 University of Toronto
Roko Mijic 1 Machine Intelligence Research Institute
Roman Yampolskiy 1 Machine Intelligence Research Institute
Rupert McCallum 1 Road to AI Safety Excellence
Ruth Fong 1 University of Oxford
Sam Bankman-Fried 1 Berkeley Existential Risk Initiative
Sam Eisenstat 1 Machine Intelligence Research Institute
Sam McCandlish 1 OpenAI
Scott Garrabrant 1 Machine Intelligence Research Institute
Sean Holden 1 Centre for the Study of Existential Risk
Seán Ó hÉigeartaigh 1 Centre for the Study of Existential Risk
Sebastian Nickel 1 Machine Intelligence Research Institute
Sergey Rodionov 1 AIDEUS
Seth Baum 1 Centre for the Study of Existential Risk
Shahar Avin 1 Centre for the Study of Existential Risk
Sören Mindermann 1 Future of Humanity Institute
Stan Franklin 1 Learning Intelligent Distribution Agent
Stanislas Sochacki 1 Machine Intelligence Research Institute
Stephanie Zolayvar 1 AI Impacts
Stephen Barnes 1 Machine Intelligence Research Institute
Stephen Hawking 1 Centre for the Study of Existential Risk
Steve Omohundro 1 Machine Intelligence Research Institute
Steve Rayhawk 1 Machine Intelligence Research Institute
Steven Kaas 1 Machine Intelligence Research Institute
Steven Umbrello 1 Institute of Ethics and Emerging Technologies
Stuart Armstrong 1 Machine Intelligence Research Institute
Tamas Madl 1 Learning Intelligent Distribution Agent
Tamay Besiroglu 1 Future of Humanity Institute
Thomas Colthurst 1 Machine Intelligence Research Institute
Thomas McCabe 1 Machine Intelligence Research Institute
Tim Crane 1 Centre for the Study of Existential Risk
Tim Czech 1 Machine Intelligence Research Institute
Tobias Baumann 1 Foundational Research Institute
Tomer Kagan 1 Machine Intelligence Research Institute
Toon Alfrink 1 Road to AI Safety Excellence
Topher Brennan 1 Machine Intelligence Research Institute
Trent Fowler 1 Road to AI Safety Excellence
Tsvi Benson-Tilsen 1 Machine Intelligence Research Institute
Vanessa Kosoy 1 Machine Intelligence Research Institute
Veerle de Goederen 1 Road to AI Safety Excellence
Victoria Krakovna 1 Machine Intelligence Research Institute
Vincent Fagot 1 Machine Intelligence Research Institute
Vipul Naik 1 Machine Intelligence Research Institute
Vishal Maini 1 Google DeepMind
Will Newsome 1 Machine Intelligence Research Institute
Xavier Prospero 1 Center for Applied Rationality
Yang Liu 1 Centre for the Study of Existential Risk
Zac Kenton 1 Ought
Zachary Miller 1 Ought
Angela P. 0

Positions grouped by organization

Showing 31 organizations.

Organization Number of people List of people
Machine Intelligence Research Institute 142 James Payor, Edward Kmett, Victoria Krakovna, Ben Weinstein-Raun, Alex Zhu, David Simmons, Alex Mennen, Linda Linsefors, Evan Hubinger, Daniel Demski, Alex Appel, Qiaochu Yuan, Buck Shlegeris, Blake Borgeson, Nick Tarleton, Kurt Brown, Jesse Liptrap, Benjamin Mann, Tsvi Benson-Tilsen, Abram Demski, Sam Eisenstat, Jeremy Schlatter, Jan Leike, Andrew Critch, Matthew Graves, Ryan Carey, Connor Flexman, Colm Ó Riain, Aaron Silverbook, Gary Drescher, Rob Bensinger, Malo Bourgon, Katja Grace, Scott Garrabrant, Andrew Lapinski-Barker, Robin Hanson, Anna Salamon, Jack Gallagher, Vanessa Kosoy, Ramana Kumar, Jaan Tallinn, Jed McCaleb, Luke Muehlhauser, Bart Selman, Stuart Russell, Nate Thomas, Stuart Armstrong, Jake Moskowitz, Jessica Taylor, Jesse Galef, Matthew Fallshaw, Eliezer Yudkowsky, Liron Shapira, Peter Thiel, Christine Peterson, Elizabeth Morningstar, Antonius Lourenço Kasbergen, Lila Rieber, Vipul Naik, Nate Soares, Jimmy Rintjema, Daniel Lewis, Richard Neal, Robert Mushkatblat, Dávid Natingga, Moshe Looks, Nick Bostrom, Steve Omohundro, Nathan Clark, Evan Erickson (this list is partial)
Centre for the Study of Existential Risk 24 Adrian Weller, Sean Holden, Stephen Hawking, Tim Crane, Max Tegmark, Murray Shanahan, Dana Scott, Stuart Russell, Elon Musk, Alison Gopnik, David Chalmers, Nick Bostrom, Margaret Boden, Ryan Carey, Martina Kunz, Seth Baum, Beth Barnes, Yang Liu, Jaan Tallinn, Martin Rees, Huw Price, Haydn Belfield, Shahar Avin, Seán Ó hÉigeartaigh
Ought 18 Chris Cundy, Girish Sastry, Neal Jean, Ryan Carey, Zac Kenton, Tom McGrath, Ben Weinstein-Raun, Ozzie Gooen, Milan Griffes, Zachary Miller, Ben Goldhaber, Ben West, Andrew Schreiber, Ben Rachbach, Noah Goodman, Paul Christiano, Owain Evans, Andreas Stuhlmüller
AI Impacts 10 Connor Flexman, Finan Adamson, Michael Wulfsohn, Katja Grace, Stephanie Zolayvar, Ben Hoffman, John Salvatier, Paul Christiano, Jimmy Rintjema, Justis Mills
OpenAI 10 Mor Katz, Sam McCandlish, Christopher Olah, Jeffrey Wu, Ethan Knight, Daniel Ziegler, Joshua Achiam, Geoffrey Irving, Paul Christiano, Dario Amodei
Berkeley Existential Risk Initiative 8 Josh Jacobson, Sam Bankman-Fried, Matthew Fallshaw, Colleen Gleason, Jeremy Schlatter, Qiaochu Yuan, Eric Rogstad, Andrew Critch
Road to AI Safety Excellence 8 Remmelt Ellen, Trent Fowler, Erik Istre, Rupert McCallum, Robert Miles, Johannes Heidecke, Veerle de Goederen, Toon Alfrink
AI Safety Camp 7 Remmelt Ellen, Jessica Cooper, Kristina Nemcova, Jirí Nadvorník, Anne Wissemann, Jan Kulveit, Johannes Heidecke
LessWrong 2.0 6 Eric Rogstad, Harmanas Chopra, Raymond Arnold, Ben Albert Pace, Matthew Graves, Oliver Habryka
Open Philanthropy Project 6 Daniel Dewey, Holden Karnofsky, Dario Amodei, Christopher Olah, Jacob Steinhardt, Paul Christiano
Center for Applied Rationality 5 Xavier Prospero, Brienne Strohl, Luke Raskopf, Adom Hartell, Oliver Habryka
Foundational Research Institute 5 Brian Tomasik, Kaj Sotala, Caspar Oesterheld, Lukas Gloor, Tobias Baumann
EthicsNet 4 Aleksandra Orchowska, Remco Bloemen, Anish Mohammed, Nell Watson
Future of Humanity Institute 4 Tom McGrath, Tamay Besiroglu, Anders Sandberg, Sören Mindermann
Center for Human-Compatible AI 3 Beth Barnes, Dmitrii Krasheninnikov, Christopher Cundy
Google DeepMind 3 Vishal Maini, Pedro A. Ortega, Chris Maddison
AIDEUS 2 Sergey Rodionov, Alexey Potapov
Learning Intelligent Distribution Agent 2 Tamas Madl, Stan Franklin
University of Oxford 2 Ruth Fong, Chris Maddison
1 Angela P.
Australian National University 1 Jarryd Martin
Carnegie Mellon University 1 Noam Brown
Centre for Effective Altruism 1 Johannes Treutlein
ETH Zurich 1 Felix Berkenkamp
Institute of Ethics and Emerging Technologies 1 Steven Umbrello
Massachusetts Institute of Technology 1 Jon Gauthier
Sorbonne University 1 Michaël Trazzi
Stanford University 1 Aditi Raghunathan
Theiss Research 1 Paul Christiano
University of California, Berkeley 1 Michael Janner
University of Toronto 1 Roger Grosse