| Item | Value |
|---|---|
| Country | United Kingdom |
| Website | https://deepmind.com/ |
| Source | [1] |
| Agendas | Recursive reward modeling |
Hover over a name to see the position and date range. This table only includes positions where at least the start date is known. The positions count can count the same person multiple times if they held different positions; similarly, the list of staff may include the same person multiple times if they held more than one position during a single year. For each year, a person is included if they were at the organization for any part of the year; this means the actual staff count at any point during the year can be lower (or higher, if some staff held multiple positions in a single year).
The following table lists some dates and people who were at the organization on the given date (namely, the start of the year). The table may not list every person who worked for the organization (e.g. they could have joined and left in the middle of a single year). This table excludes associates, interns, advisors, and board members.
This table shows the full change history of positions. Each row corresponds to at least one addition or removal of a position. Additions are in green and subtractions are in red. If a position name changed, it is listed simultaneously as an addition (of the new name) and removal (of the old name) and colored yellow. Additionally there are faded variants of each color for visited links.
| Person | Title | Start date | End date | AI safety relation | Subject | Employment type | Source | Notes |
|---|---|---|---|---|---|---|---|---|
| Chris Maddison | Research Scientist | position | technical research | [2] | One of the Open Philanthropy Project 2018 AI Fellows. | |||
| Laurent Orseau | Research Scientist | [3], [4], [5], [6], [7], [8], [9] | ||||||
| Tom Everitt | [8] | |||||||
| Pedro A. Ortega | Research Scientist | 2016-01-01 | position | technical research | full-time | [8], [10], [11], [12], [13] | ||
| Vishal Maini | Strategic Communications Manager | 2018-02-01 | position | popularization | [14], [15], [16] | |||
| Thore Graepel | [17] | |||||||
| Andrew Lefrancq | Program Manager | 2016-01-01 | 2020-04-01 | [18] | ||||
| Andrew Lefrancq | Senior Program Manager | 2017-11-01 | 2017-11-01 | [18] | ||||
| Andrew Lefrancq | Lead Program Manager, AI Research | 2020-05-01 | 2023-04-01 | [18] | ||||
| Andrew Lefrancq | Head of International Operations | 2023-04-01 | full-time | [18] | ||||
| Azade Nova | Senior Research Scientist | 2023-04-01 | full-time | [19] | ||||
| Christiana Figueres | DeepMind Ethics & Society Fellow | [20] | ||||||
| Demis Hassabis | Co-Founder and CEO | 2010-09-23 | [21], [22], [23] | |||||
| Diane Coyle | DeepMind Ethics & Society Fellow | [20] | ||||||
| Edward W. Felten | DeepMind Ethics & Society Fellow | [20] | ||||||
| Hanie Sedghi | Staff Research Scientist | 2017-11-01 | full-time | [24] | ||||
| Ian Goodfellow | Research Scientist | 2022-06-01 | full-time | [25], [26] | ||||
| Isabel Leal | Senior Software Engineer | 2023-06-01 | [27] | |||||
| James Manyika | DeepMind Ethics & Society Fellow | [20] | ||||||
| Jan Leike | [28], [8] | |||||||
| Jeffrey D. Sachs | DeepMind Ethics & Society Fellow | [20] | ||||||
| Kavya Kopparapu | Research Engineer | 2022-08-01 | full-time | [29] | ||||
| Keerthana Gopalakrishnan | Senior Research Engineer | 2021-02-01 | full-time | [30] | ||||
| Lila Ibrahim | Chief Operating Officer | 2018-04-01 | [31] | |||||
| Mehdi Jafarnia | Research Engineer | 2022-07-01 | full-time | [32] | ||||
| Miljan Martic | Reserach Engineer | 2017-03-01 | 2020-10-31 | AGI organization | [28], [8], [33] | |||
| Miljan Martic | Senior Reserach Engineer | 2020-10-01 | AGI organization | [28], [8], [33] | ||||
| Mustafa Suleyman | Co-Founder and Head of Applied AI | 2010-09-23 | [21], [22] | |||||
| Nick Bostrom | DeepMind Ethics & Society Fellow | [20] | ||||||
| Nidhi Vyas | Product Manager (AI/ML) | 2022-12-01 | 2023-10-01 | [34] | ||||
| Nidhi Vyas | Product Manager Lead (Gen AI) | 2023-10-01 | full-time | [34] | ||||
| Raphael Hoffmann | Director of Engineering | 2023-04-01 | full-time | [35] | ||||
| Rohan Anil | Principal Engineer / Director | 2023-06-01 | full-time | [36] | ||||
| Sean Legassick | Head of DeepMind Ethics & Society | 2017-10-04 | [37], [38] | |||||
| Shane Legg | Co-Founder and Chief Scientist | 2010-09-23 | [21], [22], [28], [8], [9] | |||||
| Shixiang Shane Gu | Research Scientist | 2023-09-01 | full-time | [39] | ||||
| Sholto Douglas | Research/Software Engineer | 2022-09-01 | full-time | [40] | ||||
| Shubham Agrawal | Research Engineer | 2021-09-01 | full-time | [41] | ||||
| Stanislav Fort | Senior Research Scientist | 2023-11-01 | full-time | [42] | ||||
| Thibault Sellam | Senior Research Scientist | 2023-06-01 | [43], [44] | |||||
| Verity Harding | Head of DeepMind Ethics & Society | 2017-10-04 | [37], [38] | |||||
| Victoria Krakovna | Research Scientist | [45], [8], [9] | ||||||
| Will Grathwohl | Research Scientist | 2021-10-01 | 2023-10-01 | [46] | ||||
| Will Grathwohl | Senior Research Scientist | 2023-10-01 | [46] | |||||
| Yasaman Bahri | Research Scientist | 2018-12-01 | full-time | [47] | ||||
| Zachary Gleicher | Product Manager | 2017-07-01 | 2023-01-01 | [48] | ||||
| Zachary Gleicher | Co-lead, Applied Product Manager | 2022-12-01 | [48] |
| Name | Creation date | Description |
|---|
| Title | Publication date | Author | Publisher | Affected organizations | Affected people | Document scope | Cause area | Notes |
|---|
| Title | Publication date | Author | Publisher | Affected organizations | Affected people | Affected agendas | Notes |
|---|---|---|---|---|---|---|---|
| New safety research agenda: scalable agent alignment via reward modeling | 2018-11-20 | Victoria Krakovna | LessWrong | Google DeepMind | Jan Leike | Recursive reward modeling, iterated amplification | Blog post on LessWrong announcing the recursive reward modeling agenda. Some comments in the discussion thread clarify various aspects of the agenda, including its relation to Paul Christiano’s iterated amplification agenda, whether the DeepMind safety team is thinking about the problem of whether the human user is a safe agent, and more details about alternating quantifiers in the analogy to complexity theory. Jan Leike is listed as an affected person for this document because he is the lead author and is mentioned in the blog post, and also because he responds to several questions raised in the comments. |
| Scalable agent alignment via reward modeling: a research direction | 2018-11-19 | Jan Leike, David Krueger, Tom Everitt, Miljan Martic, Vishal Maini, Shane Legg | arXiv | Google DeepMind | Recursive reward modeling, Imitation learning, inverse reinforcement learning, Cooperative inverse reinforcement learning, myopic reinforcement learning, iterated amplification, debate | This paper introduces the (recursive) reward modeling agenda, discussing its basic outline, challenges, and ways to overcome those challenges. The paper also discusses alternative agendas and their relation to reward modeling. |