Past & Future Games


Register or Organizing:

Registration to Replication Games: To register for an upcoming Replication Games event, email the following information to Abel Brodeur at abrodeur [at] uottawa.ca: (i) your field of study and research interests, (ii) preferred statistical software, (iii) the specific games you are interested in attending and (iv) if you want to participate in-person or virtually. I4R will assign you to a team based on your research interests. Pre-defined teams are also welcome to participate.

Virtual Participation: Virtual participants are welcome and should collaborate with their teams using appropriate tools and communication platforms. Further instructions for virtual participants will be provided upon registration.

Organizing Replication Games: If you are interested in organizing a Replication Games event at your institution, please reach out to Abel Brodeur at abrodeur [at] uottawa.ca for more information and guidance.

Upcoming Games: Registration Open

Melbourne Replication Games: June 7th, 2024 at Deakin University (Deakin Downtown), Australia. Register here. Social science papers to be reproduced/replicated. Local organizer is once again Romain Gauriot.

Sydney Replication Games: June 11th, 2024 at University of Technology Sydney (Business School), Australia. Register here. Social science papers to be reproduced/replicated. Local organizer is Jason Collins.

AI Replication Games - Sheffield: June 17th, 2024 at the University of Sheffield, UK. Register here. Registered participants will be randomly assigned to one of three teams: Machine, Cyborg or Human, and asked to work in groups to evaluate the reproducibility of one quantitative social science paper during a 1-day hybrid workshop. Participants require no previous knowledge of GPT-4 or any other AI-system in order to participate in this workshop. The local organizer is Tom Stafford.

Grenoble Replication Games: June 26th, 2024. Experimental papers to be reproduced (and planned replication). Register here. The games will be just before the 14th ASFEE conference. Local organizer is Paolo Crosetto and Margaux Sinceux.

Seattle Replication Games: June 28th, 2024. Social science papers to be reproduced/replicated. This is a collaboration with Seattle University and co-sponsored by WEAI. Local organizer is Nick C. Huntington-Klein.

Polmeth Replication Games (UC Riverside): July 20th, 2024. Only political science papers to be reproduced/replicated. Register here. The event will take place in person during the 41st Annual Meeting of the Society for Political Methodology at UC Riverside (https://polmeth.ucr.edu/).

AI Replication Games (at Cornell University): August 12th, 2024 at Cornell University, sponsored by the ESEM. Register here. The event will take place a day before the ESIF Economics and AI+ML Meeting. Registered participants will be randomly assigned to one of three teams: Machine, Cyborg or Human, and asked to work in groups to evaluate the reproducibility of one quantitative social science paper. Participants require no previous knowledge of GPT-4 or any other AI-system in order to participate in this workshop.

EEA-ESEM Replication Games (Rotterdam): August 25th, 2024 in Rotterdam. Only economics papers to be reproduced/replicated. Register here. The event will take place in person prior to the 39th meeting of the European Economic Association in Rotterdam (https://www.eea-esem-congresses.org/).

Upcoming Games: Registration Closed

Madrid Replication Games: May 17th 2024 at ICAE. Social science papers to be reproduced/replicated. Local organizer is Marcello Sartarelli and Francesca Lipari.

Upcoming Games: Registration Not Open Yet

Innsbruck Replication Games: July 5th, 2024 at the University of Innsbruck, Austria. Social science papers to be reproduced/replicated. Local organizer is Felix Holzmeister.

Växjö Replication Games: September 26-27, 2024, Linnaeus University, Sweden. The focus is on articles using Swedish register data. Local organizer is Olle Hammar.

Oxford Replication Games: Sep/early October (tbc), 2024, Oxford University, UK. Political science and economics papers to be reproduced/replicated. Local organizers are Edmund Kelly and Angela Odermatt.

AI Replication Games - Tilburg: Fall 2024 at Tilburg University, Netherlands. Registered participants will be randomly assigned to one of three teams: Machine, Cyborg or Human, and asked to work in groups to evaluate the reproducibility of one quantitative social science paper during a 1-day hybrid workshop. Participants require no previous knowledge of GPT-4 or any other AI-system in order to participate in this workshop. The local organizer is Lachlan Deer.

Munich Replication Games: Late October 2024, Munich, Germany. Behavioral and psychology papers to be reproduced/replicated. Local organizer is Mario Gollwitzer.

Bergen Replication Games: November 29th, 2024 (date tbd), Bergen, Norway. Social science papers to be reproduced/replicated. Local organizer is Lenka Fiala.

UK Reproducibility Network Replication Games: December 5th 2024, virtual. Behavioral and psychology papers to be reproduced/replicated. This is an event jointly organized with the UKRN Local Network Leads.

Tokyo Replication Games: Date tbd, at the University of Tokyo campus, Japan. Economics and political science papers to be replicated. Local organizers are Yasuyuki Sawada, Chishio Furukawa and Hiroki Kameyama.

Cologne Replication Games: 2024 (date tbd), Cologne, Germany. Economics and political science papers to be replicated. Local organizer is Jörg Peters.

Past Games

AI Replication Games - Ottawa: May 3rd 2024 at the University of Ottawa, Canada. Registered participants were randomly assigned to one of three teams: Machine, Cyborg or Human, and asked to work in groups to evaluate the reproducibility of one quantitative social science paper during a 1-day hybrid workshop. The local organizer was our chair Abel Brodeur.

Brown Replication Games: April 19th 2024 at Brown University. Social science papers to be reproduced/replicated. Local organizer is Jonathan Roth.

Northwestern Replication Games: April 15th 2024 at Northwestern University. Social science papers to be reproduced/replicated. Local organizer is Emilio Lehoucq.

Berkeley Replication Games: March 7th 2024 at University of California, Berkeley. Social science papers to be replicated. Local organizers are Edward Miguel and Fernando Fernando Hoces de la Guardia.

Los Angeles Replication Games: February 28th 2024 at University of California, Los Angeles. Demography, economics, politics, psychology and other social science papers were reproduced/replicated. The event was sponsored by the California Center for Population Research.

AI Replication Games - Toronto: February 20th 2024 at the University of Toronto, Canada. Registered participants were randomly assigned to one of three teams: Machine, Cyborg or Human, and asked to work in groups to evaluate the reproducibility of one quantitative social science paper during a 1-day hybrid workshop. Participants require no previous knowledge of GPT-4 or any other AI-system in order to participate in this workshop. The local organizer was once again Rohan Alexander.

London (Management) Replication Games: January 26th, 2024 at the Birkbeck, University of London. Management, finance and economics papers to be reproduced/replicated. Local organizer was Lukas Wallrich.

London (Health) Replication Games: November 7th, 2023 at the Institute for Mathematical and Statistical Sciences at UCL, London. Health and health equity papers were reproduced/replicated. Local organizers were Brieuc Lehmann, Vanessa Rodriguez and Ahwaz Akhtar.

Lyon Replication Games: October 24th, 2023 at ENS de Lyon, France. Economics and political science papers were reproduced/replicated. Local organizers were Mathieu Couttenier and Cedric Chambru.

Stockholm Replication Games: October 26th, 2023 in Stockholm, Sweden. Behavioral science, economics and political science papers were reproduced/replicated. Local organizer was I4R's co-director Anna Dreber.

Brussels Replication Games: October 27th, 2023 at ULB-ECARES, Belgium. Economics and political science papers were reproduced/replicated. Local organizers were Paula Gobbi and Joanne Haddad.

EEA-ESEM Replication Games (Barcelona): August 27th, 2023 in Barcelona. 10 economics papers reproduced/replicated. The event took place in person a day prior to the 38th meeting of the European Economic Association in Barcelona (https://www.eea-esem-congresses.org/).

Bank-Funds Replication Games (DC, co-sponsored by IMF and WB): July 17th, 2023 in Washington DC. 29 papers by IMF and WB staff replicated.

Norwich Replication Games: July 10th, 2023 at the University of East Anglia, UK. 11 economics and political science papers replicated. Local organizer was Farasat Bokhari.

San Diego Replication Games: July 1st, 2023. This was a collaboration with UCSD (Political Science Department) and co-sponsored by WEAI. 14 economics and political science papers replicated. Local organizer was Scott Desposato. The Games took place in a room on the 7th floor in central campus at UCSD with a giant ocean view. Thanks, Scott!

Montreal Replication Games: June 14th, 2023 at the Université du Québec à Montréal, Canada. 17 economics and political science replicated. Local organizer was Marie Connolly.

Melbourne Replication Games: June 2nd, 2023 at Deakin University (Deakin Downtown), Australia. 10 economics papers replicated. Local organizer was Romain Gauriot.

Ottawa Replication Games: May 5th, 2023 at the University of Ottawa, Canada. 15 papers replicated. Organizer was I4R's chair, Abel Brodeur.

Vienna Replication Games: May 5th, 2023 at the Vienna University of Econ and Business, Austria. 12 papers replicated. Organizer was Christoph Huber.

Nottingham Replication Games: March 18th, 2023 at the University of Nottingham School of Economics, UK. 17 papers replicated. Local organizer was Diego Marino Fages.

Toronto Replication Games: February 22nd, 2023 at the University of Toronto, Canada. This was a collaboration with the University of Toronto's Data Sciences Institute. 13 papers replicated. Local organizer was Rohan Alexander.

Calgary Replication Games: November 26th, 2022 at the University of Calgary, Canada. 6 papers replicated. Local organizer was Leonard Goff.

Oslo Replication Games: October 27th, 2022 at the Frisch Centre, Norway. 15 papers replicated. Local organizer was Andreas Kotsadam.