After being alerted about possible misconduct, the I4R started reproducing published papers that use data from a specific NGO (GDRI). The investigation started November 2024. As of April 11, 2025 we have reproduced 10 studies linked to GDRI.
We are thrilled to report that we secured additional funding from Open Philanthropy for our project ‘Benchmarking LLM agents on real-world tasks: Reproducibility’ (174,112 USD).
One of I4R’s core objectives is to help disseminate reproductions and replications. We highlight special issues/symposiums and journals which publish comments and replication studies, and provide results from a survey of journal editors.
Researchers in the Replication Games form teams of 3-5 to replicate studies. Before the event, they read the paper and plan responsibilities. The event runs from 8:30 am to 4 pm, after which they write a summary report. Participants receive co-authorship on a meta-paper and can submit their replication for publication.
The Replication Games are one-day events that bring researchers together to collaborate on replicating studies from top-tier journals. This blog post highlights the rankings from previous games.
Frequently asked questions about Replication Games, covering goals, participation, expectations, and outcomes.
Research & Politics welcomes replications as regular submissions and announces a call for abstracts for a special issue on methods, practices and ethics for replication in collaboration with the Institute for Replication.
Our chair, Abel Brodeur, Kevin Esterling and many collaborators published a piece in Research & Politics entitled ‘Promoting reproducibility and replicability in political science’.