2016 WhatDoesResearchReproducibility

Subject Headings: Research Reproducibility; Methods Reproducibility; Results Reproducibility; Inferential Reproducibility.

Notes

The language and conceptual framework of research reproducibility are nonstandard and unsettled across the sciences. In this Perspective, we review an array of explicit and implicit definitions of reproducibility and related terminology, and discuss how to avoid potential misunderstandings when these terms are used as a surrogate for “truth",

(...)

Methods reproducibility is meant to capture the original meaning of reproducibility, that is, the ability to implement, as exactly as possible, the experimental and computational procedures, with the same data and tools, to obtain the same results. Results reproducibility refers to what was previously described as “replication,” that is, the production of corroborating results in a new study, having followed the same experimental methods. Inferential reproducibility, not often recognized as a separate concept, is the making of knowledge claims of similar strength from a study replication or reanalysis. This is not identical to results reproducibility, because not all investigators will draw the same conclusions from the same results, or they might make different analytical choices that lead to different inferences from the same data. Here, we explore the definitions and operational complexities of each of these concepts.

(...)

;

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2016 WhatDoesResearchReproducibility	Steven N. Goodman Daniele Fanelli John P. A. Ioannidis			What Does Research Reproducibility Mean?				10.1126/scitranslmed.aaf5027		2016