Reproducibility Quotes

“The conventional is uncritically enjoyed, while the truly new is criticized with aversion.”
― Walter Benjamin, The Work of Art in the Age of Its Technological Reproducibility

“A task force of the American Society for Cell Biology (ASCB) distinguished four kinds of reproducibility: analytic reproducibility, which tries to duplicate original conclusions by reanalyzing original data; direct reproducibility, which tries to get the same experimental results using the same experimental conditions as in the original report; systematic reproducibility, which tries to get the same results as the original study under different experimental conditions than the original ones; and conceptual reproducibility, which uses new experimental approaches and aims “to demonstrate the validity of a concept or finding using a different paradigm.”
― Bradley E. Alger, Defense of the Scientific Hypothesis: From Reproducibility Crisis to Big Data

“Reproducibility is also hampered by qualitative issues that include such intangibles as the “culture of science,” the “scientific reward system,” and cognitive biases, as well as matters of scientific practice governing how we do experiments and publish our reports. Even if identifying the remedies for some of these problems were straightforward—and it isn’t—putting them into place would require the concerted effort of the scientific community.”
― Bradley E. Alger, Defense of the Scientific Hypothesis: From Reproducibility Crisis to Big Data

“Reproducibility is not a binary condition: a scientific report may not be all right or all wrong. One part of a multipart report may not replicate, while other parts do. Or a replicated result might match the original result qualitatively though not quantitatively, as was the case in many of the RPP experiments. It is often hard to classify reports as “reproducible” or “irreproducible.”
― Bradley E. Alger, Defense of the Scientific Hypothesis: From Reproducibility Crisis to Big Data