Replication Crisis Quotes

“I’m being diplomatic. Many readers will know of the “replication crisis” in psychology, where an alarming percentage of published findings, even some in textbooks, turn out to be hard or impossible for other scientists to independently replicate (including some findings, I admit ruefully, that wound up being cited in my 2017 book, where I should have been more discerning). Thus, this section considers only findings whose broad conclusions have been independently replicated.”
― Robert M. Sapolsky, Determined: A Science of Life without Free Will

“Schnall’s strong reaction to the failed replication of her own work provoked a mixed reaction from the psychological community. While many psychologists were bewildered by her response, a number of prominent US psychologists voiced support for her position. Dan Gilbert from Harvard University likened Schnall’s battle to the plight of Rosa Parks, and he referred to some psychologists who conducted or supported replications as “bullies,” “replication police,” “second stringers,” McCarthyists, and “god’s chosen soldiers in a great jihad.” Others accused the so-called replicators of being “Nazis,” “fascists,” and “mafia.” Rather than viewing replication as an intrinsic part of best scientific practice, Gilbert and his supporters framed it as a threat to the reputation of the (presumably brilliant) researchers who publish irreproducible findings, stifling their creativity and innovation”
― Chris Chambers, The Seven Deadly Sins of Psychology: A Manifesto for Reforming the Culture of Scientific Practice

“In many life sciences, including psychology, discovery isn’t a black-and-white issue; it is matter of determining, from one experiment to the next, the theoretical contribution made by various shades of gray. When psychologists set arbitrary criteria (p<.05) on the precise shade of gray required to achieve publication—and hence career success—they also incentivize a host of conscious and unconscious strategies to cross that threshold. In the battle between science and storytelling, there is simply no competition: storytelling wins every time.”
― Chris Chambers, The Seven Deadly Sins of Psychology: A Manifesto for Reforming the Culture of Scientific Practice

“If we take a science such as experimental physics, where studies tend to have high statistical power, methods are well defined and de facto preregistered, then the failure to reproduce a previous result is considered a major cause for concern. But in a weaker science where lax statistical standards and questionable research practices are the norm, attempts to reproduce prior work will often fail, and it should therefore come as no surprise that retraction is rare.”
― Chris Chambers, The Seven Deadly Sins of Psychology: A Manifesto for Reforming the Culture of Scientific Practice

“philosophers of science from Francis Bacon to Karl Popper had argued that a quintessential prerequisite for a scientific finding to be valid resides in its reproducibility (i.e., the ability of other scientists to replicate it)”
― R. Barker Bausell, The Problem with Science: The Reproducibility Crisis and What to do About It