Publication Bias Quotes

“It is fascinating to discover that individuals who are asked to assign a punishment to a criminal are influenced by factors that they are unaware of (like the presence of a flag in the room) or that they would consciously diavow (like the color of the criminal's skin). It is boring to find that individuals' proposed punishments are influenced by rational considerations such as the severity of the crime and the criminal's previous record. Interesting: we are more willing to help someonw if there is the smell of fresh bread in the air. Boring: we are more willing to help someone if he or she has been kind to us in the past. We sometimes forget that this bias in publication exists and take what is reported in scientific journals and the popular press as an accurate reflection of our best science of how the mind works. But this is like watching the nightly news and concluding that rape, robbery, and murder are part of any individual's everyday life - forgetting that the nightly news doesn't report the vast majority of cases where nothing of this sort happens at all.”
― Paul Bloom, Just Babies: The Origins of Good and Evil

“Given that most published research is flawed and non-reproducible, this is the most organized body of lies we believe in without much scrutiny.”
― Sayem Sarkar

“When we incentivize the publication of new research, it's no wonder that people will be publishing more and more flawed new research because they have families to take care of and bills to pay.”
― Sayem Sarkar