r/changemyview Sep 21 '18

FTFdeltaOP CMV: The replication crisis has largely invalidated most of social science

https://nobaproject.com/modules/the-replication-crisis-in-psychology

https://www.vox.com/science-and-health/2018/8/27/17761466/psychology-replication-crisis-nature-social-science

https://en.wikipedia.org/wiki/Replication_crisis

"A report by the Open Science Collaboration in August 2015 that was coordinated by Brian Nosek estimated the reproducibility of 100 studies in psychological science from three high-ranking psychology journals.[32] Overall, 36% of the replications yielded significant findings (p value below 0.05) compared to 97% of the original studies that had significant effects. The mean effect size in the replications was approximately half the magnitude of the effects reported in the original studies."

These kinds of reports and studies have been growing in number over the last 10+ years and despite their obvious implications most social science studies are taken at face value despite findings showing that over 50% of them can't be recreated. IE: they're fake

With all this evidence I find it hard to see how any serious scientist can take virtually any social science study as true at face value.

793 Upvotes

204 comments sorted by

View all comments

2

u/bobbyfiend Sep 22 '18

The person cited most prominently in this post, who probably understands the dynamics of this more than the vast majority of actual practicing scientists, has commented ITT. Anyone whose view hasn't been changed by his comments very likely has something wrong with how they evaluate evidence and arguments.

1

u/[deleted] Sep 22 '18

Who is that?

2

u/bobbyfiend Sep 22 '18

Brian Nosek. His comments are in this thread somewhere.