YANSS 100 – The Replication Crisis

Psychology is working on the hardest problems in all of science. Physics, astronomy, geology — those are easy, by comparison. Understanding consciousness, willpower, ideology, social change – there’s a larger-than-Large-Hadron-Collider level of difficulty to each one of these, but since these are more relatable ideas than quarks and bosons and mass coronal ejections — this a science about our minds and selves — it’s easier to create eye-catching headlines and, well, to make podcasts about them.

This is the problem. Because the system for distributing the findings of science is based on publication within journals, which themselves are often depend on the interest of the general media, all the biases that come with that system and media consumption in general are now causing the sciences that are most interesting to the public to get tainted by that interest.

As you will hear in this episode, one of the most famous and most talked-about phenomena in recent psychological history, ego depletion, hasn’t been doing so well in replication attempts.

In the show, journalist Daniel Engber who wrote an article for Slate about the failure to replicate many of the famous ego depletion experiments will detail what this means for the science and the scientists involved.

Also, you’ll hear from psychologist Brain Nosek, who says, “Science is wrong about everything, but you can trust it more than anything.”

Nosek is director of the Center for Open Science, an organization working to correct what they see as the temporarily wayward path of psychology.

Nosek recently lead a project in which 270 scientists sought to replicate 100 different studies in psychology, all published in 2008 — 97 of which claimed to have found significant results — and in the end, two-thirds failed to replicate.

Clearly, some sort of course correction is in order. There is now a massive effort underway sort out what is being called the replication crisis. Much of the most headline-producing research in the last 20 years isn’t standing up to attempts to reproduce its findings. Nosek wants to clean up the processes that have lead to this situation, and in this episode, you’ll learn how he and others plan to do so.

Download – iTunes – Stitcher – RSS – Soundcloud

Great Courses PlusThis episode is sponsored by The Great Courses Plus. Get unlimited access to a huge library of The Great Courses lecture series on many fascinating subjects. Start FOR FREE with Your Deceptive Mind taught by neurologist Steven Novella. Learn about how your mind makes sense of the world by lying to itself and others. Click here for a FREE TRIAL.

sssThere is no better way to create a website than with Squarespace. Creating your website with Squarespace is a simple, intuitive process. You can add and arrange your content and features with the click of a mouse. Squarespace makes adding a domain to your site simple; if you sign up for a year you’ll receive a custom domain for free for a year. Start your free trial today, at Squarespace.com and enter offer code SOSMART to get 10% off your first
purchase.

PatreonSupport the show directly by becoming a patron! Get episodes one-day-early and ad-free. Head over to the YANSS Patreon Page for more details.

Links and Sources

Download – iTunes – Stitcher – RSS – Soundcloud

Previous Episodes

Boing Boing Podcasts

Cookie Recipes

The Reproducibility Project

How Reliable are Psychology Studies?

Psychology’s reproducibility problem is exaggerated – say psychologists

First results from psychology’s largest reproducibility test

Daniel Engber on Twitter

Everything is Crumbling (Engber’s Article)

How much of the psychology literature is wrong?

The Open Science Framework

The Center for Open Science

The Truth Wears Off

Psych File Drawer

Advertisements