Replication Crisis

We rely on science. Why is it letting us down when we need it most? | 8/20/2020

… any number of creation/evolution issues. But as this LA Times op-ed notes, sometimes scientists themselves contribute to the lack of trust by the public. The article states: Science is suffering from a replication crisis . Too many landmark studies can’t be repeated in independent labs, a process crucial to separating flukes and errors from solid results. The consequences are hard to overstate: Public policy, medical treatments and the way …

Letters to the Editor: One failure to replicate a scientific study doesn’t mean there’s a crisis | MSN | 8/20/2020

… HBO) To the editor: In his Aug. 14 op-ed article, psychology professor Stuart Ritchie reports on a recent failure to replicate a study of ours and uses this as an example of a replication crisis in science . He lauds efforts by the scientific journal Cortex to promote the replication of seminal findings as a means to address this crisis and laments that such efforts are too infrequent in science …

Follow Replication Crisis:    

How The Replication Crisis Undermines Government By Bureaucracy | 8/19/2020

By Lewis M. Andrews August 19, 2020 For decades, critics of secular progressivism have been skeptical of the many billions Congress and state legislatures annually spend on university research, especially in the social sciences. What leftists like to tout as a valuable investment in better understanding and improving the human condition is increasingly seen by others as a cleverly camouflaged marketing effort to justify bigger and more intrusive bureaucracy. It …

Some thoughts inspired by Lee Cronbach (1975), “Beyond the two disciplines of scientific psychology” | 8/16/2020

… All this sounds a lot like Meehl, and Meehl is great , but Cronbach adds value by giving lots of specific applied examples. In the article, Cronbach makes a clear connection between interactions and the replication crisis arising from researcher degrees of freedom, a point that I rediscovered—40 years later—in my paper on the connection between varying treatment effects and the crisis of unreplicable research. Too bad I hadn’t …

Op-Ed: We rely on science. Why is it letting us down when we need it most? | MSN | 8/14/2020

… when we need it most? © (Brian van der Brug / Los Angeles Times ) Test media and supplies at the UCLA Clinical Microbiology Laboratory. (Brian van der Brug / Los Angeles Times ) Science is suffering from a replication crisis . Too many landmark studies can’t be repeated in independent labs, a process crucial to separating flukes and errors from solid results. The consequences are hard to overstate: Public policy, medical treatments and the way …

Viewpoints: Since Masks Save Lives, Why Is There A Debate On Them?; US Lessons On Embracing Preventive Measures | Kaiser Health News | 8/14/2020

… open and sniff all my spice jars. Nothing. This is spooky.” (Ann-Sophie Barwich, 8/14) Los Angeles Times: Why Is Science Letting Us Down When We Need It Most? Science is suffering from a replication crisis . Too many landmark studies can’t be repeated in independent labs, a process crucial to separating flukes and errors from solid results. The consequences are hard to overstate: Public policy, medical treatments and the way …

Friday, August 14, 2020 | Kaiser Health News | 8/14/2020

… open and sniff all my spice jars. Nothing. This is spooky.” (Ann-Sophie Barwich, 8/14) Los Angeles Times: Why Is Science Letting Us Down When We Need It Most? Science is suffering from a replication crisis . Too many landmark studies can’t be repeated in independent labs, a process crucial to separating flukes and errors from solid results. The consequences are hard to overstate: Public policy, medical treatments and the way …

Not The Replication Crisis: American Heart Association Withdraws Paper “Concluding INCORRECTLY That Black And Hispanic Trainees In Medicine Are Less Qualified” | 8/12/2020

… trainees. Wang paper is wrong: Diversity, equity and inclusiveness in medicine and cardiology are important and necessary: UPDATED statement from the American Heart Association, August 6, 2020 This retraction is not due to the replication crisis. A paper showing blacks and Hispanics are less qualified than Asians and whites would replicate pretty good. Affirmative action acts for blacks and Hispanics, against Asians and whites. Anti-affirmative action activist Vijay Chokal …

Perils and pitfalls of mixed-effects regression models in biology | 8/12/2020

… situation, also known as an inflated type I error rate or being anti-conservative, risks the false conclusion of the importance of a fixed effect explanatory variable (false positive) and has contributed to a replication crisis in some research fields ( Forstmeier, Wagenmakers & Parker, 2017 ). Anti-conservative inference from (G)LMMs can arise when sample sizes are small because maximum likelihood estimates of variance components become biased. This problem is fixed …

IT’S OFFICIAL (AGAIN): Leftists, Particularly Leftist Women, Are Nuts | 8/9/2020

… aged 18 to 29 had been diagnosed with a mental illness. Moderates were more mentally stable than Liberals but less so than Conservatives. This is only one analysis, and of course there is a replication crisis in social science. But a new study by Danish social scientist Emil Kirkegaard (right) has replicated the Pew Research findings with a vengeance, revealing that, in a huge dataset and on multiple different measures …

IT’S OFFICIAL (AGAIN): Leftists, Particularly Leftist Women, Are Nuts, by Lance Welton | 8/9/2020

… aged 18 to 29 had been diagnosed with a mental illness. Moderates were more mentally stable than Liberals but less so than Conservatives. This is only one analysis, and of course there is a replication crisis in social science. But a new study by Danish social scientist Emil Kirkegaard (right) has replicated the Pew Research findings with a vengeance, revealing that, in a huge dataset and on multiple different measures …

Science is self-correcting. Social Psychologists are not. That means they are not scientists. | 8/2/2020

… edited by Chris Crandall, who has been defending shoddy practices and questionable results on social media for the past decade. The authors first deception is that they fail to mention the extent of the replication crisis in social psychology. A comprehensive replication attempt found that only 25% of results in social psychology could be replicated (Open Science Collaboration, 2015). There also has been no other representative samples of social psychology …

Thinking about election forecast uncertainty | 7/31/2020

… just doesn’t pass the smell test. Looking at these “fundamentals” models (something I spent a ton of time in 2012) was really a seminal moment for me in learning about p-hacking and the replication crisis . It was amazing to me how poorly they performed on actual, not-known-in-advance data. Of course, if you’re constructing such a model this year , you’ll choose variables in way that just so …

Alexander Castro Romero comments on Stuff The Internet Says On Scalability For July 31st, 2020 | 7/31/2020

… the high proportion of computer science journals that accept papers using dichotomous interpretations of p, it seems unreasonable to believe that computer science research is immune to the problems that have contributed to a replication crisis in other disciplines. Next, we review proposals from other disciplines on how to ease the replication crisis , focusing first on changes to the way in which experimental data is analyzed, and second on proposals …

Wednesday Round Up #8 | 7/30/2020

The Flawed Reasoning Behind the Replication Crisis This is why better theory and a wider range of evidence and samples matter (both of which anthropology can provide) – you need to think about whether your theory is good, and how much it might relate to the larger claims studies often make. The mathematical lens that allows us to see the flaw in these arguments is Bayes’ theorem. The theorem dictates that …

The Many Faces of Bad Science | 7/28/2020

… of a previous book, Intelligence: All That Matters , about IQ testing. In Science Fictions he presents a broad overview of the problems facing science in the 21st century. The book covers everything from the replication crisis to fraud, bias, negligence and hype. Much of his criticism is aimed at his own field of psychology, but he also covers these issues as they occur in other fields such as medicine and …

The Many Faces of Bad Science | WIRED | 7/22/2020

… of a previous book, Intelligence: All That Matters , about IQ testing. In Science Fictions he presents a broad overview of the problems facing science in the 21st century. The book covers everything from the replication crisis to fraud, bias, negligence and hype. Much of his criticism is aimed at his own field of psychology, but he also covers these issues as they occur in other fields such as medicine and …

Behavioral Biases of Analysts and Investors | 7/22/2020

… consider decision fatigue, defined as the tendency for decision quality to decline after an extensive session of decision-making. Whether decision fatigue exists has been a topic of controversy as part of the greater replication crisis in experimental psychology. My collaborators Yaron Levi, Ben Lourie, Siew Hong Teoh, and I provide a test of whether decision fatigue affects a set of skilled financial professionals in the field. Specifically, we test …

Scientific Method + 1, Replication Crisis -1 | 6/23/2020

Knowing the scientific method innoculates one against replication crisis tropes. Posted Jun 23, 2020 TWEET The “ replication crisis ” talking point in academic psychology represents a very under-developed conception of the scientific method which fails to grasp the sequence of stages or the complexity of theory, hypothesis, and prediction testing. By asserting that a theory should be considered disproven if a given study anywhere in the nomological net of that …

【未成年閲覧厳禁】無修正ノーカット本入手! | 6/21/2020

Re: “Some denialists say a “replication crisis” undermines climate science, as per John Ioannidis’ work”Ioannidis’ is not friend to denialism, and denialists should stop abusing his work.To quote his words on climate change: https://t.co/Fa6Gm2B4x5 pic.twitter.com/XHkz8sujDP — Atomsk’s Sanakan (@AtomsksSanakan) March 21, 2020 【関連する記事 …

Only the Permanently Unemployed Have True Freedom of Speech (The Saad Truth with Dr. Saad_13) | 6/16/2020

Topics covered include the self-fulfilling prophecy, stereotype accuracy, the replication crisis , evolutionary psychology, use of satire in academia, intellectual diversity (heterodox academy), and academics’ public engagement. This chat was originally posted on January 24, 2020 on my YouTube channel as THE SAAD TRUTH_1002: https://youtu.be/8qvelMdnENI Please visit my new website gadsaad.com and sign up for alerts. If you’d like to support my efforts, please click on the …

Can we Leave Politics out of Medical Research? - Bedcloud - Medium | 6/5/2020

… statistical analysis, Ioannidis had found the data for drug-company research insufficient and that the results of the medical treatments were easy to manipulate. In addition, his findings were that medical research had a replication crisis where science studies can be difficult to replicate. For instance, if a drug-company would like to prove that a certain medication will alleviate anxiety disorders, they are written with soft-data such as …

A.J. Jacobs on radical honesty, following the whole Bible, and reframing global problems as puzzles | 6/2/2020

… am incredibly pro-science, but science has biases, corruption, mistakes. So if you dig in, it’s a very subtle message. So be pro-science but also be very skeptical of science. You’ve got the replication crisis . So I was worried that the takeaway was going to be people would read it and be like, “Oh yeah, we can’t trust anything. It’s all competing narratives. There is no truth”! Because that’s …

An ensuing crisis or opportunity? The role, quandary of replication in science | 6/1/2020

UC Davis researchers, faculty speak to the reasons behind, the impact of the replication crisis A 2015 exposé revealed that political scientist Michael LaCour had fabricated results in his ground-breaking paper about the effects a conversation with gay canvassers can have on voters’ preferences. Having recently read the article, my interest in the validity of research piqued. After just a few clicks, I discovered that within the scientific community …

Coronavirus and the “replication crisis” in social science | 3/30/2020

Home Uncategorized Coronavirus and the “replication crisis” in social science Coronavirus and the “replication crisis” in social science from an article by Nassim Nicholas Taleb and Yaneer Bar-Yam in yesterday’s Guardian Dominic Cummings [Chief Adviser to UK Prime Minister Boris Johnson] loves to theorise about complexity, but he’s getting it all wrong. . . . The error in the UK is on two levels. Modelling and policymaking. First, at the modelling level …