Do empirical studies change minds?

Economics got on just fine before the attack of the econometricians and their data mining and publication bias:

From ‘The Scientific Illusion in Empirical Macroeconomics’, Lawrence H. Summers , The Scandinavian Journal of Economics, Vol. 93, No. 2, Proceedings of a Conference on New Approaches to Empirical Macroeconomics. (June 1991), pp. 129-148.

A baser reason for holding out against the latest empirical is in Most Published Research Findings Are False, John Ioannidis says that:

There is increasing concern that in modern research, false findings may be the majority or even the vast majority of published research claims. However, this should not be surprising. It can be proven that most claimed research findings are false

Ioannidis goes on the say that

  • The truth of a research claim is true may depend on study power and bias, the number of other studies on the same question, and, the ratio of true to no relationships among the relationships probed in each scientific field; and
  • a research finding is less likely to be true when the studies conducted in a field are smaller, when effect sizes are smaller, when there is a greater number and lesser preselection of tested relationships, where there is greater flexibility in designs, definitions, outcomes, and analytical modes; when there is greater financial and other interest and prejudice; and when more teams are involved in a scientific field in chase of statistical significance.

Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true. Ioannidis also says that for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias.

Now let The Guardian finish matters with “False positives: fraud and misconduct are threatening scientific research: High-profile cases and modern technology are putting scientific deceit under the microscope”:

Cases of scientific misconduct tend to hit the headlines precisely because scientists are supposed to occupy a moral high ground when it comes to the search for truth about nature. 

The scientific method developed as a way to weed out human bias. But scientists, like anyone else, can be prone to bias in their bid for a place in the history books. 

Increasing competition for shrinking government budgets for research and the disproportionately large rewards for publishing in the best journals have exacerbated the temptation to fudge results or ignore inconvenient data.

Massaged results can send other researchers down the wrong track, wasting time and money trying to replicate them. Worse, in medicine, it can delay the development of life-saving treatments or prolong the use of therapies that are ineffective or dangerous.

Malpractice comes to light rarely, perhaps because scientific fraud is often easy to perpetrate but hard to uncover.

Leave a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Bassett, Brash & Hide

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

Truth on the Market

Scholarly commentary on law, economics, and more

The Undercover Historian

Beatrice Cherrier's blog

Matua Kahurangi

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

Temple of Sociology

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

Velvet Glove, Iron Fist

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

Why Evolution Is True

Why Evolution is True is a blog written by Jerry Coyne, centered on evolution and biology but also dealing with diverse topics like politics, culture, and cats.

Down to Earth Kiwi

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

NoTricksZone

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

Homepaddock

A rural perspective with a blue tint by Ele Ludemann

Kiwiblog

DPF's Kiwiblog - Fomenting Happy Mischief since 2003

The Dangerous Economist

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

Watts Up With That?

The world's most viewed site on global warming and climate change

The Logical Place

Tim Harding's writings on rationality, informal logic and skepticism

Doc's Books

A window into Doc Freiberger's library

The Risk-Monger

Let's examine hard decisions!

Uneasy Money

Commentary on monetary policy in the spirit of R. G. Hawtrey

Barrie Saunders

Thoughts on public policy and the media

Liberty Scott

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

Point of Order

Politics and the economy

James Bowden's Blog

A blog (primarily) on Canadian and Commonwealth political history and institutions

Science Matters

Reading between the lines, and underneath the hype.

Peter Winsley

Economics, and such stuff as dreams are made on

A Venerable Puzzle

"The British constitution has always been puzzling, and always will be." --Queen Elizabeth II

The Antiplanner

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

Bet On It

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

History of Sorts

WORLD WAR II, MUSIC, HISTORY, HOLOCAUST

Roger Pielke Jr.

Undisciplined scholar, recovering academic

Offsetting Behaviour

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

JONATHAN TURLEY

Res ipsa loquitur - The thing itself speaks

Conversable Economist

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

The Victorian Commons

Researching the House of Commons, 1832-1868

The History of Parliament

Articles and research from the History of Parliament Trust

Books & Boots

Reflections on books and art

Legal History Miscellany

Posts on the History of Law, Crime, and Justice

Sex, Drugs and Economics

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

European Royal History

Exploring the Monarchs of Europe

Tallbloke's Talkshop

Cutting edge science you can dice with

Marginal REVOLUTION

Small Steps Toward A Much Better World

NOT A LOT OF PEOPLE KNOW THAT

“We do not believe any group of men adequate enough or wise enough to operate without scrutiny or without criticism. We know that the only way to avoid error is to detect it, that the only way to detect it is to be free to inquire. We know that in secrecy error undetected will flourish and subvert”. - J Robert Oppenheimer.

STOP THESE THINGS

The truth about the great wind power fraud - we're not here to debate the wind industry, we're here to destroy it.

Lindsay Mitchell

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

Alt-M

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

croaking cassandra

Economics, public policy, monetary policy, financial regulation, with a New Zealand perspective

The Grumpy Economist

Celebrating humanity's flourishing through the spread of capitalism and the rule of law

International Liberty

Restraining Government in America and Around the World