Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say ”Usually Not” | E-Axes
 

Search
Login
Username:
Password:
Not a member yet? Click here.
Forgot your Password?
Archives - Categories
Home
On Inequality
On the Eurozone Debt Crisis
On Monetary Policy and Central Banking
On Global Economic Growth
On the Greek Debt Crisis
On the Banking and Financial Sectors
On Brexit
On China
On India
On Global Inflation
On Currencies
On the US Debt
On the "Economics" of the Arab Spring
Blogs
Working Papers
Books
Books suggested by members



Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say ”Usually Not”

date Date: September 14, 2015
date Author(s): Andrew C. Chang and Phillip Li
date Affiliation: Federal Reserve Board
Abstract

We attempt to replicate 67 papers published in 13 well-regarded economics journals using author-provided replication files that include both data and code. Some journals in our sample require data and code replication files, and other journals do not require such files. Aside from 6 papers that use confidential data, we obtain data and code replication files for 29 of 35 papers (83%) that are required to provide such files as a condition of publication, compared to 11 of 26 papers (42%) that are not required to provide data and code replication files. We successfully replicate the key qualitative result of 22 of 67 papers (33%) without contacting the authors. Excluding the 6 papers that use confidential data and the 2 papers that use software we do not possess, we replicate 29 of 59 papers (49%) with assistance from the authors. Because we are able to replicate less than half of the papers in our sample even with help from the authors, we assert that economics research is usually not replicable. We conclude with recommendations on improving replication of economics research.


© 2011–2017 e-axes. All rights reserved. | Credits | Contact Us | Privacy Statement | Wed 24 Jan, 2018 13:33:16 PM
e-axes is proudly powered by Norder - Creative Solutions