Which findings should be published?

Speaker
Alexander Frankel
Date
19/03/2018 - 12:30 - 11:10Add To Calendar 2018-03-19 11:10:00 2018-03-19 12:30:00 Which findings should be published? Not all empirical findings are published. What is the socially optimal  rule for deciding whether a study should be published in scarce journal space? We show that if the goal of publication is to inform policymakers about a policy-relevant parameter, then one should publish extreme or ``surprising" results. For specific policy objectives, the optimal rule may take the form of a one- or two-sided test comparing the point estimate to the prior mean. Dynamic considerations may additionally justify the publication of precise null results. However, if one insists on a rule for which the absence of publication is not informative, or for which frequentist inference remains valid conditional on publication, then the publication rule must not select on the study's findings (but may still select on the study's design). We also characterize publication rules that maximize alternative objectives such as learning or the plausibility of published findings.  Building 504 (Economics), seminar room 011 אוניברסיטת בר-אילן - Department of Economics Economics.Dept@mail.biu.ac.il Asia/Jerusalem public
Place
Building 504 (Economics), seminar room 011
Affiliation
University of Chicago
Abstract

Not all empirical findings are published. What is the socially optimal  rule for deciding whether a study should be published in scarce journal space? We show that if the goal of publication is to inform policymakers about a policy-relevant parameter, then one should publish extreme or ``surprising" results. For specific policy objectives, the optimal rule may take the form of a one- or two-sided test comparing the point estimate to the prior mean. Dynamic considerations may additionally justify the publication of precise null results. However, if one insists on a rule for which the absence of publication is not informative, or for which frequentist inference remains valid conditional on publication, then the publication rule must not select on the study's findings (but may still select on the study's design). We also characterize publication rules that maximize alternative objectives such as learning or the plausibility of published findings. 

Last Updated Date : 04/03/2018