New paper alert! #statistics #metascience "On the poor statistical properties of the P-curve meta-analytic procedure" in JASA. https://raw.githubusercontent.com/richarddmorey/MoreyDavisStober_pcurveASA/refs/heads/main/text/asa_article/Morey_Davis-Stober_2025_JASA_with_supplement.pdf

We show that the "P curve" meta-analysis tests have terrible statistical properties, in spite of being used for over a decade to tell "bad" science from "good". The initial tests should never have made it through peer review. They suffer from extreme sensitivity, arbirary conclusions, inadmissibility, nonmonotonicity in the evidence, and inconsistency in estimation. We recommend they not be used, and that better vetting is needed for methods in metascience.

Journal link: https://www.tandfonline.com/doi/full/10.1080/01621459.2025.2544397