Björn Brembs
@brembs@mastodon.social  ·  activity timestamp last week

To my knowledge, first time that not only prestigious journals, but also prestigious institutions are implicated as major drivers of irreproducibility:

"Higher representation of challenged claims in trophy journals and from top universities"

https://www.biorxiv.org/content/10.1101/2025.07.07.663460v2

#reproducibility #openscience
Björn Brembs
@brembs@mastodon.social  ·  activity timestamp last week

The killer quote! Prestigious institutions and prestigious journals drive irreproducibility in the life sciences - well, at least in this particular sample.

biorxiv.org/content/10.1101/20

Previous work has suggested journal rank as a major associate of irreproducibility (Brembs et al., 2013), and that high-impact journals favour authors from leading institutions (Kulal et al., 2025). Our study highlights how university ranking is among the most striking correlates of irreproducibility. Taken together, the cause and effect relationship at play here may be driven most by factors associated with institutional prestige, such as trust among networks of colleagues that act as editors and reviewers, leading to greater acceptance rates at high-impact journals. Importantly, our results suggest this greater acceptance does not strictly reflect a high quality of the work being published, but rather a willingness to trust irreproducible work more frequently if it comes from a prestigious institute.
Previous work has suggested journal rank as a major associate of irreproducibility (Brembs et al., 2013), and that high-impact journals favour authors from leading institutions (Kulal et al., 2025). Our study highlights how university ranking is among the most striking correlates of irreproducibility. Taken together, the cause and effect relationship at play here may be driven most by factors associated with institutional prestige, such as trust among networks of colleagues that act as editors and reviewers, leading to greater acceptance rates at high-impact journals. Importantly, our results suggest this greater acceptance does not strictly reflect a high quality of the work being published, but rather a willingness to trust irreproducible work more frequently if it comes from a prestigious institute.
Previous work has suggested journal rank as a major associate of irreproducibility (Brembs et al., 2013), and that high-impact journals favour authors from leading institutions (Kulal et al., 2025). Our study highlights how university ranking is among the most striking correlates of irreproducibility. Taken together, the cause and effect relationship at play here may be driven most by factors associated with institutional prestige, such as trust among networks of colleagues that act as editors and reviewers, leading to greater acceptance rates at high-impact journals. Importantly, our results suggest this greater acceptance does not strictly reflect a high quality of the work being published, but rather a willingness to trust irreproducible work more frequently if it comes from a prestigious institute.
Björn Brembs
@brembs@mastodon.social  ·  activity timestamp last week

And yet another one in the ever increasing list of analyses showing that top journals are bad for science:

"Thus, our analysis show major claims published in low-impact journals are significantly more likely to be reproducible than major claims published in trophy journals. "

https://www.biorxiv.org/content/10.1101/2025.07.07.663460v2

#publishing #openscience #reproducibility