Bayesian hypothesis testing reveals that reproducible models in systems biology get more citations

This study investigates the citations of reproducible vs. not reproducible papers and is based on 328 published models, classified by Tiwari et al. based on their reproducibility are analyzed in this study. Hypothese testing is performed using a flexible Bayesian approach for a complete assessment of posteriors. The approach handels outliers via a non-central t distribution. Results show that reproducible papers are significantly more citet between 2013 and 2020, i.e. 10 years after the introduction of SBML. In conclusion, this statistical analysis demonstrates long-term benefits of reproducible modeling for the individual researcher and the scientific community.

DOI: 10.15490/

Zenodo URL: None

Created at: 3rd Oct 2022 at 16:29


Statistical analysis and BEST method of Kruschke for python applied on citation data in Systems Biology

The statistical analysis was performed in a jupyter notebook.
This notebook contains the commands for all performed analyses (Statistical_analysis_of_FAIR_citations.ipynb)

The Bayesian Estimation Superseeds the t Test (BEST) method of Kruschke 2013 was used for the Bayesian significance testing.
The method was implemented in a python class together with visualization and distributional analysis methods (

The results of the statistical analysis, including

Posterior traces and visualizations

Full posterior traces for all analysis are avalable.

Furthermore all visualizations of the paper are included.


BEST method and executable notebook

The folder contains the jupyter notebook for the execution of all analyses of the study.
The BEST method is used in the notebook and is added in a separate python skript.

  • Statistical analysis and python BEST

These checksums allow you to check a Snapshot you have downloaded hasn't been modified. For details on how to use these please visit this guide

MD5: eb989a40b1c2f165e5bdbf4193b1851c

SHA1: 8cc711005b767381ee569dcdefc8815efc084697

Höpfl, S. (2022). Bayesian hypothesis testing reveals that reproducible models in systems biology get more citations. FAIRDOMHub.
Snapshot 2 (11th Jan 2023) DOI
Snapshot 1 (3rd Oct 2022) DOI

Views: 365   Downloads: 9

Created: 3rd Oct 2022 at 16:29

Last updated: 3rd Oct 2022 at 16:32

Powered by
Copyright © 2008 - 2023 The University of Manchester and HITS gGmbH