Bayesian hypothesis testing reveals that reproducible models in systems biology get more citations
Actions 
Order Assays
This study investigates the citations of reproducible vs. not reproducible papers and is based on 328 published models, classified by Tiwari et al. based on their reproducibility are analyzed in this study. Hypothese testing is performed using a flexible Bayesian approach for a complete assessment of posteriors. The approach handels outliers via a non-central t distribution. Results show that reproducible papers are significantly more citet between 2013 and 2020, i.e. 10 years after the introduction of SBML. This trend persists also for later periods with more than 95% credibility. In conclusion, this statistical analysis demonstrates long-term benefits of reproducible modeling for the individual researcher and the scientific community.
SEEK ID: https://fairdomhub.org/studies/1103
hidden item
Projects: Working Group Nicole Radde
Study position:
Export PNG
Download
Creators and Submitter
Views: 581
Created: 29th Sep 2022 at 12:57
Last updated: 11th Jan 2023 at 13:06
TagsThis item has not yet been tagged.
Related items
Projects: Working Group Nicole Radde, SteaPKMod
Institutions: University of Stuttgart
https://orcid.org/0000-0002-5300-0915
Currently I focuse on the integration of data into multi-scale models with statistical methods and uncertainty tracking in the research unit QuaLiPerF.
The German Network for Bioinformatics Infrastructure - de.NBI offers first class bioinformatics services including training and education to users in basic and applied life sciences research. In this network 40 projects belonging to eight service centers provide services that cover a wide variety of methods (genomics, proteomics, ...) and applications (from plants to humans). de.NBI-SysBio is the Systems Biology Service Center of de.NBI. In collaboration with FAIRDOM, de.NBI-SysBio serves the ...
Projects: de.NBI-SysBio, ExtremoPharm, ZucAt, Kinetics on the move - Workshop 2016, Example use cases, MIX-UP, Working Group Nicole Radde, MPIEvolBio-SciComp, SABIO-VIS
Web page: http://www.denbi.de
The group around Nicole Radde specializes in the modeling, analysis, and simulation of biochemical systems. This especially includes parameter optimization and identification.
Programme: de.NBI Systems Biology Service Center (de.NBI-SysBio)
Public web page: https://www.ist.uni-stuttgart.de/research/group-of-nicole-radde/
Start date: 11th Feb 2020
The statistical analysis was performed in a jupyter notebook. This notebook contains the commands for all performed analyses (Statistical_analysis_of_FAIR_citations.ipynb)
The Bayesian Estimation Superseeds the t Test (BEST) method of Kruschke 2013 was used for the Bayesian significance testing. The method was implemented in a python class together with visualization and distributional analysis methods (BEST_method_python_Kruschke2012.py). Also the bayesian multiple comparison analysis can be ...
Submitter: Sebastian Höpfl
Biological problem addressed: Model Analysis Type
Investigation: 1 hidden item
The Results of the analysis are structured in three parts:
- The results of the main analysis
- The results with a broader prior (Sensitivity analysis)
- The Results of the multiple period comparison
For each part, full posterior traces for all analysis and visualizations of the paper are avalable.
Furthermore the diagnostics and traces were added for the different analysis. The trace for the mulitple comparison was to large to upload it and is available on request.
Creator: Sebastian Höpfl
Submitter: Sebastian Höpfl
The classification in reproducible and not reproducible models was made by Tiwari et al.
Citations were looked up in Scopus, Web of Science and Google Scholar.
The following journals had to be excluded, as Journal Impact Factors (JIF) were missing or papers were discontinued:
- Experientia was closed 1996 and continued as Cellular and Molecular Life Sciences 1997
- The American journal of physiology – split into fields 1977, further splits in 1980 and 1989
- IFAC Proceedings Volumes – last issue ...
Creator: Sebastian Höpfl
Submitter: Sebastian Höpfl
The folder contains the jupyter notebook for the execution of all analyses of the study. The BEST method is used in the notebook and is added in a separate python skript.
There is a class for the BEST method according to Kruschke and a class für the BEST multiple comparison.
A conda environment file with all libraries that are necessary to perform the analysis, including the package version was created. It can be easily installed via conda env create -f pymc_env.yml
Creator: Sebastian Höpfl
Submitter: Sebastian Höpfl
Model type: Not specified
Model format: Not specified
Environment: Not specified
