Public Health Seminar
METHODS IN DATA SCIENCE AXIS
A replication crisis in methodological research?
Recent developments and remaining challenges
towards reliable empirical evidence
Louis Amphi- Isped
Campus Carreire – Université de Bordeaux
Open to all, no registration, videoconferencing only
Anne-Laure BOULESTEIX, PhD
Institute for Medical Information Processing, Biometry, and Epidemiology, Munich, Germany
Statisticians are often keen to analyze the statistical aspects of the so-called “replication crisis in science“. They condemn fishing expeditions and publication bias across empirical scientific fields applying statistical methods, such as health sciences. But what about good practice issues in their own – methodological – research, i.e. research considering statistical (or more generally, computational) methods as research objects? When developing and evaluating new statistical methods and data analysis tools, do statisticians and data scientists adhere to the good practice principles they promote in fields which apply statistics and data science? I argue that methodological researchers should make substantial efforts to address what may be called the replication crisis in the context of methodological research in statistics and data science, in particular by trying to avoid bias in comparison studies based on simulated or real data. I discuss topics such as publication bias, cherry-picking, and the design and necessity of neutral comparison studies, and review recent positive developments towards more reliable empirical evidence in the context of methodological biostatistical research.
Meeting ID: 847 9055 3944