Thu, 30 Jan|
FOWI common room, fourth floor
Cross-validation: Addressing the replicability crisis
Dr Serena Wee will present strategies to cross-validate your research; how to show that your findings also apply in other samples. Practical examples with the R package Caret will be provided.
Time & Location
30 Jan 2020, 1:00 pm – 2:00 pm
FOWI common room, fourth floor, 78 Murray Street, Perth WA, Australia
About the Event
Concerns over replicability are, in part, concerns about the generalizability of our (statistical) models to new samples and populations. In this talk, Dr Serena Wee from the University of Western Australia will discuss why model fitting implies model overfitting, when problems of overfitting are most likely to occur, and how cross-validation can help us (a) evaluate model generalizability, and (b) develop models that are more likely to generalise. I will also demonstrate how to conduct cross-validation using the R caret package. This presentation is from the perspective of a non-expert, and based on what I have learned in an attempt to address comments, rightly raised by reviewers, that my work might have capitalised on chance (Wee, Newman, & Joseph, 2014; Song, Wee, & Newman, 2017).