Improving statistical inferences: Can a MOOC reduce statistical misconceptions about p-values, confidence intervals, and Bayes factors?
Statistical reforms in psychology and surrounding domains have been largely motivated by doubts surrounding the methodological and statistical rigor of researchers. In light of high rates of p-value misunderstandings, against the backdrop systematically raised criticisms of NHST, some authors have d...
Main Authors: | , , , |
---|---|
Format: | Other/Unknown Material |
Language: | unknown |
Published: |
Center for Open Science
2020
|
Subjects: | |
Online Access: | http://dx.doi.org/10.31234/osf.io/zt3g9 |
id |
crcenteros:10.31234/osf.io/zt3g9 |
---|---|
record_format |
openpolar |
spelling |
crcenteros:10.31234/osf.io/zt3g9 2023-09-05T13:19:55+02:00 Improving statistical inferences: Can a MOOC reduce statistical misconceptions about p-values, confidence intervals, and Bayes factors? Herrera-Bennett, Arianne Constance Heene, Moritz Lakens, Daniel Ufer, Stefan 2020 http://dx.doi.org/10.31234/osf.io/zt3g9 unknown Center for Open Science https://creativecommons.org/licenses/by/4.0/legalcode posted-content 2020 crcenteros https://doi.org/10.31234/osf.io/zt3g9 2023-08-18T12:45:29Z Statistical reforms in psychology and surrounding domains have been largely motivated by doubts surrounding the methodological and statistical rigor of researchers. In light of high rates of p-value misunderstandings, against the backdrop systematically raised criticisms of NHST, some authors have deemed misconceptions about p-value “impervious to correction” (Haller & Krauss, 2002, p. 1), while others have advocated for the entire abandonment of statistical significance in place of alternative methods of inference (e.g., Amrhein, Greenland, & McShane, 2019). Surprisingly little work, however, has empirically investigated the extent to which statistical misconceptions can be improved reliably within individuals, nor whether these improvements are transient or maintained. The current study (N = 2,320) evaluated baseline misconception rates of p-value, confidence interval, and Bayes factor interpretations among online learners, as well as rates of improvement in accuracy across an 8-week massive open online course (MOOC). Results demonstrated statistically significant improvements in accuracy rates, across all three concepts, for immediate learning (first post-test), as well as support for retained learning until week 8 (second post-test). The current work challenges the idea that statistical misconceptions are impervious to correction, and highlights the importance of pinpointing those more problematic misunderstandings that may warrant more efforts to support improvement. Before we abandon one of the most widely used approaches to statistical inferences in place of an alternative, it is worth exploring whether it is first possible to improve existing misunderstandings amid current methods used. Other/Unknown Material Greenland COS Center for Open Science (via Crossref) Greenland Haller ENVELOPE(-62.102,-62.102,-64.055,-64.055) |
institution |
Open Polar |
collection |
COS Center for Open Science (via Crossref) |
op_collection_id |
crcenteros |
language |
unknown |
description |
Statistical reforms in psychology and surrounding domains have been largely motivated by doubts surrounding the methodological and statistical rigor of researchers. In light of high rates of p-value misunderstandings, against the backdrop systematically raised criticisms of NHST, some authors have deemed misconceptions about p-value “impervious to correction” (Haller & Krauss, 2002, p. 1), while others have advocated for the entire abandonment of statistical significance in place of alternative methods of inference (e.g., Amrhein, Greenland, & McShane, 2019). Surprisingly little work, however, has empirically investigated the extent to which statistical misconceptions can be improved reliably within individuals, nor whether these improvements are transient or maintained. The current study (N = 2,320) evaluated baseline misconception rates of p-value, confidence interval, and Bayes factor interpretations among online learners, as well as rates of improvement in accuracy across an 8-week massive open online course (MOOC). Results demonstrated statistically significant improvements in accuracy rates, across all three concepts, for immediate learning (first post-test), as well as support for retained learning until week 8 (second post-test). The current work challenges the idea that statistical misconceptions are impervious to correction, and highlights the importance of pinpointing those more problematic misunderstandings that may warrant more efforts to support improvement. Before we abandon one of the most widely used approaches to statistical inferences in place of an alternative, it is worth exploring whether it is first possible to improve existing misunderstandings amid current methods used. |
format |
Other/Unknown Material |
author |
Herrera-Bennett, Arianne Constance Heene, Moritz Lakens, Daniel Ufer, Stefan |
spellingShingle |
Herrera-Bennett, Arianne Constance Heene, Moritz Lakens, Daniel Ufer, Stefan Improving statistical inferences: Can a MOOC reduce statistical misconceptions about p-values, confidence intervals, and Bayes factors? |
author_facet |
Herrera-Bennett, Arianne Constance Heene, Moritz Lakens, Daniel Ufer, Stefan |
author_sort |
Herrera-Bennett, Arianne Constance |
title |
Improving statistical inferences: Can a MOOC reduce statistical misconceptions about p-values, confidence intervals, and Bayes factors? |
title_short |
Improving statistical inferences: Can a MOOC reduce statistical misconceptions about p-values, confidence intervals, and Bayes factors? |
title_full |
Improving statistical inferences: Can a MOOC reduce statistical misconceptions about p-values, confidence intervals, and Bayes factors? |
title_fullStr |
Improving statistical inferences: Can a MOOC reduce statistical misconceptions about p-values, confidence intervals, and Bayes factors? |
title_full_unstemmed |
Improving statistical inferences: Can a MOOC reduce statistical misconceptions about p-values, confidence intervals, and Bayes factors? |
title_sort |
improving statistical inferences: can a mooc reduce statistical misconceptions about p-values, confidence intervals, and bayes factors? |
publisher |
Center for Open Science |
publishDate |
2020 |
url |
http://dx.doi.org/10.31234/osf.io/zt3g9 |
long_lat |
ENVELOPE(-62.102,-62.102,-64.055,-64.055) |
geographic |
Greenland Haller |
geographic_facet |
Greenland Haller |
genre |
Greenland |
genre_facet |
Greenland |
op_rights |
https://creativecommons.org/licenses/by/4.0/legalcode |
op_doi |
https://doi.org/10.31234/osf.io/zt3g9 |
_version_ |
1776200691655639040 |