Beyond Reporting Statistical Significance: Identifying Informative Effect Sizes to Improve Scientific Communication

Paul Hanel, David M. A. Mehler

Research output: Contribution to journalArticle

7 Citations (Scopus)
86 Downloads (Pure)

Abstract

Transparent communication of research is key to foster understanding within and beyond the scientific community. An increased focus on reporting effect sizes in addition to p value–based significance statements or Bayes Factors may improve scientific communication with the general public. Across three studies (N = 652), we compared subjective informativeness ratings for five effect sizes, Bayes Factor, and commonly used significance statements. Results showed that Cohen’s U3 was rated as most informative. For example, 440 participants (69%) found U3 more informative than Cohen’s d, while 95 (15%) found d more informative than U3, with 99 participants (16%) finding both effect sizes equally informative. This effect was not moderated by level of education. We therefore suggest that in general, Cohen’s U3 is used when scientific findings are communicated. However, the choice of the effect size may vary depending on what a researcher wants to highlight (e.g. differences or similarities).

Original languageEnglish
Pages (from-to)468-485
Number of pages18
JournalPublic Understanding of Science
Volume28
Issue number4
Early online date8 Mar 2019
DOIs
Publication statusPublished - 1 May 2019

Keywords

  • Cohen’s U3
  • Cohen’s d
  • effect size
  • scientific communication
  • statistical communication
  • statistical significance

ASJC Scopus subject areas

  • Communication
  • Developmental and Educational Psychology
  • Arts and Humanities (miscellaneous)

Cite this