Data from a pre-publication independent replication initiative examining ten moral judgement effects

Warren Tierney; Martin Schweinsberg; Jennifer Jordan; Deanna M Kennedy; Israr Qureshi; S Amy Sommer; Nico Thornley; Nikhil Madan; Michelangelo Vianello; Eli Awtrey; Luke Lei Zhu; Daniel Diermeier; Justin E Heinze; Malavika Srinivasan; David Tannenbaum; Eliza Bivolaru; Jason Dana; Clintin P Davis-Stober; Christilene du Plessis; Quentin F Gronau; Andrew C Hafenbrack; Eko Yi Liao; Alexander Ly; Maarten Marsman; Toshio Murase; Michael Schaerer; Christina M Tworek; Eric-Jan Wagenmakers; Lynn Wong; Tabitha Anderson; Christopher W Bauman; Wendy L Bedwell; Victoria Brescoll; Andrew Canavan; Jesse J Chandler; Erik Cheries; Sapna Cheryan; Felix Cheung; Andrei Cimpian; Mark A Clark; Diana Cordon; Fiery Cushman; Peter H Ditto; Alice Amell; Sarah E Frick; Monica Gamez-Djokic; Rebecca Hofstein Grady; Jesse Graham; Jun Gu; Adam Hahn; Brittany E Hanson; Nicole J Hartwich; Kristie Hein; Yoel Inbar; Lily Jiang; Tehlyr Kellogg; Nicole Legate; Timo P Luoma; Heidi Maibeucher; Peter Meindl; Jennifer Miles; Alexandra Mislin; Daniel C Molden; Matt Motyl; George Newman; Hoai Huong Ngo; Harvey Packham; P Scott Ramsay; Jennifer L Ray; Aaron M Sackett; Anne-Laure Sellier; Tatiana Sokolova; Walter Sowden; Daniel Storage; Xiaomin Sun; Jay J Van Bavel; Anthony N Washburn; Cong Wei; Erik Wetter; Carlos T Wilson; Sophie-Charlotte Darroux; Eric Luis Uhlmann

doi:10.1038/sdata.2016.82

Data from a pre-publication independent replication initiative examining ten moral judgement effects

Warren Tierney
, Martin Schweinsberg
, Jennifer Jordan
, Deanna M Kennedy
, Israr Qureshi
, S Amy Sommer
, Nico Thornley
, Nikhil Madan
, Michelangelo Vianello
, Eli Awtrey
, Luke Lei Zhu
, Daniel Diermeier
, Justin E Heinze
, Malavika Srinivasan
, David Tannenbaum
, Eliza Bivolaru
, Jason Dana
, Clintin P Davis-Stober
, Christilene du Plessis
, Quentin F Gronau

Andrew C Hafenbrack, Eko Yi Liao, Alexander Ly, Maarten Marsman, Toshio Murase, Michael Schaerer, Christina M Tworek, Eric-Jan Wagenmakers, Lynn Wong, Tabitha Anderson, Christopher W Bauman, Wendy L Bedwell, Victoria Brescoll, Andrew Canavan, Jesse J Chandler, Erik Cheries, Sapna Cheryan, Felix Cheung, Andrei Cimpian, Mark A Clark, Diana Cordon, Fiery Cushman, Peter H Ditto, Alice Amell, Sarah E Frick, Monica Gamez-Djokic, Rebecca Hofstein Grady, Jesse Graham, Jun Gu, Adam Hahn, Brittany E Hanson, Nicole J Hartwich, Kristie Hein, Yoel Inbar, Lily Jiang, Tehlyr Kellogg, Nicole Legate, Timo P Luoma, Heidi Maibeucher, Peter Meindl, Jennifer Miles, Alexandra Mislin, Daniel C Molden, Matt Motyl, George Newman, Hoai Huong Ngo, Harvey Packham, P Scott Ramsay, Jennifer L Ray, Aaron M Sackett, Anne-Laure Sellier, Tatiana Sokolova, Walter Sowden, Daniel Storage, Xiaomin Sun, Jay J Van Bavel, Anthony N Washburn, Cong Wei, Erik Wetter, Carlos T Wilson, Sophie-Charlotte Darroux, Eric Luis Uhlmann

Department of Psychology

Singapore Eye Research Institute, Singapore National Eye Centre, Singapore, Singapore.
Novartis, Basel, Switzerland.
University of Washington Bothell
IE University
Collège de France
Padova University Hospital
George Washington University
University of Manitoba
Loyola University Chicago
Central Michigan University
Harvard University
University of Utah
Yale University
University of Missouri
Erasmus University Rotterdam
Amsterdam University of Applied Sciences
Universidade Católica Portuguesa
Hang Seng Management College
Roosevelt University, Chicago
University of Illinois at Urbana-Champaign
Illinois Institute of Technology
University of California Santa Barbara
University of South Florida
University of Massachusetts
Washington University in St. Louis
New York University Shanghai
American University, Washington
Northwestern Polytechnical University
University of Southern California
Monash University
Social Cognition Center Cologne
German Sport University Cologne
University of Illinois at Chicago
Toronto Western Hospital
Indiana University of Pennsylvania
University of Hong Kong
Thomas Jefferson University
Walter Reed Army Institute of Research (WRAIR)
Beijing Normal University
Stockholm School of Economics

Research output: Contribution to journal › Article › peer-review

6 Citations (SciVal)

Abstract

We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science.

Original language	English
Pages (from-to)	160082
Journal	Scientific Data
Volume	3
DOIs	https://doi.org/10.1038/sdata.2016.82
Publication status	Published - 11 Oct 2016

Keywords

Humans
Morals
Reproducibility of Results

Access to Document

10.1038/sdata.2016.82Licence: CC BY

Cite this

Tierney, W., Schweinsberg, M., Jordan, J., Kennedy, D. M., Qureshi, I., Sommer, S. A., Thornley, N., Madan, N., Vianello, M., Awtrey, E., Zhu, L. L., Diermeier, D., Heinze, J. E., Srinivasan, M., Tannenbaum, D., Bivolaru, E., Dana, J., Davis-Stober, C. P., du Plessis, C., ... Uhlmann, E. L. (2016). Data from a pre-publication independent replication initiative examining ten moral judgement effects. Scientific Data, 3, 160082. https://doi.org/10.1038/sdata.2016.82

Tierney, W, Schweinsberg, M, Jordan, J, Kennedy, DM, Qureshi, I, Sommer, SA, Thornley, N, Madan, N, Vianello, M, Awtrey, E, Zhu, LL, Diermeier, D, Heinze, JE, Srinivasan, M, Tannenbaum, D, Bivolaru, E, Dana, J, Davis-Stober, CP, du Plessis, C, Gronau, QF, Hafenbrack, AC, Liao, EY, Ly, A, Marsman, M, Murase, T, Schaerer, M, Tworek, CM, Wagenmakers, E-J, Wong, L, Anderson, T, Bauman, CW, Bedwell, WL, Brescoll, V, Canavan, A, Chandler, JJ, Cheries, E, Cheryan, S, Cheung, F, Cimpian, A, Clark, MA, Cordon, D, Cushman, F, Ditto, PH, Amell, A, Frick, SE, Gamez-Djokic, M, Grady, RH, Graham, J, Gu, J, Hahn, A, Hanson, BE, Hartwich, NJ, Hein, K, Inbar, Y, Jiang, L, Kellogg, T, Legate, N, Luoma, TP, Maibeucher, H, Meindl, P, Miles, J, Mislin, A, Molden, DC, Motyl, M, Newman, G, Ngo, HH, Packham, H, Ramsay, PS, Ray, JL, Sackett, AM, Sellier, A-L, Sokolova, T, Sowden, W, Storage, D, Sun, X, Van Bavel, JJ, Washburn, AN, Wei, C, Wetter, E, Wilson, CT, Darroux, S-C & Uhlmann, EL 2016, 'Data from a pre-publication independent replication initiative examining ten moral judgement effects', Scientific Data, vol. 3, pp. 160082. https://doi.org/10.1038/sdata.2016.82

@article{b7c25b23e6114568a3f16321b0b448f7,

title = "Data from a pre-publication independent replication initiative examining ten moral judgement effects",

abstract = "We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science.",

keywords = "Humans, Morals, Reproducibility of Results",

author = "Warren Tierney and Martin Schweinsberg and Jennifer Jordan and Kennedy, \{Deanna M\} and Israr Qureshi and Sommer, \{S Amy\} and Nico Thornley and Nikhil Madan and Michelangelo Vianello and Eli Awtrey and Zhu, \{Luke Lei\} and Daniel Diermeier and Heinze, \{Justin E\} and Malavika Srinivasan and David Tannenbaum and Eliza Bivolaru and Jason Dana and Davis-Stober, \{Clintin P\} and \{du Plessis\}, Christilene and Gronau, \{Quentin F\} and Hafenbrack, \{Andrew C\} and Liao, \{Eko Yi\} and Alexander Ly and Maarten Marsman and Toshio Murase and Michael Schaerer and Tworek, \{Christina M\} and Eric-Jan Wagenmakers and Lynn Wong and Tabitha Anderson and Bauman, \{Christopher W\} and Bedwell, \{Wendy L\} and Victoria Brescoll and Andrew Canavan and Chandler, \{Jesse J\} and Erik Cheries and Sapna Cheryan and Felix Cheung and Andrei Cimpian and Clark, \{Mark A\} and Diana Cordon and Fiery Cushman and Ditto, \{Peter H\} and Alice Amell and Frick, \{Sarah E\} and Monica Gamez-Djokic and Grady, \{Rebecca Hofstein\} and Jesse Graham and Jun Gu and Adam Hahn and Hanson, \{Brittany E\} and Hartwich, \{Nicole J\} and Kristie Hein and Yoel Inbar and Lily Jiang and Tehlyr Kellogg and Nicole Legate and Luoma, \{Timo P\} and Heidi Maibeucher and Peter Meindl and Jennifer Miles and Alexandra Mislin and Molden, \{Daniel C\} and Matt Motyl and George Newman and Ngo, \{Hoai Huong\} and Harvey Packham and Ramsay, \{P Scott\} and Ray, \{Jennifer L\} and Sackett, \{Aaron M\} and Anne-Laure Sellier and Tatiana Sokolova and Walter Sowden and Daniel Storage and Xiaomin Sun and \{Van Bavel\}, \{Jay J\} and Washburn, \{Anthony N\} and Cong Wei and Erik Wetter and Wilson, \{Carlos T\} and Sophie-Charlotte Darroux and Uhlmann, \{Eric Luis\}",

year = "2016",

month = oct,

day = "11",

doi = "10.1038/sdata.2016.82",

language = "English",

volume = "3",

pages = "160082",

journal = "Scientific Data",

issn = "2052-4463",

publisher = "Nature Research",

}

TY - JOUR

T1 - Data from a pre-publication independent replication initiative examining ten moral judgement effects

AU - Tierney, Warren

AU - Schweinsberg, Martin

AU - Jordan, Jennifer

AU - Kennedy, Deanna M

AU - Qureshi, Israr

AU - Sommer, S Amy

AU - Thornley, Nico

AU - Madan, Nikhil

AU - Vianello, Michelangelo

AU - Awtrey, Eli

AU - Zhu, Luke Lei

AU - Diermeier, Daniel

AU - Heinze, Justin E

AU - Srinivasan, Malavika

AU - Tannenbaum, David

AU - Bivolaru, Eliza

AU - Dana, Jason

AU - Davis-Stober, Clintin P

AU - du Plessis, Christilene

AU - Gronau, Quentin F

AU - Hafenbrack, Andrew C

AU - Liao, Eko Yi

AU - Ly, Alexander

AU - Marsman, Maarten

AU - Murase, Toshio

AU - Schaerer, Michael

AU - Tworek, Christina M

AU - Wagenmakers, Eric-Jan

AU - Wong, Lynn

AU - Anderson, Tabitha

AU - Bauman, Christopher W

AU - Bedwell, Wendy L

AU - Brescoll, Victoria

AU - Canavan, Andrew

AU - Chandler, Jesse J

AU - Cheries, Erik

AU - Cheryan, Sapna

AU - Cheung, Felix

AU - Cimpian, Andrei

AU - Clark, Mark A

AU - Cordon, Diana

AU - Cushman, Fiery

AU - Ditto, Peter H

AU - Amell, Alice

AU - Frick, Sarah E

AU - Gamez-Djokic, Monica

AU - Grady, Rebecca Hofstein

AU - Graham, Jesse

AU - Gu, Jun

AU - Hahn, Adam

AU - Hanson, Brittany E

AU - Hartwich, Nicole J

AU - Hein, Kristie

AU - Inbar, Yoel

AU - Jiang, Lily

AU - Kellogg, Tehlyr

AU - Legate, Nicole

AU - Luoma, Timo P

AU - Maibeucher, Heidi

AU - Meindl, Peter

AU - Miles, Jennifer

AU - Mislin, Alexandra

AU - Molden, Daniel C

AU - Motyl, Matt

AU - Newman, George

AU - Ngo, Hoai Huong

AU - Packham, Harvey

AU - Ramsay, P Scott

AU - Ray, Jennifer L

AU - Sackett, Aaron M

AU - Sellier, Anne-Laure

AU - Sokolova, Tatiana

AU - Sowden, Walter

AU - Storage, Daniel

AU - Sun, Xiaomin

AU - Van Bavel, Jay J

AU - Washburn, Anthony N

AU - Wei, Cong

AU - Wetter, Erik

AU - Wilson, Carlos T

AU - Darroux, Sophie-Charlotte

AU - Uhlmann, Eric Luis

PY - 2016/10/11

Y1 - 2016/10/11

N2 - We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science.

AB - We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science.

KW - Humans

KW - Morals

KW - Reproducibility of Results

U2 - 10.1038/sdata.2016.82

DO - 10.1038/sdata.2016.82

M3 - Article

C2 - 27727246

SN - 2052-4463

VL - 3

SP - 160082

JO - Scientific Data

JF - Scientific Data

ER -

Data from a pre-publication independent replication initiative examining ten moral judgement effects

Abstract

Keywords

Access to Document

Fingerprint

Cite this