BLUE
Profile banner
BN
Brian Nosek
@briannosek.bsky.social
Co-founder of Project Implicit, Society for Improving Psychological Science, and the Center for Open Science; Professor at the University of Virginia
3.4k followers233 following423 posts
BNbriannosek.bsky.social

The first calls out the selection process and indicates that they are not randomly selected or representative of the literature. This is correct. We committed to replicating findings that were not yet discovered. There is no way to define a population and randomly sample from undiscovered things.

2

BNbriannosek.bsky.social

One could argue that the prospective approach is dumb, but for us this was important -- we wanted to know from the outset of the discovery process that replications would occur. This could lead to the findings being unusual in other ways...

2
EJwamsleylab.bsky.social

I'm not concerned if the high replication rate is partly due to researchers selecting particularly robust effects to put forward. Being more cautious in our claims should be part of the methods reform process. We should all think 2x before putting forward "findings" we have low confidence in.

0
Profile banner
BN
Brian Nosek
@briannosek.bsky.social
Co-founder of Project Implicit, Society for Improving Psychological Science, and the Center for Open Science; Professor at the University of Virginia
3.4k followers233 following423 posts