Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Download Open Analysis/Preregistration
Document related concepts
no text concepts found
Transcript
Open Science as Pro-Social and Pro-Self Charlie Ebersole University of Virginia Slides from this session: osf.io/3chwb/ Increasing Openness in Research Open Practices Benefits to Science Costs to You Benefits to You Open Materials Enables future research, Encourages replication Time spent organizing/posting Enables collaboration, Methods section done Time spent planning analyses, Simulating data Save time in analysis/writing results, Increased confidence Time spent organizing/posting, Possibility of being scooped More efficient reviews, More citations, Future collaborations Increase confidence, Open Analysis/Preregistr Checking past findings ation Open Data Enables new exploration/analysis, Checking past findings Open Science as Pro-Social Open Practices Benefits to Science Costs to You Benefits to You Open Materials Enables future research, Encourages replication Time spent organizing/posting Enables collaboration, Methods section done Time spent planning analyses, Simulating data Save time in analysis/writing results, Increased confidence Time spent organizing/posting, Possibility of being scooped More efficient reviews, More citations, Future collaborations Increase confidence, Open Analysis/Preregistr Checking past findings ation Open Data Enables new exploration/analysis, Checking past findings Open Science as Pro-Social Openness in Practice Study Idea Design Methods Full protocol shared, with analysis plan Data Collection Analysis scripts preregistered Data Analysis Many Labs 3: osf.io/ct89g Open Data Write-up/Peer Review Open Materials as Pro-Self • Catch errors early – Enables review from experts/collaborators – Ensures data can be analyzed • Methods section – Copy and paste – Regain initial time loss Open Analysis/Preregistration as Pro-Self • Data analysis – Results a click away (regain initial time loss) – Helps future you • Peer review – Bonus points from reviewers – Facilitates answering reviewer questions Open Data as Pro-Self • Peer review – Reviewers able to answer own questions – Don’t have to answer every new question • Accelerating impact – Enables more research (more citations) – Open up new (efficient) collaborations Open Science as Pro-Self Open Practices Benefits to Science Costs to You Benefits to You Open Materials Enables future research, Encourages replication Time spent organizing/posting Catch errors early, Methods section done Time spent planning analyses, Simulating data Save time in analysis and in future use, Easier peer review Time spent organizing/posting, Possibility of being scooped More efficient reviews, More citations, Future collaborations Increase confidence, Open Analysis/Preregistr Checking past findings ation Open Data Enables new exploration/analysis, Checking past findings Facilitating Open Science • Psi Chi Research Opportunities Page – https://www.psichi.org/?page=Res_Opps • Collaborative Replications and Education Project (CREP) – osf.io/wfc6u/ • Measures and Materials Repository – osf.io/4np7u/ Acknowledgments • Brian Nosek and the Center for Open Science • John Edlund and the Psi Chi Research Advisory Committee • Many Labs 3 Leadership Team, Collaborators, and Peer Reviewers Slides from this session: osf.io/3chwb/ Open Science as Pro-Self Open Practices Benefits to Science Costs to You Benefits to You Open Materials Enables future research, Encourages replication Time spent organizing/posting Catch errors early, Methods section done Time spent planning analyses, Simulating data Save time in analysis and in future use, Easier peer review Time spent organizing/posting, Possibility of being scooped More efficient reviews, More citations, Future collaborations Increase confidence, Open Analysis/Preregistr Checking past findings ation Open Data Enables new exploration/analysis, Checking past findings Increasing Openness in Research • Institutions: Center for Open Science, Open Science Framework • Incentives: Badges, BITSS Awards • Policy: Transparency and Openness Promotion (TOP) Guidelines Openness in Many Labs 3 • Commitment to Openness and Preregistration • Prior to data collection – Full protocol, all materials created (in detail) – Analysis plans for all effects written • Prior to analysis – All analysis scripts created – Data cleaned and posted Open Science as Pro-Social Open Practices Benefits to Science Costs to You Benefits to You Open Materials Enables future research, Encourages replication Time spent organizing/posting Enables collaboration, Methods section done Open Increase confidence, Analysis/Preregistrati Checking of past on findings Time spent planning analyses, Simulating data, Loss of flexibility Save time in analysis, More efficient reviews, Also increased confidence Open Data Time spent organizing/posting, Possibility of being proactively scooped More efficient reviews, More citations and collaboration Enables new exploration/analysis, Checking of past findings
