Day 2 of the Project TIER workshop on teaching reproducibility! We're starting out with discussion of the OSF as a collaboration tool for teaching transparency and reproducibility. I'd love to hear what other platforms people like for teaching.
What are the fears/barriers to incorporating reproducibility into your teaching? There are definitely some start-up costs to any skills learning or curriculum change, but you can start with small steps and proceed incrementally. Core principles and objectives can be achieved flexibly.
Why do (should) we teach computational reproducibility? Scientific benefits: enhances communication, facilitates cumulative progress (CR is necessary, but not sufficient for credibility) Students benefit regardless of career plans: enhances understanding, reinforces intellectual integrity
The reproducibility trifecta: 📁 Fixed folder structure 👷♀️ Explicit management of the working directory 👉 Use of relative paths in scripts
Soup-to-nuts reproducibility 🥫🥜 💽 input data -> (processing) -> 🔎 analysis data -> (analysis) -> 📊 results -> (writing) -> 📝 report -> (profit!)
There are many specifications for reproduction documentation (add more in the responses) * 🥫 www.projecttier.org/tier-protoco...aeadataeditor.github.io/aea-de-guida...www.worldbank.org/en/publicati...best-practice-and-impact.github.io/qa-of-code-g...
The key to computational reproducibility is documentation Documentation should enable an interested reader to redo all data processing and analysis underlying the reported results
Project TIER's vision for the future: Whenever students work with data on a computer, they use reproducible methods. Reproducibility is not a special topic or an elective; it is integrated into core classes throughout the curriculum. These norms are sustained by a culture among educators.
Slides and materials are available at osf.io/zhya6/
Hosted on the Open Science Framework
It's really nice to have diverse disciplines represented across the workshop members, with representation from ecology, economics, education, and environmental sciences, as well as psychology.