New post based on an interesting recent conversation ‘Test-based confidence intervals or confidence-interval-based tests?’ open.substack.com/pub/tpmorris...

Test-based confidence intervals or confidence-interval-based tests?

Confidence intervals and tests often correspond. That is, if a one-sided test returns p=0.05 then the bound of a one-sided confidence interval should touch the null H0; if a one-sided test returns p>0...

The Metascience conference is coming to London! June 30-July 2, 2025

CFcos.ioMay 13, 2024 12:04pm

Save the date! COS and @rorinstitute.bsky.social have partnered to bring the Metascience Conference to London! ℹ️ Learn more: metascience.info ➡️ Sign up for updates: eepurl.com/iPa39k #metascience2025

I was also surprised that it is not open access... Hopefully an error that will be quickly be corrected.

NEW PAPER: Data are often imperfect, do not fulfill assumptions of methods, etc. What is the impact on the reliability of results? Abrahamowicz et al. (with @timpmorris.bsky.socialacademic.oup.com/aje/advance-...

Data-Driven Simulations to Assess the Impact of Study Imperfections in Time-to-Event Analyses

Abstract. Quantitative bias analysis (QBA) permits assessment of the expected impact of various imperfections of the available data on the results and conc

JAMA introduces a new framework for drawing causal inferences from observational data. Including a call for adopting explicit causal language. This is a key moment in the embrace of contemporary causal inference methods within health science! jamanetwork.com/journals/jam...#EpiSky#CausalSky

Causal Inference and Effects of Interventions From Observational Studies in Medical Journals

This study examines drawing causal inferences about the effects of interventions from observational studies in medical journals.

They’re trying to get a hold on the jungle of cluster analysis. statmodeling.stat.columbia.edu/2024/05/12/t...

An update on Gino's lawsuit against us (Data Colada). We had a hearing about our motion to dismiss, and we've learned some legal things along the way. No big news yet, but some details: datacolada.org/116

[116] Our (First?) Day In Court - Data Colada

“Any update on the lawsuit?” That is the most common question any of us is asked. It is usually preceded by an apologetic preamble, like, “sorry if this is a sensitive question,” or “I don’t know if you’re tired of talking about this, but…” The reality is that, for the most part, our actual sensitivity...

I'm excited at the prospect of working closely with someone on the implementation of what promises to be an impactful project! Don't hesitate to ask me about the role!

co-authors are @iamjulianlange.bsky.social K. Eggensperger, G. Casalicchio, M. Wever, M. Feurer, D. Rügamer, E. Hüllermeier, myself and B. Bischl

NEW accepted ICML'24 position paper: „Rethinking Empirical Research in Machine Learning: Addressing Epistemic and Methodological Challenges of Experimentation“ by Moritz Herrmann et al.: arxiv.org/abs/2405.02200

Position Paper: Rethinking Empirical Research in Machine Learning:...

We warn against a common but incomplete understanding of empirical research in machine learning (ML) that leads to non-replicable results, makes findings unreliable, and threatens to undermine...