BLUE
Profile banner
CT
Carl T. Bergstrom
@carlbergstrom.com
Biology professor at the University of Washington. I study how information flows in biology, science, and society. I wrote a book: *Calling Bullshit*: tinyurl.com/fdcuvd7b I love ravens and crows: tinyurl.com/mr2n5ymk he/him
47.5k followers1.5k following4.3k posts
CTcarlbergstrom.com

The entire idea of outsourcing the scientific ecosystem to LLMs — as described below — is a concept error that I can scarcely begin to get my head around. sakana.ai/ai-scientist/

In our report:

    We propose and run a fully AI-driven system for automated scientific discovery, applied to machine learning research.
    The AI Scientist automates the entire research lifecycle, from generating novel research ideas, writing any necessary code, and executing experiments, to summarizing experimental results, visualizing them, and presenting its findings in a full scientific manuscript.
    We also introduce an automated peer review process to evaluate generated papers, write feedback, and further improve results. It is capable of evaluating generated papers with near-human accuracy.
    The automated scientific discovery process is repeated to iteratively develop ideas in an open-ended fashion and add them to a growing archive of knowledge, thus imitating the human scientific community.
    In this first demonstration, The AI Scientist conducts research in diverse subfields within machine learning research, discovering novel contributions in popular areas
14

SEgojira65.bsky.social

Wait...the AI-generated reports are going to be peer-reviewed by...AI?

1
CTcarlbergstrom.com

"While there are still occasional flaws in the papers produced by this first version..." Meanwhile the authors note that the output itself fails to meet standards of scientific rigor, but treat this as a minor wrinkle, not a fundamental barrier imposed by using the wrong tool for the wrong job.

While containing some flaws (e.g. a slightly unconvincing interpretation of why its method is successful).....
5
TFthomasfuchs.at

Most The Onion articles are more believable

0
CDm00psy.bsky.social

wtf are these dipshits

0
CScscheid.net

It's hilarious to me that "sacana" is Brazilian slang for something in the general vicinity of "bastard", "scam artist" and "asshole"

1
Llauren1701.bsky.social

if they improve the quality of the papers enough that they're consistently discovering new facts about reality, will you really be happy? would that really be good? it sounds horrifying to me

0
Nnormbrown.bsky.social

Complete nonsense. And welcome to the brave new world of imaginary field work

0
WFwillsmith.fun

These are deeply unserious people who deserve to be mocked and then ignored.

0
CHcecilharr.bsky.social

Yikes! This would be a good satire of itself.

0
SBpeculiarsusan.bsky.social

“The Ai scientist”

0
Profile banner
CT
Carl T. Bergstrom
@carlbergstrom.com
Biology professor at the University of Washington. I study how information flows in biology, science, and society. I wrote a book: *Calling Bullshit*: tinyurl.com/fdcuvd7b I love ravens and crows: tinyurl.com/mr2n5ymk he/him
47.5k followers1.5k following4.3k posts