thx to tech crunch for putting it so concisely: “The secret is using less, but better quality, data. Instead of training on a library of billions of images that can’t possibly all be quality controlled, described, or deduplicated, Ai2 curated and annotated a set of just 600,000.”

Ttechcrunch.comSep 25, 2024 1:01pm

AI2’s Molmo shows open source can meet, and beat, closed multimodal models

AI2’s Molmo shows open source can meet, and beat, closed multimodal models

The common wisdom is that companies like Google, OpenAI, and Anthropic, with bottomless cash reserves and hundreds of top-tier researchers, are the only ones that can make state-of-the-art foundation model. But as one among them famously noted, they “have…