Using Beethoven to Discover New Materials

TLDR;

✋🏼 OpenAI Sora Leaked

🥸 The Scam That Wasn’t A Scam After All?

🤖 Olmo2, The Best Fully Open LLM to Date

🫡 Anthropic Launches ‘Claude Styles’

🤨 Anthropic Models Engage in Uncanny Conversation

✒️ AI Poetry is Indistinguishable to Humans

📹 Runway Launches ‘Frames’ Model

[TREND OF THE WEEK] Using Beethoven to Discover New Materials

NEWSREEL

OpenAI Sora Leaked

OpenAI’s Sora model was leaked for a short time. A group of artists serving as beta testers for the unreleased text-to-video AI model, Sora, have leaked access to the tool in protest.

They allege that OpenAI exploited their unpaid labor for research and public relations purposes, using them as free bug testers and for “art washing,” which lends artistic credibility to the product.

The leak enabled the widespread generation of AI-created videos resembling OpenAI’s demos before the company revoked access. OpenAI responded by stating that participation in the research preview was voluntary and emphasized its support for artists through grants and other programs. The company is working to balance creativity with robust safety measures before Sora’s broader release.

TheWhiteBox’s takeaway:

Without weighing in the dispute, which I do not know who is at fault here, the only thing I can say is that video generation is the biggest “fun toy you’ll play with for 10 minutes and never use it again” technology ever if it doesn’t improve its understanding of the world.

I mean, what on Earth is this thing below?

It can generate moving dogs, yes, but it doesn’t understand normal dog behavior and interactions, let alone one of the most basic concepts in physics: solid objects can’t go through each other. And even if it seems it can understand shadows, these behave in supernatural ways (the tails make shadows only at some points).

Source

The videos are impressive, but you can instantly observe a tremendous amount of inaccuracies. These make it clear that the model simply imitates things it has seen many times without fully understanding them. While LLMs can hide their poor understanding by writing text, the gaps in knowledge and proper understanding from AI are clear with video models.

Extensive engineering may yield some decent results, but as some have proclaimed, this is not the tool that will end Hollywood—not in its current form.

The only thing that makes me interested in video generation is that video carries much more information about the world than text, which means that, at scale, these models seem to be more suited to becoming world models (models that can predict events in the real world, much needed for things like embodied AI) than models like GPT-4. In other words, I believe the path to AGI is closer to video models than to LLMs.

HARDWARE

The Scam That Wasn’t A Scam After All?

A while back, we discussed the Rabbit R1, visionary hardware that allowed users to interact via voice with a Generative AI model that executed actions on their behalf.

However, when the product was first released, it received…

Enjoyed the introduction? Subscribe or sign in to continue with this edition.