The Platonic Representation & Apple Intelligence

Sponsored by

🏝 TheTechOasis 🏝

part of the:

Welcome to the newsletter that keeps you updated on the latest developments at the cutting edge of AI by breaking down the most advanced systems in the world & the hottest news in the industry.

10-minute weekly reads.

🚨 Week’s Update 🚨

Welcome back! This week, we have news from China, Anthropic, Stability AI, Together.ai, OpenAI, and more.

A new video generation model from China is shocking the world. Named Kling, it offers a performance that matches Sora while having double the video length, up to 2 minutes for high-definition videos.

Fueling this frenzy, San Francisco start-up Luma AI has released DreamMachine, another text-to-video that looks very good. Is the industry getting bored of LLMs and ready for an exciting new race in video?

China’s insane progress comes in handy when considering that the US is trying to kill its open-source industry with the SB-1047 bill. If US regulators think a bill in California is going to be followed by China (or Rusia) they are out of their mind.

Also, considering that most AI talent in the world already comes from China, this could be the beginning of the end of the US’ AI supremacy.

Moving on, Anthropic released quite an interesting piece on how they approach the character development of their chatbot Claude.

This is the type of content I would never show to people starting off with AI, because it’s extremely tempting to believe Claude has a character of its own if you read this.

It’s a fascinating read, but please bear in mind we are talking about a model imitating the desired character, not developing it.

As for the open-source community, Stability AI seems desperate to disappear. They released the weights of Stable Diffusion 3 Medium, and the results are, frankly, embarrassing. Simply put, the model cannot draw humans, generating horrifying scenes.

Stability AI is extremely zealous in ensuring their datasets are clean and absent of undesirable content, like porn. The fact that their models miss on so much unethical data causes the model to fall considerably behind private players.

OpenAI announced its mechanistic interpretability efforts on GPT-4, claiming to have found around 16 million features that help us understand how these models see our world.

Interestingly, the method they used is highly similar to that of Anthropic; the use of sparse autoencoders to map neural activations into interpreatable features.

Continuing on OpenAI, Elon Musk has dropped its March 2024 lawsuit against them, but without explanation.

However, Elon Musk did slam Apple’s announcement on their integration with OpenAI, even threatening the ban of all Apple products in his companies.

Finally, as I know many of you read my newsletter because I tend to avoid the unnecessary hype, I want to leave you with an extract from an interview with François Chollet, creator of the highly influential Keras library, on why LLMs will not take us to AGI.

In fact, he argues LLMs are taking us away from that goal…

Enjoyed the introduction? Subscribe or sign in to continue with this edition.