10+ News To Keep You Up-to-Date with AI.

TLDR;

Welcome back! This week, I have a lot of news for you. Several new products (awesome ones and also, ironically, bad ones), new debt stories to keep you awake at night, market data, and others that will make you think deeply about the world we are moving towards.

Enjoy!

ASSISTANTS

ChatGPT and Claude get Interactive superpowers

Announced by OpenAI a few days ago and now by Anthropic, they have both added in-chat visual generation: they can now automatically create charts, diagrams, tables, and other interactive visuals within a conversation when they think it would help, or when you explicitly ask for them.

In Claude’s case, these visuals appear inline in the chat, unlike Claude’s older “artifacts” feature, which opens in a side panel (which seems to be ChatGPT’s case still, as seen in the thumbnail). The new visuals are more temporary and can change or disappear as the conversation evolves. The feature is rolling out to all users and is enabled by default.

TheWhiteBox’s takeaway:

Both apps are slowly becoming defaults for everything. They can literally help you with almost anything you want to do on your computer that involves text, code, and, soon enough, creative work, as Google is massively pushing for.

Eventually, the entire software stack will be built on top of these models, an idea I have called the ‘LLM Operating System’ in the past. It was more than a year ago, but it feels closer and “truer” than ever.

MODELS

Google Releases Embeddings 2

Google has released a new model, Gemini Embeddings 2. The main idea is that it places text, images, video, audio, and documents into a single shared embedding space, rather than handling only text embeddings. It supports more than 100 languages.

According to the piece, Gemini Embedding 2 can process up to 8,192 text tokens, up to six images, videos up to 120 seconds, native audio, and PDFs up to six pages.

TheWhiteBox’s takeaway:

But what does that mean? Picture a model that can semantically unify meaning across several data modalities. A text describing a penguin, an image of a penguin, and a video of a penguin will all be assigned the “same value.”

And why would you need that? Simple example: search. Imagine a product that can search images based on text descriptions. Sounds a lot like what Google Image Search does, right? Well, surprise, that’s exactly what is going on under the hood.

But this model takes it a step further by incorporating other modalities, meaning you can search for video with video, images with text, audio with video, and video with text… You get the gist.

WAR

AI, Under The Spot for Target Attacks

There’s mounting concern that AI’s role in warfare is much more than simply making plans.

The issue is that it seems AIs may have played a role in particular attacks, especially for targeting objectives. I won’t indulge in speculation about whether Claude or any AI participated in any particular attack, because I don’t know, but…

Enjoyed the introduction? Subscribe or sign in to continue with this edition.