Meta's Multi-token Paradigm & Google's Pixel Sound Predictor

🏝 TheTechOasis 🏝

part of the:

Welcome to the newsletter that keeps you updated on the latest developments at the cutting edge of AI by breaking down the most advanced systems in the world & the hottest news in the industry.

10-minute weekly reads.

🚨 Week’s Update 🚨

Welcome back! This week, we have news from Groq, Figure, OpenAI, Cognizant, & more.

Starting strong, Groq unveiled new features you can try on their website for free with ultra-fast throughput. This article includes video examples for inspiration.

Groq’s insane capabilities really give a perspective on how narrowed the industry’s focus is on GPUs, while other hardware like LPUs offer better performance at scale.

And once Etched.ai launches Sohu, things might start getting ‘interesting’ for NVIDIA’s dominance in LLM inference workloads.

In a recent study, Cognizant and Dataiku commented on enterprises' increased adoption of GenAI.

Let’s not get carried away with the hype and follow the money. We need less “yeah we are deploying GenAI” marketing stunts and more “stop bluffing and give me your core budget number for GenAI”.

The truth? Only 33% of companies have moved on from the experimental phase, aka no serious commitments for the time being.

Writer, one of the few GenAI companies that seem to be experiencing this unusual feeling called ‘having revenues,’ has announced new features, including a graph-based RAG pipeline.

The interesting thing to mention here is how knowledge graphs seem to be gaining momentum in the retrieval augmented space to detriment of vector databases, meaning we might be lowkey transcending to a new, more robust enterprise architecture.

SenseTime has announced a model, SenseNova 5.5, that allegedly surpasses GPT-4o in 5 out of 8 critical benchmarks.

In the latest issue of “China is catching up quickly” series, SenseTime really pushes the boundaries, putting to shame all those claims that ‘China is years behind’.

In fact, are they actually behind?

Talking about politics, both Apple and Microsoft have relinquished their board seats at OpenAI, amidst consistent scrutiny by regulators considering the—obvious—consolidation of the LLM market.

Finally, on more futuristic news, Figure AI has published a video with its partner BMW in which a humanoid is seen working in one of the latter’s factories.

As shown in the video, the robot is capable of autocorrecting the position of the metal piece. Seeing these robots self-correcting this early in robotics is truly remarkable.

🧐 You Should Pay Attention to 🧐

🤩 Meta’s New Model Paradigm

🤯 Google Predicts Sounds from Pixels

🤩 Meta’s New Model Paradigm 🤩

Have we discovered a better way of training Large Language Models (LLMs)?

This is what Meta is promising with its new research: it presents a model that predicts multiple tokens at once in every prediction, not just one, and with no training overhead.

This speeds up the model's text generation and, incredibly, makes it smarter, suggesting a new training paradigm for frontier AI.

With this article, you will learn about an interesting new paradigm that could be foundational for future…

Enjoyed the introduction? Subscribe or sign in to continue with this edition.