OpenAI's Strawberry & Google's Million-Expert LLM

TLDR;

🗞️ News from the big tech crash, Andrej Karpathy’s new venture, OpenAI and Salesforce

📚 The Resource Corner: Some of what I’ve been reading/seeing over the last week

🍓 OpenAI's Project Strawberry

✨ Google's Million-Expert LLM

NEWSREEL

Week’s Update 🚨

Over the past few days, the ‘Magnificent Seven’, the seven largest big tech companies, saw the erosion of $1.1 trillion, the Netherlands’ entire GDP (2022), and $500 billion on Wednesday alone, amid fears of potential upcoming higher restrictions on exports to China imposed by Joe Biden, an escalation in the ongoing chip war between the US and China.

The fall also affected Asian stocks, as well as the Dutch ASML, and basically any company related to the chips supply chain.

In the case of the hyperscalers, the big tech companies providing cloud services, the fall was particularly steep amid concerns that the US Government would soon target them from providing GPU services to Chinese companies, reducing the impact of the export sanctions.

Also, the overall sentiment toward AI is shifting, especially considering Goldman Sachs’ report listed below.

Moving on, Salesforce has announced a new AI Service Agent for its platform, using their Einstein Copilot as the foundation. It can autonomously handle customer service tasks and integrate with company records for seamless support.

The main takeaway for me is what I outlined in my winners & losers article; most SaaS products will evolve into declarative apps where you leverage an AI agent to perform the actions. I predict some of these products will even end up with no interface besides chat.

Andrej Karpathy, legendary researcher, has announced the creation of Eureka Labs, an AI-native school. Andrej is known for being extremely educational about AI, and this company could personify that mission.

Can’t recommend it’s Zero-to-One Neural Network series enough (it’s free).

As for our weekly touchpoint on OpenAI, anonymous ex-OpenAI whistleblowers have accused OpenAI of using NDAs that illegally restrict employees from reporting issues to regulators.

On the flip side, they have released exciting research using games to train LLMs to be more transparent and explanatory.

Lately, OpenAI has been immersed in a bad PR flywheel due to its excessive closeness (the irony considering it is called OpenAI).

As for the research, it’s becoming clear that the future of OpenAI models screams ‘verifiers.’ That is, using smaller models in real time to verify or validate the big model's ‘thoughts’ and allow it to search for solutions.

Care to understand more? Read the article below on Project Strawberry.

LEARN

The Resource Corner 📚

😱 GenAI: Too Much Spend, Too Little Benefit, by Goldman Sachs

🌳 AI Optimism vs AI Arms Race, by Sequoia Capital

🫡 Misha Laskin on the Future of AI Agents, from the Training Data Podcast

🤩 Microsoft’s Spreadsheet LLM, a new model specifically designed to work with spreadsheets, and Excel’s Future?

🧠 Extremely insightful philosophical discussion on LLMs, by ML Street Talk with Murray Shanahan (Google)

OPENAI

Project Strawberry 🍓

In an exclusive, Reuters claims having obtained leaked…

Enjoyed the introduction? Subscribe or sign in to continue with this edition.