Weights and Biases’ Weave: wandb.me/ai_explained
And yes, the title is not clickbait, a company is pledging to build data centers in space, but that follows failed attempts in the sea. Plus, distributed training, Gemini 2, Grok-3, Colossus, CharacterAI, Orion, and … chapters.
AI Insiders: https://www.patreon.com/AIExplained
Chapters:
00:00 – Intro
01:06 – SSI, Safe Superintelligence (Sutskever)
03:45 – Grok-3 (Colossus) + Altman Concerned
05:36 – CharacterAI + Foundation Models
06:26 – $125B Supercomputers + 5-10GW
08:28 – ‘GPT-6’ Scale
09:07 – Zuckerberg on Exponentials and Doubt
09:42 – Strawberry/Orion + Connections + Weights
11:39 – Data Centers in Space (and the sea)
12:45 – Distributed Training + SemiAnalysis Report w/ Gemini 2
17:34 – Climate Change Pledges?
Weights and Biases’ Weave: wandb.me/ai_explained
Safe Superintelligence (Sutskever SSI): https://www.reuters.com/technology/artificial-intelligence/openai-co-founder-sutskevers-new-safety-focused-ai-startup-ssi-raises-1-billion-2024-09-04/
$125B Data Centers: https://www.theinformation.com/articles/two-ai-developers-are-plotting-125-billion-supercomputers?utm_source=ti_app&rc=sy0ihq
Altman ‘Too Aggressive’: https://www.theinformation.com/articles/openai-has-talked-to-broadcom-about-developing-new-ai-chip?rc=sy0ihq
OpenAI Orion: https://www.theinformation.com/articles/openai-races-to-launch-strawberry-reasoning-ai-to-boost-chatbot-business?rc=sy0ihq
Semianalysis Report: https://www.semianalysis.com/p/multi-datacenter-training-openais
https://www.semianalysis.com/p/100000-h100-clusters-power-network
Xai Colossus: https://x.com/elonmusk/status/1830650370336473253
https://x.com/elonmusk/status/1815341263102804072
Altman Reacts: https://www.theinformation.com/articles/introducing-the-ai-data-center-database?rc=sy0ihq
GPT-6 Co-location: https://x.com/corbtt/status/1772392525174620355
Data Centers in Space: https://x.com/8teAPi/status/1831113308356964464
And Underwater: https://www.itpro.com/infrastructure/data-centres/microsoft-scrapped-its-project-natick-underwater-data-center-trial-heres-why-it-was-never-going-to-work
Zuckerberg on Power and Exponentials: https://www.youtube.com/watch?v=i-o5YbNfmh0
Epoch AIB Report: https://epochai.org/blog/can-ai-scaling-continue-through-2030
Original SuperAlignment Deadline: https://openai.com/index/introducing-superalignment/
Character AI Bought: https://www.theinformation.com/articles/google-hires-character-ai-cofounders-and-licenses-its-models?rc=sy0ihq
My New Coursera Course! The 8 Most Controversial Terms in AI: https://imp.i384100.net/m57g3M
Non-hype Newsletter: https://signaltonoise.beehiiv.com/
GenAI Hourly Consulting: https://www.theinsiders.ai/
Weights and Biases’ Weave: wandb.me/ai_explained
