October 2024 saw a National Security Memorandum and US framework for using AI in national security contexts. We go through the content so you don't have to, pull out the important bits, and summarize our main takeaways.

• (00:48) - The memorandum
• (06:28) - What the press is saying
• (10:39) - What's in the text
• (13:48) - Potential harms
• (17:32) - Miscellaneous notable stuff
• (31:11) - What's the US governments take on AI?
• (45:45) - The civil side - comments on reporting
• (49:31) - The commenters
• (01:07:33) - Our final hero
• (01:10:46) - The muck

• United States National Security Memorandum on AI
• Fact Sheet on the National Security Memorandum
• Framework to Advance AI Governance and Risk Management in National Security

Related Media

• CAIS Newsletter - AI Safety Newsletter #43
• NIST report - Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile
• ACLU press release - ACLU Warns that Biden-Harris Administration Rules on AI in National Security Lack Key Protections
• Wikipedia article - Presidential Memorandum
• Reuters article - White House presses gov't AI use with eye on security, guardrails
• Forbes article - America’s AI Security Strategy Acknowledges There’s No Stopping AI
• DefenseScoop article - New White House directive prods DOD, intelligence agencies to move faster adopting AI capabilities
• NYTimes article - Biden Administration Outlines Government ‘Guardrails’ for A.I. Tools
• Forbes article - 5 Things To Know About The New National Security Memorandum On AI – And What ChatGPT Thinks
• Federal News Network interview - A look inside the latest White House artificial intelligence memo
• Govtech article - Reactions Mostly Positive to National Security AI Memo
• The Information article - Biden Memo Encourages Military Use of AI

Other Sources

• Physical Intelligence press release - π0: Our First Generalist Policy
• OpenAI press release - Introducing ChatGPT Search
• WhoPoo App!!

Frontier developers continue their war on sane versioning schema to bring us Claude 3.5 Sonnet (New), along with "computer use" capabilities. We discuss not only the new model, but also why Anthropic may have released this model and tool combination now.

• (00:00) - Intro
• (00:22) - Hot off the press
• (05:03) - Claude 3.5 Sonnet (New) Two 'o' 3000
• (09:23) - Breaking down "computer use"
• (13:16) - Our understanding
• (16:03) - Diverging business models
• (32:07) - Why has Anthropic chosen this strategy?
• (43:14) - Changing the frame
• (48:00) - Polishing the lily

Links

• Anthropic press release - Introducing Claude 3.5 Sonnet (New)
• Model Card Addendum

Other Anthropic Relevant Media

• Paper - Sabotage Evaluations for Frontier Models
• Anthropic press release - Anthropic's Updated RSP
• Alignment Forum blogpost - Anthropic's Updated RSP
• Tweet - Response to scare regarding Anthropic training on user data
• Anthropic press release - Developing a computer use model
• Simon Willison article - Initial explorations of Anthropic’s new Computer Use capability
• Tweet - ARC Prize performance
• The Information article - Anthropic Has Floated $40 Billion Valuation in Funding Talks

Other Sources

• LWN.net article - OSI readies controversial Open AI definition
• National Security Memorandum
• Framework to Advance AI Governance and Risk Management in National Security
• Reuters article - Mother sues AI chatbot company Character.AI, Google over son's suicide
• Medium article - A Small Step Towards Reproducing OpenAI o1: Progress Report on the Steiner Open Source Models
• The Guardian article - Google's solution to accidental algorithmic racism: ban gorillas
• TIME article - Ethical AI Isn’t to Blame for Google’s Gemini Debacle
• Latacora article - The SOC2 Starting Seven
• Grandview Research market trends - Robotic Process Automation Market Trends

Brace yourselves, winter is coming for OpenAI - atleast, that's what we think. In this episode we look at OpenAI's recent massive funding round and ask "why would anyone want to fund a company that is set to lose net 5 billion USD for 2024?" We scrape through a whole lot of muck to find the meaningful signals in all this news, and there is a lot of it, so get ready!

• (00:00) - Intro
• (00:28) - Hot off the press
• (02:43) - Why listen?
• (06:07) - Why might VCs invest?
• (15:52) - What are people saying
• (23:10) - How *is* OpenAI making money?
• (28:18) - Is AI hype dying?
• (41:08) - Why might big companies invest?
• (48:47) - Concrete impacts of AI
• (52:37) - Outcome 1: OpenAI as a commodity
• (01:04:02) - Outcome 2: AGI
• (01:04:42) - Outcome 3: best plausible case
• (01:07:53) - Outcome 1*: many ways to bust
• (01:10:51) - Outcome 4+: shock factor
• (01:12:51) - What's the muck
• (01:21:17) - Extended outro

• Reuters article - OpenAI closes $6.6 billion funding haul with investment from Microsoft and Nvidia
• Goldman Sachs report - GenAI: Too Much Spend, Too Little Benefit
• Apricitas Economics article - The AI Investment Boom
• Discussion of "The AI Investment Boom" on YCombinator
• State of AI in 13 Charts
• Fortune article - OpenAI sees $5 billion loss in 2024 and soaring sales as big ChatGPT fee hikes planned, report says

More on AI Hype (Dying)

• Latent Space article - The Winds of AI Winter
• Article by Gary Marcus - The Great AI Retrenchment has Begun
• TimmermanReport article - AI: If Not Now, When? No, Really - When?
• MIT News article - Who Will Benefit from AI?
• Washington Post article - The AI Hype bubble is deflating. Now comes the hard part.
• Andreesen Horowitz article - Why AI Will Save the World

Other Sources

• Human-Centered Artificial Intelligence Foundation Model Transparency Index
• Cointelegraph article - Europe gathers global experts to draft ‘Code of Practice’ for AI
• Reuters article - Microsoft's VP of GenAI research to join OpenAI
• Twitter post from Tim Brooks on joining DeepMind
• Edward Zitron article - The Man Who Killed Google Search

The Open Source AI Definition is out after years of drafting, will it reestablish brand meaning for the “Open Source” term? Also, the 2024 Nobel Prizes in Physics and Chemistry are heavily tied to AI; we scrutinize not only this year's prizes, but also Nobel Prizes as a concept.

• (00:00) - Intro
• (00:30) - Hot off the press
• (03:45) - Open Source AI background
• (10:30) - Definitions and changes in RC1
• (18:36) - “Business source”
• (22:17) - Parallels with legislation
• (26:22) - Impacts of the OSAID
• (33:58) - 2024 Nobel Prize Context
• (37:21) - Chemistry prize
• (45:06) - Physics prize
• (50:29) - Takeaways
• (52:03) - What’s the real muck?
• (01:00:27) - Outro

Links

• Open Source AI Definition, Release Candidate 1
• OSAID RC1 announcement
• All Nobel Prizes 2024

More Reading on Open Source AI

• Kairos.FM article - Open Source AI is a lie, but it doesn't have to be
• The Register article - The open source AI civil war approaches
• MIT Technology Review article - We finally have a definition for open-source AI

On Nobel Prizes

• Paper - Access to Opportunity in the Sciences: Evidence from the Nobel Laureates
• Physics prize - scientific background, popular info
• Chemistry prize - scientific background, popular info
• Reuters article - Google's Nobel prize winners stir debate over AI research
• Wikipedia article - Nobel disease

Other Sources

• Pivot.ai article - People are ‘blatantly stealing my work,’ AI artist complains
• Paper - GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models
• Paper - Reclaiming AI as a Theoretical Tool for Cognitive Science | Computational Brain & Behavior

Why is Mark Ruffalo talking about SB1047, and what is it anyway? Tune in for our thoughts on the now vetoed California legislation that had Big Tech scared.

• (00:00) - Intro
• (00:31) - Updates from a relatively slow week
• (03:32) - Disclaimer: SB1047 vetoed during recording (still worth a listen)
• (05:24) - What is SB1047
• (12:30) - Definitions
• (17:18) - Understanding the bill
• (28:42) - What are the players saying about it?
• (46:44) - Addressing critiques
• (55:59) - Open Source
• (01:02:36) - Takeaways
• (01:15:40) - Clarification on impact to big tech
• (01:18:51) - Outro

• SB1047 legislation page
• SB1047 CalMatters page
• Newsom vetoes SB1047
• CAIS newsletter on SB1047
• Prominent AI nerd letter
• Anthropic's letter
• SB1047 ~explainer

Additional SB1047 Related Coverage

• Opposition to SB1047 'makes no sense'
• Newsom on SB1047
• Andreesen Horowitz on SB1047
• Classy move by Dan
• Ex-OpenAI employee says Altman doesn't want regulation

Other Sources

• o1 doesn't measure up in new benchmark paper
• OpenAI losses and gains
• OpenAI crypto hack
• "Murati out" -Mira Murati, probably
• Altman pitching datacenters to White House
• Sam Altman, 'podcast bro'
• Paper: Contract Design with Safety Inspections

OpenAI's new model is out, and we are going to have to rake through a lot of muck to get the value out of this one!

⚠ Opt out of LinkedIn's GenAI scraping ➡️ https://lnkd.in/epziUeTi

• (00:00) - Intro
• (00:25) - Other recent news
• (02:57) - Hot off the press
• (03:58) - Why might someone care?
• (04:52) - What is it?
• (06:49) - How is it being sold?
• (10:45) - How do they explain it, technically?
• (27:09) - Reflection AI Drama
• (40:19) - Why do we care?
• (46:39) - Scraping away the muck

Links relating to o1

• OpenAI blogpost
• System card webpage
• GitHub collection of o1 related media
• AMA Twitter thread
• Francois Chollet Tweet on reasoning and o1
• The academic paper doing something very similar to o1

Other stuff we mention

• OpenAI's huge valuation hinges on upending corporate structure
• Meta acknowledges it’s scraping all public posts for AI training
• White House announces new private sector voluntary commitments to combat image-based sexual abuse
• Sam Altman wants you to be grateful
• The Zuck is done apologizing
• IAPS report on technical safety research at AI companies
• Llama2 70B is "about as good" as GPT-4 at summarization tasks