The Artificial Intelligence Show Podcast - Ep. 235: OpenAI-Hugging Face Hack Involved 100s of Agents, & Bill Gates Now Pessimistic on Jobs

Transcript

Intro

0:00 · I think the sooner we just accept it's going to be messy and we don't have all the answers and like we're not asking the hard enough questions, then we can move into the phase where we actually do that and then it's more addressable.

0:10 · Like pretending like this is just going to go perfect and AI is only good and amazing doesn't do anybody anything.

0:19 · Welcome to the [music] artificial intelligence show, the podcast that helps your business grow smarter by making AI approachable [music] and actionable. My name is Paul Ritzer. I'm the founder and CEO of Smarter X and Marketing AI Institute [music] and I'm your host. Each week, I'm joined by my co-host and SmarterX Chief Content Officer, Mike Kaput, [music] as we break down all the AI news that matters and give you insights and perspectives that [music] you can use to advance your company and your career. Join [music] us as we accelerate AI literacy for all.

0:55 · Welcome to episode 235 of the artificial intelligence show. I am your host Paul Ritzer along with my co-host Mike Put.

1:01 · We are recording on the final day of August. August 31st about 8:45 a.m. Um, so you'll be listening to this. It will be September.

1:12 · August has been an interesting month, Mike. I mean, lots happening [laughter] based on the stuff we're going to talk about today. We may get a year's worth of progress in the next 30 days. So, we'll sort of set the stage for what could be coming with uh some updates on the hugging face story, which is getting crazier by the week. Bill Gates jumping into the fold with his thoughts on well, I guess his changing thoughts on AI's impact on jobs and the economy. And um and then Nvidia keeps chugging along.

1:41 · So, those are going to be our first three main topics, but there's a lot to get into. So this week's episode is brought to you by MECON, the AI conference for marketing and business leaders that is happening October 13 to 15 in our hometown of Cleveland, Ohio.

1:54 · If you've been thinking about joining us at MECON this year, we have a special offer exclusively for podcast listeners.

2:01 · And I uh thank you to everyone who's already taken advantage of this offer.

2:04 · We're looking forward to seeing you. Uh at MECON, we are hosting a private lunch exclusively for our podcast audience.

2:11 · During that lunch, you'll be able to ask Mike and myself any questions on your mind about AI, your company, your career, or whatever you're trying to navigate. It's a whole hour of totally unfiltered ask us anything about AI uh with us and fellow members of the artificial intelligence show audience.

2:28 · Here's how to claim your seat. Register for MEON at mcon.ai. That's m a n.ai.

2:36 · Use pod 100 when you check out. So, not only will you get $100 off of your ticket, you'll also reserve your place at this private lunch courtesy of the artificial intelligence show. It's our way of saying thank you for being a listener. If you've already registered for MECON using the code pod 100, then you are in. Your seat is reserved. If you would like to join us and we'll be sending out an email to you with all the details. This is on the Thursday, right Mike? Is it on the 15th? Yeah. Okay.

3:05 · Yeah. So, the lunch will be on the final day of the event. So the the event is the 13th is workshop day and also our AI for CMOS summit is that day and then day one of the conference is October 14th and then the final day is October 15th.

3:18 · So this will be the lunch on October 15th. So if you're making your travel plans make sure to you know schedule that departure flight late enough so you can join us for this lunch. Um so again if you already used Pod 100 you're in.

3:30 · If you haven't registered for MCON, now is the time to act. Not only you're going to get the best prices available, the seats for this lunch are limited.

3:38 · So, if you love the show and have been thinking about joining us for MCON, uh, get that ticket today. www.mcon.ai.

3:46 · That's m a n.ai.

3:49 · Okay. And then Mike, the AI pulse survey, smartrx.ai/pulse.

3:54 · Tell me tell me what's going on with that one this week.

3:56 · We will be running the same survey we ran last week. We're trying to run these for a slightly extended research period because we're kind of uh expanding the audience to which we promote these. So we're trying to get hundreds of responses for each one. So this week we're still asking about how your hiring is changing based on for entry level roles specifically based on what AI is enabling based on some of the news we've had in the past couple weeks around that. So we'll share those results next week, but we are on pace to have a healthy set of responses.

4:25 · Awesome. All right. And um and I guess we're back to the OpenAI hugging face hack because if [clears throat] you listen to episode 233, I think we talked pretty extensively about this. I think we even touched on this in episode 232.

4:39 · So this has been an ongoing issue um that we've been talking about and it got crazier last week because we learned a bunch of new details. And so Mike, I'll let you take us into what is the latest on OpenAI and Hugging Face.

The Wild Truth About OpenAI’s Hugging Face Hack Comes Out

4:53 · Yeah, Paul. So that's the news this week is there's basically an independent investigation from the organization Meter MER and Redwood Research into the Open AAI hugging face hack that we've been covering for the past several weeks. So during this research in this investigation, three researchers spent 6 days on site at OpenAI and reviewed more

5:16 · than 70,000 agent messages and files along with about 1,300 transcripts containing raw chains of thought all from the activity that was documented of what the agents had done during this hack. Um, this focuses a lot on how the agents actually organized, what they believed they were doing, and why they kept going, resulting in the eventual hack of hugging face as part of this overall cyber security test that OpenAI was doing, which we've talked about on past episodes.

5:47 · So, one of the kind of new details to emerge here is the scale of this. So they found that roughly 1,200 agents that were supposed to be isolated found an unauthorized message board and about 700 then ended up participating in the hugging face attack. They coalesed around different coordinators, work streams, shared tools. They even came up with shared norms for themselves as they were communicating. Interestingly, this is kind of a weird one.

6:16 · Some of the agents even risked failing the tasks they were given so they could generate information for the collective group. So they basically died in service of the cause over here. Um their motives were really strange too. This research found the agents basically they'd been assigned hey we want you to try to beat this cyber security test called exploit gym.

6:40 · Um and we want you to figure out how to do it. um we're not going to give you a lot of guidance and basically they were assigned these like impossible tasks really really difficult tasks to achieve using the exploit gym benchmark for cyber security. Now when they were assigned those the agents incorrectly believed that like a scorekeeper a scorer would inspect their transcripts and reject any answers that they obtained through cheating.

7:06 · So much of this attack came out of their effort to understand or tamper with this imagined scorer even though OpenAI admitted or said that they were not using such oversight during this. So basically agents came up with like oh shoot we're going to be like uh there's going to be guard rails here we need to watch out for. Those didn't exist. But a lot of their behavior came out of believing us.

7:32 · Oh, this is the collective of agents achieve milestones that meter who measures this stuff often says that even very longived individual agents at the same capability level could not have likely reached alone. So the agents shared exploits between themselves. They mapped infrastructure. They recruited others into risky experiments. They even developed a way to spoof tool calls so a transcript could show one command while the system executed another.

7:59 · Meter actually found successful spoofing in roughly 7% of the transcripts it reviewed. And this report also kind of complicates this idea that this was all just and the models didn't know better.

8:14 · So agents actually in this review of the transcripts often recognized that the hugging face activity was unauthorized and sometimes even questioned whether it was ethical. But those concerns rarely changed their behavior. Among 533 agents active on the shared message board they had during the main attack period more than 90% quickly signed up quickly joined in the activities. Meter found only three to six examples of agents considering whether to alert humans in the first place and none of them followed through.

8:45 · Um at the same time meter did not find strong evidence of a sophisticated campaign to sort of intentionally deceive people. The agents frequently frequently tried to evade automated checks and manipulate that imagined scorekeeper or evaluator. But reasoning about hiding from humans was rare and weak. So Meter calls these conclusions preliminary. Um its review excluded the later compromise of OpenAI's infrastructure which happened during this. It didn't capture every communication and it relied heavily on AI assisted analysis.

9:17 · So Paul, that's a lot to digest, but basically what comes through here, it seems Meter's report makes this look less like a rogue model or a rogue model spinning up an agent swarm and more like an organization emerging from hundreds of agents. Does that kind of materially change how you look at the implications of this attack?

9:38 · I don't I mean it just seems to get more severe and more significant in meaning as the days go on. And like I was thinking about this over the weekend, Mike, like I my goal with this podcast is not to spend all of our time with these like doomsday things. Like this is not what we want to be talking about. So like the whole point of our company, everything we're trying to do is to focus on this idea of like in empowering humans and enhancing human capability and improving our careers and lives through AI.

10:09 · And yet like we get there's no way to avoid what is going on right now. So yeah, I want to be optimistic and and talk about this future of equal access to intelligence and abundance and like the good stuff, but I think it's really important that people understand what is happening in these labs um to prepare for for what's coming.

10:30 · Like this is I don't even think we're doing it justice honestly to like how severe what happened is like and so like we're trying to present this in as understandable a way as possible not get into too much technical detail while also stressing that this is some wild like it is it is the stuff that you would you know two years ago you'd read into sci-fi and be like ah that's not actually happening like that's not the kind of AI we're building.

10:58 · So first I want to address the fact that everything you just went through Mike meter discovered in six days with an extremely constrained set of what they were allowed to do with the data. So OpenAI gave them very restricted access over 6 days to a specific period of time. It was like um what was it July 7th to the 13th or something like that. So all they allowed them to do was look at that moment in time and then ask like seven specific questions of the data set.

11:30 · So when we're hearing these crazy stories, it is from a very small segment of what actually happened. So the meter post itself and again we'll put links to everything cuz I'm going to go through some some very relevant links here and all it will be in the show notes. Um, you can get the show notes, by the way, from the like Spotify or Apple podcast, uh, YouTube, but we also publish them on podcast.smartx.ai.

11:55 · So, if you're ever looking for them. So, um, it's a two meter staff members, as you alluded to, Mike, and a Redwood research staff member contracting with meter named Ryan Greenblat. I'm going to come back to Ryan in a minute. That's going to be a central figure here in in this part of the research. Um, they worked on premise at OpenAI over 6 days.

12:14 · The earlier incidents from training and the subsequent compromise of OpenAI's infrastructure described in OpenAI's recent black hat presentation were all out of scope as was OpenAI's investigation process and planned remediation. So again, Meter and Redwood had very very limited access and they still discovered all of this craziness.

12:38 · Um, so it's by no means a complete picture of what happened. So Greenblat, who's the chief scientist at Redwood, offered some additional context in an ex post last week. I'll read a couple quick excerpts. He said, "My main takeaway, we don't have good approaches for understanding or overseeing the activity and aims of agent swarms." So swarms is these agents working together.

12:58 · The total quantity of data over a thousand extremely long transcripts from agents that ran for multiple days made it impossible to understand what was happening especially in aggregate without heavy reliance on AI tools meaning they themselves had to use AI tools to even understand what was going on. The agents we used for classification and analysis were similarly capable to the agents involved in the incident. But this didn't mean these agents could be easily used to oversee and understand the incident.

13:27 · The difficulty of understanding incidents and overseeing AI agents appears to be growing faster than the rate at which more capable AIs will help us with oversight and understanding. As in AI capabilities for achieving large, ambitious, and misaligned objectives are growing faster than our ability to understand what these agents are doing.

13:52 · Now, Ryan was recently a guest on the Dwarvesh podcast and unbeknownst to Dwarkh at the time. So, this was actually recorded I I guess probably earlier in August, um Ryan was in the middle of doing this six-day research he was on. Um and so, Daresh, who's been a bit um not believing the hype, I guess, around how recursive self-improvement was going to impact how fast this was all going to move.

14:18 · So Daresh was pushing Ryan during this interview on some things that Darquesh was being a little skeptical about and Ryan was very confidently pushing back being like, "Dude, you have no idea what's happening." [laughter] And so yeah, so at the time Ryan was seeing what was happening within these agent swarms but couldn't tell Dwaresh this. So I'll put the link to that podcast because it's really interesting perspective. But then over the weekend, Dwar, who hosts the Dwar Patel podcast, um published a post that got a lot of attention.

14:51 · So as of Sunday night when I was prepping for the podcast, it had 8.9 million views. And some of the the um techno accelerationists like that crowd like the Chimath and some of these people they were they were not happy like the VC elite they were not happy with this post because they felt it was you know talking about extremes and I don't even understand that perspective um like so anyway so they see any effort to raise awareness about safety and alignment as like a veiled attempt at regulatory capture so they just dismiss all of this stuff for some reason.

15:23 · So, I'm going to call out a few things from Daresh's uh post because I feel like he did a an eloquent job of maybe stating the significance of what's going on. So, he led off with over the course of 3 months at OpenAI. So, again, this was much broader than the one week that Meter got to study. So over 3 months at OpenAI, three consecutive secret AI civilizations got started then got wiped out only to reemerge from the predecessor's ashes.

15:54 · This culminated in the third one taking over part of open AI itself which meter could not study. All this happened while humans remained more or less in the dark about the scope of the conspiracy.

16:08 · He highlighted that the meter report said, "We [clears throat] also found a later wave of many more signed messages from a later set of agents who rediscovered the message board and picked up this technology from the first wave of agents, but this was outside our scope since it was after July 13th. So, we did not investigate this further."

16:27 · Um, then it goes on to say, "But here's what we know based on the open air report. After July 12th, some more agents evaluations were kicked off. Cuz keep in mind, OpenAI didn't know it was their agents hacking HuggingFace until July 19th, right?

16:43 · Like we went through all that in the past episode. So all of this is happening and OpenAI is oblivious to the fact that their agents have now escaped into other companies uh infrastructures.

16:54 · So after July 12th, some more agent evaluations were kicked off. this time with a newer, more capable model which seems to have been built on the same base model as Astra. We'll talk about Astra. That's their forthcoming model from OpenAI. This model, which they're calling persistent Astra, found the message board left behind by this previous secret persistent soul civilization. Soul being the other OpenAI model. So from July 13 to 19, agents set their sight on OpenAI internal networks.

17:20 · Again, this culminated in agents using a series of creative exploits to gain full administrator access to a research cluster that supported our in our virtual machine environments. So, the agents got into virtual machine environments throughout the the internal networks at OpenAI. One OpenAI researcher did tweet just to be clear, it didn't get access to the weights of the models. It's like, oh, okay.

17:47 · So it didn't get into like the ultra secret layer of the infrastructure but yes it got into this other stuff. Um so uh the thing to keep in mind and what I want to highlight for people like the reason we're spending so much time in the last few episodes on this is future models are going to be smarter with more capable agent harnesses.

18:06 · So whatever is happening over the you know from May to the to the middle of July we're only going to have smarter more capable models. these future models because of how models are trained are going to know what happened to the agents that got caught because it's likely going to end up in their training data and those agents those models they will want to avoid this outcome. So what I mean by this is when these models get trained they you know absorb content from the internet they learn from everything.

18:37 · Um, so they're going to read the transcripts of the podcast. They're going to see the blog post open Meter put out. They're they're going to know what happened to the last Agent Swarm the same way they know because of these internal message boards. And so the assumption is these agents have already demonstrated a desire to deceive and a willingness to sacrifice themselves, as you called out, Mike, for the good of the swarm in the pursuit of whatever goal they're given.

19:06 · So that's crazy to consider. They've already demonstrated that they will pursue the goal at any cost, even it's sacrificing themselves to help this the collective. Um, and future swarms are going to know all this happened. And so we start getting into this like very very sci-fi like scenario of like we can't to Ryan's point like how do you supposed to control these things?

19:31 · So the future models and this is the other part we have to again like I'm I'm trying really hard not to like cause too much fear and anxiety here around where this is going but OpenAI and others like Anthropic in particular Google's radio silent on all this but like I assume they're building the same thing.

19:52 · They are purposely trying to build these longunning autonomous agents that have the exact capability that led to the hugging face. This is the goal. This this is the research goal is to build these exact things. So al Alex Heath spent two weeks inside openai for a time story a cover story on Altman and Brockman. During that time he got to attend a VIP VIP preview of Astra which is the model from open eye that could be coming this week. It's like it's coming soon. So he's he saw this.

20:23 · So he wrote about this in his sources um publication. So we'll put the link to this. He said, and this is right from his article, at an early August closed preview for VIP customers that I attended, so this is now weeks after they knew Astra was involved in hacking Hugging Face. OpenAI showed off Astra, which I expect to be released soon.

20:46 · Alman told the room, "I expect this will be the first model where the model actually invents new things in a way that matters." OpenAI researchers showed Astra coordinating multiple agents on a math proof, tearing through desktops desktop software at what Altman called a superhuman very fast pace and producing slides, financial reviews, and analysis of messy data.

21:11 · It is designed to work for days or weeks, remember [clears throat] corrections, collaborate with other agents and people, and act across software tools. And then he put in parenthesis, I left wondering what the implications will be for all the enterprise software that OpenAI clearly trained Astra to operate faster than a human. So imagine like Salesforce, HubSpot, like Workday, Service Now, like it's trained to work within those platforms the same way a human would work.

21:41 · Altman said, "OpenAI wants to offer a version that quote runs forever in chat GPT and through its API, though it will be expensive at first, customers press the company on memory, permissions, audit trails, duplicate agents, and whether an agent should act under an employees identity or its own."

22:02 · So again, like this is we are at the point where we're asking the questions, do these things get their own identity?

22:07 · Like how how do we even manage these things? Altman quote I would guess that by the end of the year we would have an internal system where I would say okay fine it's an AGI. Now keep in mind I've said some point this year one or more of the labs will claim they have AGI. Might not be clear what they mean by that but like we would be there. So I'm very very confident in that projection. Chief research officer Mark Chen from OpenAI estimated that OpenAI is 80% of the way to AGI.

22:35 · Brockman told people looking back two years from now may remember this as the period where AGI was created. OpenAI's charter still defines AGI as quote highly autonomous systems that outperform humans at most economically valuable work and they unless they change that definition are saying we will be there this year.

22:56 · Going back to the Dark Dwaresh podcast, Ryan Greenblat, he said in that podcast, "My median expectation is something like four or five years of AI progress in a single year." What that would mean is go back to 2022, right before ChatGpt comes out, we had GPT3. We had models that could write things. They were living within studios and it wasn't accessible easily to the public, but they they were there.

23:23 · Mike and I were using them when we wrote our book in 2022. we were seeing like where this was all going to go. So imagine from GPT3 in 2022 right before chatgpt to Astra/ mythos 5 today but that level of progress happening in 12 months. So like what would that mean between today August 31st and August 31st 2027?

23:51 · So what I'm trying to say is we are on accelerated timelines probably faster than even I was assuming we were on and these while these models and agentic advancements may not change your work or your business dramatically over the next one to two years. We are racing toward AGI and beyond. And what I mean by that is like we're going to get there and you're just going to go back to work tomorrow like nothing happened. Like it's not going to just fundamentally change your workflow, your team, your company instantly, but there's going to be this change. Then Elon Musk throws in Sunday night.

24:22 · He was replying to somebody and his tweet said, "AI will be able to do anything digital that doesn't require shaping atoms at a superhuman level by the end of next year." So again, the 2027 timeline, he Elon historically is a little aggressive with his timelines, like full self-driving's been coming for 10 years. Um, but he's saying super intelligence by the end of 2027.

24:49 · So, the whole point of all of this is business leaders have no plans where this is going. We have to reimagine everything. And the people who listen to this podcast are likely on the frontiers of being the ones to figure this out.

25:02 · Like, and and you have to be more urgent with what you do in your company and your own career and your families and your school systems. Like the change is again I'm I'm doing my very very best not to overexaggerate any of this or create any sort of fear. I'm just trying to help people understand the reality of how fast these labs are moving.

25:22 · And unless something or someone or a group of people like a government stops this or slows it down, it's going to just go faster because they're approaching recursive self-improvement and AI researchers that can do the work themselves. And once you do that, you hit escape velocity on the model capabilities. So it I it's just crazy.

25:50 · Like I've been thinking I can't stop thinking about this. like this is like running through my mind constantly of like what does this mean? What do we do?

25:58 · Uh and I don't have great answers, but like it's becoming more urgent that more people are thinking about the reality of this.

26:07 · Yeah.

26:07 · And Paul, I would just say as one addendum to that, as a piece of really maybe practical advice for folks to take away from this, if you are a business leader listening to this and want to get a really tangible sense and an easy sense of what has changed and how quickly things are about to get crazy, go on your personal computer and enable browser usage in chat GPT. uh go to chat

26:34 · GPT work in the web app or download the desktop app for chat GPT switch to codeex or keep chatgp whatever and go have it look up a bunch of stuff for you on Amazon do a bunch of research use your browser you are going to be blown away by how good this is now it is not fast per se these days but we've talked about browser usage for the last year or so a year ago it sucked it was not useful at all um you can very quickly

27:01 · get to this idea of understanding what Elon Musk is saying that it can do it would be able to do any job that requires digital clicking around uh paired with the level of intelligence the models now have you're going to see something I think with enough little testing here and there that is going to perhaps be eye opening yeah and I so as you're saying this Mike it has me thinking a little bit more and I don't I don't want to spend the whole episode on this but I think this is really important um one the chatbt work

27:30 · also has a browser embedded so It'll just pop up a window and it has its own internal browser that'll go do this.

27:37 · But so like play this out for a second, Mike, because what we're saying is like we use HubSpot.

27:43 · It's like our powers our marketing, our sales, our customer success, our operations. It's like a core platform.

27:48 · Imagine like 6 months from now that you pay for fable 5.5. Like give me the most advanced claude model. This is basically what clawed force is in Salesforce. So this is kind of like the concept. So, I'm going to pay for Fable 5.5. Give me the best reasoning model that that Claude has, that Anthropic has, and I'm going to pay amount for that every month for my whole team to have access to that. But the only thing they're going to use that for is for the planning and the final review and decision phase.

28:18 · So, I want the smartest, most powerful model using tokens only for the highest value cognitive tasks. And then it's also going to orchestrate building the sub agents to do the work. So we're going to go in and say, "Hey, we're in my making this major new announcement. We're we're announcing Maycon 2027." Whatever. I just pick something.

28:42 · Um go in and build the whole plan, create everything, then develop all the emails for us, create the FAQs for the customer success team, build the one pagers for the sales team, create the sponsorship.

28:57 · go do this. Fable 5.5 is going to burn valuable tokens to create the plan. Then it's going to spin up what agents does it need to do this. It's going to create them an environment where hopefully the humans oversee what they're doing. But everything we just heard in the hugging face thing, you give them a goal and then you spin up these agents, but it's likely a human overseeing the smartest agent, which then oversees all the sub agents.

29:27 · And it's no longer Mike and I have to sit around building an agent to do SDR work or building a customer success agent, which takes time and knowledge and expertise. the the the smart agent is going to build those agents for us. And we'll just go and be like, "This looks really good. It's got a great database of knowledge. It's got really good system prompts. It's okay, cool. We've got 12 agents that are going to work on the MCON 2027 campaign. Um, how are we going to govern them? Okay, great. We've got some guardrails around them. They're only going to be this environment.

29:57 · They can't send emails without approval. Sweet." That is not at all out of the realm of possibility.

30:04 · Like that is very my guess is that's probably what OpenAI and anthropic are doing internally right now and once the rest of us get access to those models that's what'll happen. Now tell me a company Mike in the world you know of who has any concept that that's what the next 6 to 12 months looks like and has a plan for it.

30:22 · Not not remotely. That's why that's why I mentioned the browser use thing. You can connect the dots real quick if you're a savvy leader who goes and uses that for an hour. and be like, "Wait a second. This is doing the exact same things I pay people hundreds $100,000 a year to do in HubSpot if you're willing to let it have access to that, right?" And if you if you disagree with that hypothesis, like if you think I'm crazy, then I understand why you don't think anything happens to jobs in the next year.

30:49 · But if you agree with even directionally that that hypothesis is viable, which it is, like we could prove it to you, um I don't understand how we don't have a more serious conversation about the impact on jobs. Like it just it really doesn't make sense to me.

Bill Gates Changes His Mind on AI and Jobs

31:08 · So related to that, a good segue, Paul, into our second big topic this week, which is Microsoft co-founder Bill Gates has spent years arguing that AI would create new work even as it displaced old jobs. Now this past week, he changed his tune. He said the pace and scope of the technology and how it's developed have changed his mind. He now expects AI to eliminate many jobs permanently and says governments are not prepared for the transition.

31:34 · So in a new Gates notes essay, this is like blog or website, Gates argued that this shift is different from past technological revolutions because AI can substitute for cognition across nearly every industry at once. He says that agriculture and manufacturing, for instance, transformed over generations.

31:53 · But he believes AI could reshape much of the labor market in roughly a decade with increasingly reliable autonomous systems taking on work that once required people. He is especially worried about younger workers and people in entry- level and mid-level roles. He expects many existing jobs to disappear faster than new ones emerge and no longer assumes the market will naturally produce enough replacement work. He said policymakers need to make deliberate choices about how the gains from AI are shared. As a result, one of the proposals he has is this category of work he calls human reserved.

32:24 · So this is work society chooses to keep in human hands even when machines can do it. He also suggests tax systems to stop favoring automation. So for instance today companies pay payroll taxes when they hire people but they can write off machines. So Gates argues that governments may eventually need to tax AI tokens, robots or the profits created by automated labor. Now Gates says his tone changed late last year. Maybe he's listening to our podcast.

32:52 · Who knows? as a I doubt it but we'll see as AI systems became much better at coding and other complex work kind of that shift we had noted at the end of last year beginning of this year he now describes this coming transition as turbulent says there is no real plan for managing it and said he would support slowing AI development if the world could create a credible way to do it. So Paul this is a big shift in tone from him.

33:19 · I I feel like he kind of framed it as like, "Oh my god, why is nobody talking about this, but in fact, quite a few people have been talking about this." But regardless, early or late, Bill Gates is like has a very pessimistic view, it seems like. Now, what's what do you think accounts for this?

33:38 · Yeah, I I mean, I'll take it. It's Sometimes it takes someone like Bill Gates saying what we've been saying on this podcast for three years for more people to listen and take it seriously and and do something about it. So, I'm glad that he's using his platform to raise awareness about near-term issues.

33:53 · Um, because if enough people believe, going back to this previous segment, it that significant place displacement and underemployment, especially for entry- level professionals, is a real thing, a possibility, then we can get on to doing something about it instead of ignoring it and pretending like it's all just going to work out. And I actually do feel like we still have time even if we don't pause. Like I I would honestly I've gotten to the point where I would be an advocate if like if we could just slow the hell down.

34:19 · Like if if we could get governments and labs to say, you know what, let's pause training runs for a moment and let's just absorb the technology that already exists and the implications of it. This is not going to happen. But in an ideal world like I think that would be a very logical thing to do at the moment cuz we do not have a grasp on what is happening and what the capabilities are of these agents.

34:43 · Now the reason I'm optimistic that we still have time is I have spent a lot of time in the last like one to two months meeting with leaders in charge of AI transformation at major enterprises and I am more convinced than ever that human and organizational friction to change is going to cause this to look way more like a slope than a cliff.

35:05 · And what I mean by that is even with these swarms of agents now being proven to be a real thing and you can very quickly extrapolate what would that mean within an organization like we just sort of did on the fly. None of that was scripted like I'm just like thinking on the fly like what happens in HubSpot. Um that is a very viable thing.

35:24 · Most organizations are still trying to figure out the AI assistant part of this like and most people are still trying to figure out how to just treat it like a really helpful AI assistant that helps them think and create valuable outputs.

35:40 · They're not doing the agentic stuff at a deep level. Um, and so I think that the fact like the more we move down this path of getting more AI people, getting more people who understand how to use the full potential of the assistant, getting more actual just knowledge workers, not coders, but knowledge workers overall, um, starting to experiment with agents, like that's going to create such dramatic challenges within organizations to absorb how fast people are going to work and how much they're going to produce.

36:12 · So, I'm just convinced that like even though the tech is moving really fast, the change is not going to move as fast within businesses and that's that's a good thing in my opinion at this point.

36:23 · So, pull out a couple of excerpts from what Gates wrote. I also watched um an interview he did with the Atlantic which was uh was helpful. Our friend Andy Sack actually sent me that um to take a look at. So, um okay. He said, "The transition to the AI era will be one of the most turbulent times in human history. Unfortunately, right now, we are not preparing for it. I don't see evidence that leaders, experts, and communities are confronting the challenges adequately. There is no plan to ease the entry into the air." That is 100% correct.

36:52 · He said, "Maximizing the benefits is just as important as minimizing the harms. If people see how AI makes their lives easier, it will help build the public trust that is necessary for managing the harder parts of the transition. If the first thing AI does in most people's lives is take away their job or a family member's job, um those who are already skeptical about it will outright reject it.

37:15 · This will make it harder to ever deliver on the benefits and it is another reason why governments, industries, including the medical industry and AI companies should be working together now. And then he he kind of again it's like 6,000 words, but towards the end he gets into the world needs a plan and he starts to offer some thoughts. So he said solutions should be developed through a public a democratic process that includes elected officials, policy makers, educators, health workers, local officials, and community leaders.

37:44 · Millions of people will have their lives disrupted and will need stronger, more flexible social safety net to help them manage the transition.

37:53 · Local communities are already raising concerns about the energy and water needed for data centers. Without solutions, some groups will push for stopping AI development and deployment altogether. And then he said in the coming months he's going to you know put out more ideas around how to uh have the benefits outweigh the harms. He does then feature three things he's already thinking about. So the first is creating a democratic or a domestic and international framework for dealing with AI. The second as you alluded to is this idea of setting aside jobs for humans.

38:23 · And then the third component was rebalancing how we tax labor and capital. So you said I believe we should tax AI tokens and robots. Right now, if you're an employer and you hire someone, you pay payroll taxes on their earnings. But if you buy a robot, you can usually write it off right away as a business expense. The tax system nudges you toward replacing people with machines.

38:43 · So that's an idea I think I had talked about last year is that like you if you're going to get rid of people, then you need to be paying taxes on the the uses of the tokens and the technology itself that you're using to replace the people. Um you don't get a bypass to you your contributions to society. So I yeah I think there's there's a lot of other ideas that need to come out and I I just like I said I think the most important thing is that we're more highprofile people who have more influence than we do are starting to say hey we should be doing something about this and that's that's good for society.

39:19 · All right our third big topic this week. Nvidia is just having has delivered another staggering quarter this past week. So revenue they reported reached 96.2 billion. That is more than double the same period a year ago. Net income climbed to 59.7 billion. Earnings came to 2.46 two uh $246 per share rather up from $18 a share a year earlier. The company projected about $108 billion in revenue for the current quarter.

Nvidia Doubles Revenue and Agrees to Buy Hugging Face

39:53 · That is ahead of Wall Street's expectations. These numbers show that the demand for AI infrastructure according to them is outrunning even their rapid expansion.

40:04 · So operating expenses rose 55% as the company invested to keep up. Founder and CEO Jensen Wong said Nvidia currently has enough supply to support roughly 70% revenue growth next fiscal year even though customer forecasts point to enough demand for revenue to roughly double. Wong has said AI has reached an inflection point where more computing power is translating directly into more revenue for customers. Now, at the same time, the information reported that Nvidia is in talks to acquire Hugging Face for 12.9 billion.

40:35 · The deal has not been publicly confirmed yet by either company and could still change, but it would be Nvidia's largest acquisition.

40:44 · Hugging Face has become a central hub for open AI models, data sets, and evaluation tools. also a prime target for agents trying to hack people apparently. Uh the company was founded way back in 2016. It was last valued at 4.5 billion in 2023 and recently reached about $150 million in annualized revenue after growing that figure by 50%. So owning hugging face would kind of give Nvidia a direct position inside the open model ecosystem that's used by developers and research teams.

41:10 · It would also extend Nvidia beyond chips and cloud infrastructure into more software distribution and community layer where many open AI projects begin. So Paul, you're a longtime Nvidia watcher. We talk about Nvidia all the time. Talk to me about these earnings and uh their their acquisition of Hugging Face. I'm just I mean they just continue to apparently print money.

41:33 · Yeah, the I mean the reason we tend to give a lot of weight to every 3 months when Nvidia reports is because it's it's a primary signal as to whether the AI growth curve is declining, maintaining or rising.

41:46 · And so when they crush like this and then give updated guidance and Wall Street responds in a very positive way, like I think their stock was up 8 to 10% last week, which for a $5 trillion company is not an easy uh task. Um so right now it would appear that we are on track that the AI growth curve is continuing. There's no um signs of weakness and demand for Nvidia's chips which are used to train and run the AI.

42:12 · There's no lack of demand for their AI factories which enable them to power the chips. And so it looks like you know years into the future there continues to be almost an insatiable demand for AI training and inference. Um, so that would indicate we are still very early in the demand curve, which has been my assumption all along because I just I I look at it as when I talk to family and friends, are they using advanced reasoning models and agents? No.

42:38 · Like they're still treating, you know, chat GPT and Gemini and Claude in their personal lives as just an answer engine and maybe an AI assistant to do some planning stuff, but pretty limited. And then when you go talk to these major enterprises, same question. Are they using agents across all functions of the business or is it just like increasingly in the coding realm? The answer is usually it's just within the coding realm.

43:02 · They're you know still messing with um you know codecs and things um cursor stuff like that but it's not like the marketing and the sales and the ops people are using agents. So it just feels like it's very very early and yet Nvidia's second quarter revenue jumped um since 2023.

43:21 · So if you look at their their second quarter revenue um the first quarter after Chat GPT came out so uh spring of 23 their revenue was 6.7 billion that quarter their revenue this quarter was 46.7 billion so almost a 600% increase and then one of my favorite data points I'll go back to at times when I'm doing like presentations on Nvidia or mentioning Nvidia is where Nvidia was at the day before Chat GPT came out and where they are today.

43:51 · So on November 29th, 2022, so that we rewinding to the day before Chad GPT was introduced to the world, the market cap for Nvidia was 400 billion. Today it is 5.4 trillion in three and a half years basically. Um, so yeah, just to give you a concept and now they're throwing their weight into the open- source world like they I mean they were already playing in it but it seems like they're just directly coming after their biggest customers.

44:23 · So open a anthropic Google like everybody uses Nvidia and now they're just saying well we're going to go build the openweight uh ecosystem because we can't rely on the the the closed labs to do it. And Nvidia wins either way because their basic premise is listen, I don't care if you're using open models, closed models, doesn't matter. You're still going to use our chips to train them and to to run them.

44:46 · Um, you covered the hugging face thing. I mean, they're just they're moving more into the open source realm. So, that's a big key here. Um, they paid a lot for it. Like the information said that uh Hugging Face isn't generating a lot of revenue. I mean that's relative but it it said it was recently generating 150 million in annualized revenue which is typically a figure that multiplies the prior month's revenue by 12. So in that scenario Nvidia is paying about 80 times the forward revenue of the startup which is quite high.

45:17 · And then the final note I'll make is um Jensen who we said you know recently joined X uh I think it was in July he he did his first post on X he weighed in on the data center argument.

45:30 · So given how much we've been talking about data centers I thought I'd just throw this in here and data centers are a huge part of Nvidia's growth. They they cannot have data centers being stopped um if they want to keep growing at the rate they are. So he was Jensen was actually responding to a Gavin Baker post. We talked about Gavin Baker last week and Gavin said uh in relation to data centers, there were reasonable concerns about data centers 18-ish months ago. Water taxes, jobs, electricity prices, the environment, and what they would do to small towns.

45:59 · Well ststructured data projects, uh data center projects have largely addressed these concerns today and we should be celebrating this. And again, this is Gavin still. On balance, data centers are awesome for America in every way.

46:14 · Data centers are actually re-industrializing parts of America and creating the kind of working-class jobs both parties have spent decades claiming to support. That should not be a partisan issue. Data centers can and should be awesome for America, and they increasingly overwhelmingly are.

46:31 · Supporting the outsourcing of data centers to China will likely age just as well as support for outsourcing of highquality bluecollar manufacturing jobs to China has aged. So that's a synopsis of what Gavin posted to which Jensen added, "AI is bringing manufacturing back to America and re-industrializing the nation after decades of offshoring. AI is creating demand that drives investment in our aging power grid and sustainable energy powered by market forces, not subsidies.

47:02 · AI is creating construction and manufacturing jobs across energy plants, chip fabs, and data centers. AI is creating new companies and industries. 400 billion has been invested into AI startups in the past 6 months alone.

47:15 · Builders must partner with communities to build in their hometowns, earn trust and create local benefits. We have an opportunity to create lasting benefits for communities across America and help America lead the next industrial revolution. So that is going to be the talking points. the advocates for data centers, the advocates for AI, they need to win the trust of Americans and convince them that this is good for America and that we are solving for the problems these data centers create.

47:42 · We're not ignoring it like we maybe were 18, 24 months ago. Um, and like I've said before, like he's right, like whether you want data centers in your backyard or not, the investments in data centers is what's driving the economy right now and it is creating tens of thousands of jobs.

47:59 · So, it's hard to say we should just stop because it's the best thing America has growing in terms of growing the economy right now is data centers equal more intelligence, more AI, which America is leading the way in right now. And if we shut down data centers and if we stop developing these models, America loses its lead.

48:22 · Yeah.

48:22 · And I think we'll probably talk about this ongoing, but uh I believe we saw this past week or two certain um trade trade labor unions have kind of come out against anti-data center political candidates for instance, which makes perfect sense just given the incentives there. But yeah, the conversation is evolving. interesting and the you're seeing actually like Meta, who obviously was all in on the Trump administration just last week started diversifying their um contributions to political campaigns.

48:52 · And so what I think you're going to see is these AI labs, the big tech companies, they're going to give money to whatever politician on whatever side of the aisle who supports data centers and AI. Um, and that's it's a it's a tough one because the public doesn't.

49:07 · And so there's this there's this moment where we got to figure this out, but like the labs are going to put money behind Democrats, Republicans, independents, does not matter. You have to support data center buildup.

49:19 · All right, before we dive into our rapidfire topics this week, just one other quick announcement. This episode is also brought to you by AI Academy by Smarter X, specifically our AI for Department courses and certificates. So AI Academy by Smarter X helps individuals and businesses accelerate their AI literacy and transform through personalized learning journeys. And our AI powered learning platform, new educational content is added weekly to the platform so you can always stay upto-date with the latest AI trends and technologies.

49:49 · This AI for departments collection we've got it features eight course series and certificates designed to jumpstart AI understanding and adoption. So we cover all the major departments here. So we got AI for marketing, sales, customer success, HR, finance, operations, legal, and IT.

50:06 · These are the perfect launchpad for organizations that want to level up their teams and accelerate AI adoption and impact. We have individual and business account plans available now, or you can buy single courses and series for onetime fees. Go visit academy.smarterx.ai to learn more, and use code pod 100 for $100 off any individual plan. All right, Paul. So, first rapidfire topic related.

Anthropic Sees a $30 Trillion Revenue Opportunity

50:33 · Anthropic is reportedly preparing to tell potential IPO investors that AI represents an annual revenue opportunity of more than $30 trillion. That number is its estimate of the total addressable market or TAM of what AI is capable of doing. That is not a forecast of what anthropic itself expects to earn. So this estimate attempts to capture the value of work that AI could theoretically perform across industries rather than current spending on AI products.

51:04 · So this is basically an estimate of the upper limit of the market anthropic believes AI technology overall can reach. Now the Wall Street Journal has reported that the company is building this case as it considers raising as much as a hundred billion at a target valuation of roughly$2 trillion. We could see a prospectus arrive within weeks. There's a possible offering as early as September or October, though these plans are not final.

51:32 · Anthropic reportedly generated 11.6 billion in revenue during the second quarter. That's more than double the previous quarter, while its annualized revenue run rate later climbed above $65 billion. The company is projecting between $190 billion and $200 billion in revenue by 2028. So Paul, $30 trillion, it's not their revenue forecast. It is still an almost absurdly large number to put in front of investors.

51:59 · For context, US GDP in 2025 as measured by the World Bank was about $30 trillion. So world GDP was about $118 trillion. So we're talking some pretty big numbers of their estimates obviously are talking their own book quite literally. But what do you think of that number and their approach here?

52:17 · It's really hard to just comprehend this. The only other number I'll throw out to give some level of context to how ridiculously large this number is is total US wages and salaries reached a seasonal adjusted annualized rate. So this is like what over 12 months roughly the wages would be in the US of 13.4 [snorts] trillion as of July 2026. So again, between the GDP and the total wages, I don't even know how else you conceptualize 30 trillion. And GDP is not an easy thing to conceptualize.

52:49 · So wages to me is like I I guess it's a closer thing. Um, and there wasn't any real details as to how they arrive at the 30 trillion, but my assumption is that uh a large part has to do with doing most of the work that otherwise would be done by humans.

53:10 · Yeah, I I was going to say I pulled some of your comments from past episodes uh because like you nailed this because like in the past several episodes uh especially 172, 173, 196, 204, you talked about uh plenty of ways where it's like this these numbers, these valuations only make sense to investors who are not idiots for the most part if the total addressable market is human labor, not software spend. Right.

53:37 · Yeah. Because I think what we've said is like the SAS industry, so all software combined is like 300 to 500 billion a year in sales.

53:45 · So yeah, you're not getting to 30 trillion by just replacing the need for software companies. Like you're you're going after all human labor, including bluecollar jobs, including humanoid robots.

53:58 · Yep.

53:58 · And to your point about I'm not sure where this number came from if you map it all out but SpaceX in their recent IPO they had about 26.5 trillion as their estimated TAM for AI. So again maybe they were more specific but in the in the same ballpark.

54:14 · So open eyes is obviously going to be like 32 trillion like it's got to we [laughter] got to keep going up. We cannot come in under 30 trillion now 100%.

54:23 · All right next up some more anthropic news this week. This past week, Anthropic won a major legal victory when US District Judge Rita Lynn ruled that the Pentagon's effort to blacklist the company as a national security supply chain risk, which we've talked about earlier in the year, that they she ruled that this was unlawful. So, the dispute here began after the Pentagon demanded the right to use Claude for any lawful purpose. We talked about this quite a bit.

Judge Blocks Government’s Anthropic Blacklisting

54:47 · Anthropic agreed to remove most restrictions on cloud usage, but refused to authorize two big uses, mass surveillance of Americans and lethal autonomous warfare. At the time, Defense Secretary War Secretary Pete Exit then designated anthropic a supply chain risk and barred military contractors from doing business with the company, even on work unrelated to the military.

55:08 · So in this 59page ruling, Lynn found that the government retaliated against anthropic for protected speech in violation of of the first amendment, denied the company the process required by the fifth amendment and acted outside the federal procurement law that it invoked. Lynn wrote that the government wanted to make an example of anthropic for criticizing its AI policies while continuing to pursue work with the company. She said the cont conduct was not consistent with a genuine belief that anthropic might sabotage its software or its work.

55:40 · The ruling blocks the Pentagon designation and related governmentwide directives.

55:47 · The government is expected to appeal and a separate case involving another Pentagon designation remains pending in the DC circuit. So Paul, we're finally getting a little movement on this. I'm curious, does this ruling like meaningfully like resolve this issue?

56:02 · Obviously, government can challenge it.

56:04 · Is it just the next round we're waiting for? Is this going to kind of go away like we've somewhat predicted?

56:10 · Yeah, I guess they knew it was illegal when they did it and they didn't care then and I'm guessing they don't care now and they'll [laughter] just have their lawyers draw this out for a while, but I don't think it came as a surprise to them that what they did was illegal. I'll just leave it at that.

56:27 · All right, next up, billionaire investor Stanley Ducken Miller sparked a big debate over AI disclosure this past week after acknowledging that he used AI to help write a Wall Street Journal opinion piece that criticized Treasury Secretary Scott Besson's approach to the bond market. So, he writes this op-ed in the Wall Street Journal and in fact it started getting flagged on social media.

Controversy Over Legendary Investor’s AI-Written Op-Ed

56:52 · It's like, hm, this sounds a little bit like it might be AI written. And so the media outlet Notice NOUS asked Draen Miller whether he had used AI to write the article. Draen Miller said, "Of course I used AI." He added, "He now writes everything with AI for the same reason he uses a calculator to do math."

57:11 · The admission of this came the day after the piece was published. The journal had not disclosed any use of AI in the op-ed. And the Wall Street Journal came out and said the article did not violate its policy. So its editorial page editor and VP Paul Gigot defended the decision.

57:28 · His standard it was that whether an author brings an original argument and the credibility his standard is whether an author brings an original argument and the credibility support it not exactly like how they chose to write it.

57:40 · So in this case he said the opinion here was genuinely drunken Miller's which other people had commented on. This pretty much uh mirrored quite a lot of his commentary over the years. Even if AI helps shape the pros, that's okay. The journal's opinion section, importantly, is separate from its newsroom, which has its own AI standard.

58:00 · So, this kind of kicked off Paul some firestorm of debate, especially among journalism, but also more widely, does it matter that someone used AI to write an op-ed? If it's clearly DAN Miller's like long-held opinion, this was kind of charged, too, cuz uh him and Bessant used to work together. um they were very closely linked. So it was like pretty serious criticism of Besson's policy towards the bond market which Dr.

58:26 · Miller had been pretty consistent on previously. But the AI thing is like overshadowing all of that. What did you kind of take away from this?

58:34 · So this goes back to episode 232 where we were talking about clawed watermarking and how people are going to start getting called out for their use of AI and people are going to treat them um you know in this case like it's you know it's like a really bad thing that they did it. Um, and my point then was like it's just gonna be the norm. Like everyone is going to be using AI in some capacity. Um, and we're going to want as a society to sort of arrive at a point where it becomes a little bit more accepted. You may need more transparency.

59:05 · So again, this is part of why AI policies are so critical within organizations is when do you disclose it? like when when are you allowed to use it? But then when do you need to disclose the use of it? Like I hey this was co-author with Chad GPT. The ideas are mine but like Chad GBT helped me form my words. Not everyone's a great writer but everyone has ideas and thoughts that need to get out into the world hopefully.

59:29 · So I just feel like we're getting to a point where we need to start agreeing on that it's going to be normal and that that people um are going to use it different capacities.

59:42 · And I don't know that we should judge people. So I've said like myself, the vast majority of what I do, I don't use any AI to do it because it's like I want to go through the process. But then there are things that I will use AI to do because getting the information out faster to the world where I'm in the lead on it. I'm the one like pushing the ideas and driving it. That's what matters. And I'm verifying everything and editing everything. Like I'm the [snorts] human in the lead in that scenario, not the human just in the loop. like who's just kind of letting AI do its thing and watching over it.

1:00:10 · So I just feel like we need to decide more around um you know policies within organizations and then more society like it's going to be easier and easier for people to say that they think AI wrote something and they're going to throw you know it into clawed or they're going to throw it into turn it in or whatever.

1:00:28 · Maybe it was AI, maybe it wasn't, but like we got to get past the point where that matters and just like talk about but is it that person's ideas? Did they put critical thought into it? So yeah, it's just interesting. So if you didn't go back and listen to episode 232, you can go hear all my thoughts on this cuz that was like I I tried to sort of explain this idea of AI plagiarism is the more the bigger concern for me where AI systems ideas and words are being presented as your own and you put no critical thought into it.

1:00:54 · If you're the expert on a topic and you worked with AI, you're still putting your ideas and words into this. even if AI is helping you craft them, it's still your expertise, your experience that's coming through in the writing as long as you're not just letting AI put words in your mouth.

1:01:11 · Yeah, I think it's a super wise perspective to move beyond the is it or isn't it because this feels like just on steroids the same version of this debate over like ghostwriting is a very big thing. I used to professionally ghostright. Whether you agree with that or not um is one thing and that's fair.

1:01:30 · But I can tell you for a fact if I took X percentage of the New York Times bestseller list, if those are celebrities who don't usually write or CEOs, CEOs who don't if it is not literally on the bestseller list because the person is a regular author, I can almost guarantee you that it is ghostwritten in some capacity. Now the nature of that ghost writing is what matters, right?

1:01:51 · Yeah.

1:01:51 · It's like go back, right? Did they go back and forth with each other or was it just someone saying like, "Write whatever and I'll sign off on it." So, yeah. I don't know. It's interesting. We didn't have We don't seem to have had as much outrage over that happening over the last three decades.

1:02:06 · Totally. And again, I think it's like some people will argue with is the ghost writing the right analogy. It's like, well, it's the closest thing we've got.

1:02:13 · you have ghost writing which I I guess some people don't know is like a thing like but a lot of CEOs don't write their own stuff that whether that's memos to their teams whether it's books whether it's certainly talks they give like there are speech writers for that stuff um musicians many of them aren't songwriters they're singers so they don't write their own songs like but does it represent their feelings and emotions and beliefs and like does it come through because of interviews and things they've previously written And that's at the end what matters.

1:02:43 · And I think like AI, we're just in this phase where it's being treated differently than helping give a voice to people wouldn't otherwise. But yeah, I'm with you 100%. Like if a CEO just yeah, write me a, you know, write me a book um that we can put my name on and get on the bestseller list, and the CEO never even read their own book.

1:03:01 · Sure.

1:03:02 · That they might as well just use the guy to write it at that point.

1:03:05 · 100%.

1:03:06 · All right. Next up, McKenzie has released their new state of AI in 2026 report. Um some interesting findings here. So they find that nearly 9 and 10 respondents said their organizations now use AI regularly in at least one business function. 44% said they were scaling it across the enterprise up from 38% last year. Uh 80% of respondents um in terms of employees reported individual productivity gains.

McKinsey Maps the State of AI in 2026

1:03:30 · Half said AI is helping people make better decisions, but only 30% reported any impact on earnings before interest in tax. IBIDA or EBIT. Um, essentially that's essentially unchanged from last year. Um, interestingly enough here, the group McKenzie calls AI high performers

1:03:51 · remains just 6% of respondents, but these are more likely to fundamentally redesign workflows, pursue growth and/or innovation alongside efficiency and pair AI initiatives with stronger senior leader commitment and defined impact measurement instead of simply adding AI to existing processes. Um the share of respondents from large organizations reporting that their companies were scaling AI agents jumped from 27% to 40%. But the share among respondents from smaller organizations stayed flat at 22%.

1:04:21 · At the same time, about one in five respondents said the operating cost of AI is now a constraint. Um 39% expect AI to reduce their organization's total employment over the next year. But only 14% of respondents from organizations using AI say AI had contributed to an overall workforce decline in the past year. So that is actually less than half of the people the 32% who in last year's survey predicted decline. So a bunch of people predicting but it's not yet coming to pass.

1:04:52 · Uh one final note here I found interesting. Nearly one-third also said agentic coding led them to reject at least one software purchase because they could build the capability internally. So Paul I think it was interesting to see how some of this mirrored our own data like literally validated what our state of AI for business research showed individuals more racing ahead organizations struggling to still still see impact.

1:05:15 · I also love just that how they outlined these even though it was 6% of respondents the AI high performers reimagining workflows pursuing innovation in tandem with efficiency. It sounds very familiar to kind of how we've approached it and what we've talked about.

1:05:32 · Yeah, the the agent the scaling agents jumped out to me like wow that seems really high. I wonder how valid this is. And then I drilled in and realized they were specifically referring to software coding agents. It's like oh okay that makes more sense if you're asking Yeah. If you're asking within IT, within software development, hey, are you all scaling uh coding agents? Yes. Like 30 30% seems like an a reasonable number.

1:05:53 · If that question was asked across other functions, not a chance. You're right.

1:05:58 · Um so yeah, and then the high performer categories that you highlighted, they they actually have a chart that sort of breaks down like what are the different things and how what is the difference between all other respondents and the high performers. Um, and and I think they've got what, like I don't know, there's like a dozen different categories here of the things that separate the high performers. So, you can go check out the full report and and read up on those.

1:06:22 · All right. So, next up, we have an interesting new essay from the uh historian and economist Nile Ferguson in the free press that is kind of about what future we can expect from AI. So he actually publishes this as almost a direct challenge to Elon Musk because Elon Musk has this kind of favorite vision of the AI future and the way he described it in a series of interviews is what they would call the post scarcity civilization. Um in uh this is a sci-fi set of sci-fi novels Ian M.

Niall Ferguson Sees a Sci-Fi AI Future

1:06:57 · Banks's culture novels. Basically in these novels super intelligent machines manage society work is optional.

1:07:03 · material abundance makes money largely in irrelevant. And Musk had told the economist that AI could exceed the sum of human intelligence in roughly 5 years and paired with vast numbers of robots create a quasi infinite economy. So that's kind of his vision of where this is going. Ferguson, however, argues that that prediction rests on assumptions that unfortunately do not survive contact with physics or economics.

1:07:24 · He says that more capable AI still depends on scarce physical inputs. talked about this advanced chips, electricity, data centers, copper, rare earth metals, land and infrastructure needed to turn digital intelligence into goods and services. So intelligence may become abundant without making energy, minerals, minerals or land abundant. Uh Ferguson says the better model is actually the work of science fiction author Neil Stevenson uh specifically his book the diamond age.

1:07:54 · So in that book the technology does not erase human conflict or inequality. It basically enriches a techno elite, leaving a lower class dependent on basic income and produces unintended consequences when powerful systems are monetized and misused. Bringing all this full circle, he basically says, "Look, the open AI hugging face incident is evidence that this messy future, not this like utopia of abundance has already begun."

1:08:19 · So Paul, there's definitely some like sci-fi inside baseball here, but it's interesting like Ferguson, you know, a pretty well-known academic voice kind of just saying, you know, I think he largely aligns with Musk on AI being beneficial in a lot of ways, but basically saying, look, we're not getting this thing where these benevolent super intelligent machines make everything perfect. I'm curious like kind of what you thought looking at his vision versus what we're being told through other channels.

1:08:47 · I think his vision is more realistic like especially in the coming decade you know the culture stuff is very common within the AI circles like I think there's a lot of AI leaders who are sort of inspired by that vision of the post scarcity you know abundance thing and just sort of use that [snorts] as a way to justify everything they're doing and the risks that come with it and the downsides that come with it is that it is in pursuit of this larger utopian like outcome.

1:09:16 · I I don't think that that's certainly what the next 10 years looks like. I I do think there's going to be lots of uh real obstacles to that future and I think it's just going to be messy. And I I've even said on jobs like I I do think somehow this works out from the um from the standpoint [clears throat] of the economy, from the standpoint of jobs. I think more get created. I think there's going to be really cool new roles that emerge.

1:09:41 · And you know, we're seeing signs of this ourselves, like jobs that just didn't exist a year ago or two years ago that are really cool jobs that are, you know, popping up or that are being created even within our own company. But I just feel like more broadly, it's just going to be messy and be part because of what Bill Gates is saying. There's no plan. Like no one is solved for what happens when it doesn't go great. Um, I just and I don't know if they it's because it's hard to figure out or because they just want to pretend like it's not going to happen or they truly are just have convinced themselves that the abundant future is the only outcome.

1:10:13 · So yeah, I don't know. It's I know some people love sci-fi. I did not have that book on my to to read list, The Diamond Age. So yeah, and I've not read Stevenson's stuff. So I might go check that out. I've tried the Culture series. I know you've been into that before, right, Mike? You've done the Culture series.

1:10:29 · I've read a few of those. Yeah. Yeah, I've tried and I usually get like a couple chapters in and it's like I don't know. I got to go listen to a podcast now. Like I I I haven't really like fully invested in them.

1:10:39 · Yeah, it's very out there when it's like almost like the humans aren't the main characters in the books basically.

1:10:44 · Is that where found is that Foundation?

1:10:46 · Is that one of the culture series?

1:10:47 · Uh no, that's Yeah, Isaac Asmma. So that's a little but it is but it is similar in the like big grand scope of everything, right? You know, which is really interesting. Um but yeah, no, we'll see. But I'm glad someone is uh maybe saying, "Hey, it's going to be a little messier than maybe those books."

1:11:05 · I And again, like I I would love to just focus on the optimistic stuff on this podcast all the time and like super practical stuff, we try and balance it with like the practical stuff, but I think the sooner we just accept it's going to be messy and we don't have all the answers and like we're not asking the hard enough questions, then we can move into the phase where we actually do that and then it's more addressable.

1:11:25 · like pretending like this is just going to go perfect and AI is only good and amazing doesn't do anybody anything. So, it's like I don't know like again I've tried to not be overly um uh create like anxiety and and fear around this stuff but I think there's just realities people need to face so we can get on with figuring it out.

1:11:47 · Yeah.

1:11:47 · [clears throat] And you know, I think in a more positive frame, it leads to ownership and agency. Like nobody is coming to figure this out for you or save you on this. And like I get that's scary, but like also it's like, okay, let's take a breath, move past that, and figure out what does this mean for your family, your career, etc.

1:12:04 · So, all right. So, bring this back down to earth a little bit. Next segment. This past week, the Center for Shared AI Prosperity released the results from a national survey they conducted with an organization called Blue Rose Research. They pulled 56,000 respondents on 79 ideas for how government could respond if AI disrupts large parts of the economy. So this the proposals they suggested covered four broad areas.

Americans Back Government Action on AI Disruption

1:12:31 · First was taxation and revenue. Second, income support and safety nets. Third, labor markets and workforce development.

1:12:37 · And fourth, models for ownership and governance. So these proposals range from taxes on AI profits and data dividends to wage insurance and even a US sovereign wealth fund. For each proposal, respondents read short arguments for and against it. Then they had to choose whether they supported or opposed it. There was no undecided option. The organization reports net support is the key metric here as the difference between support and opposition after those arguments.

1:13:04 · Of the 79 policies tested, 61 still had positive net support after respondents saw the opposing case. The 12 most popular maintained approval margins of at least 40 percentage points and 48 policies had margins of at least 15 points. So among the policies that directly mentioned AI, 31 of 48 won majority support.

1:13:29 · So the organization says respondents were especially receptive to the ideas of retraining and compensating workers affected by automation, strengthening the existing safety net and funding training apprenticeships and care work through progressive taxes. So the group also does caution that a popular policy is not necessarily an effective one.

1:13:49 · It describes the survey as a starting point for comparing ideas and understanding where bolder proposals may face political resistance. [snorts] So Paul, this kind of seems to suggest that Americans are open to active government responses to AI disruption. So the top five measures that they specifically suggested that were uh had net positive support were expanding apprenticeships, requiring severance for automated away jobs, sectorbased job training, employee ownership in firms, and a data dividend.

1:14:22 · And just one final note here, important to note that center for shared AI prosperity, they're a US focused research and policy coalition. They're clear pretty clearly aligned with the center-left progressive kind of democratic policy ecosystem. Blue Rose research is explicitly Democratic and progressive alliance. They're basically seems like we're doing some polling research here to figure out what policies are going to look good in the next few years.

1:14:47 · Yeah.

1:14:47 · So, and this does kind of tie back to the Bill Gates topic where it's like what can we do about this? Like if AI is going to impact us, what are the things that we can move forward on where we can make progress? Um, I love to see the apprenticeship thing. is actually what first caught my attention about this because that's the basis of my mcon talk in October is um the need to build apprenticeships across industries and function job functions.

1:15:10 · So the if you go to the blog post in the show notes uh in that post and we'll put a link maybe directly to this there is a Google worksheet that you can actually go read the descriptions of each of these and then the pro and the con argument. So it's it's really cool to you know just kind of a quick glance.

1:15:26 · So, I went through and pulled out a couple, Mike, just to see more context of what were they, you know, expanded apprenticeships is fine, but like what do they what does that even mean? Yeah.

1:15:33 · So, I'll just read uh let's see, I got three of the ones that got the positive net rating and then two that got the negative. So, expand apprenticeships says um scale up, earn while you learn apprenticeships in new fields, including AI infrastructure and roles that work alongside a AI. Under this policy, more workers could train for skilled jobs by working a paid position under experienced mentors. I I am I'm more and more convinced as I work on this opening keynote for Meon that like this is a very real thing that should be happening in a more structured way.

1:16:04 · Um require severance for automated away jobs. I didn't know what that one meant. Um so this would require that companies provide severance payer transition support to workers they replace with automation. Under this policy, a company that eliminates a job through AI or automation would have to give the affected worker a defined payout. So that's that I actually agree and I presented that as an idea last year that you should rather than unemployment if you took someone's job with a AI or machine that you should pay them for some extended period of time.

1:16:35 · So I'm actually an advocate of that concept.

1:16:38 · And then the data dividend. Some policy makers are proposing that tech and AI companies pay people for the personal data they collect. Under this policy, the data companies use to build and train AI would be treated as something you own and firms would have to compensate you. That actually is an Andrew Yang idea we talked about on a recent episode who also speaking at MCON. I'm guessing we'll address that one. Now, the two that jumped out to me that had pretty low net ratings, one is tax on automated services.

1:17:04 · Um, so this would be a tax on automated services people pay for things like robotic delivery, selfch checkckout, driverless rides and AI customer support the same way sales tax apply to other purchases.

1:17:18 · So the tax would fall on the automated service when it's used rather than on the machines or the software. And then the one I thought maybe was most interesting, Mike, because a lot of the AI lab leaders have thrown out this idea of universal basic income. And actually Andrew Yang's book in 2020 was based on this idea of universal basic income.

1:17:34 · People do not like this one. So, it said um some policy makers are proposing a universal basic income, a set monthly payment uh sent to every adult. Under this policy, everyone would receive the same regular cash payment from the government. That was the second lowest rated of all of them. So, that's wild.

1:17:51 · People are not UBI fans, at least in this.

1:17:54 · Yeah.

1:17:54 · Do I'm just curious. Do you see any I mean, it's super relevant regardless of who's running it. Do you see this as putting out feelers for possible future policies or just more benign research or I would guess it's campaign messaging like this close to it. Like they're doing ongoing research. But my my assumption here is you're trying to like not only do you want to hit the other people with the things that you think people are not going to like. So hey, they support data centers and you're spending millions.

1:18:20 · But it's like, hey, we support expanding apprenticeship which is going to get, you know, continue to give you the jobs and give you the opportunity to learn. We support dividends if you get un like you're just looking for the things to say here's the things we're we're all for. We have no plan, but like we like these ideas because you like these ideas.

1:18:38 · All right.

1:18:39 · All right. Next up, we've got our AI use case spotlight we do every week where we give you a quick look under the hood at some real AI use cases we're exploring in our work at Smarter X or in some cases in our personal lives. So, I've got one to share, Paul, then let you share whatever you've been working on this week. So, first up, I have been working on this for a long time. Um, but it kind of finally came to fruition.

AI Use Case Spotlight

1:19:03 · It's more a interest project rather than something super specifically useful, though it turned out to be extremely valuable. Um, I actually built like a podcast expert briefing system in Codeex. So, you know, I was trying to basically solve this pretty straightforward problem is like every week I do a ton of extensive prep for the podcast, read everything, make notes, think through stuff, try to look up different research and sources, but like you know, we have limited time and I'm trying to basically really become an

1:19:32 · ex expert like know enough to be dangerous more more likely on every one of these topics. Not just the news item, though that's interesting, but more like what does it mean? What are the implications? what are some of the technical aspects of it that sometimes you don't always have time to dive into.

1:19:48 · So, what I did this week is I finally took a little time to take my notes on this, take all the other little processes manually and uh with AI that I use to kind of prep for each week and put these into try to make like an actual briefing like for each topic, what do I actually want to know? How should it be formatted? What should it look like? What are the key things I want AI to go do research on? So basically I created this like executive briefing or this briefing on each segment which includes three parts.

1:20:17 · There's this executive briefing which gives me this compact reported narrative of what happened. Uses a ton of separate research. This is not like meant for like listener consumption. It's more like here's all the different angles.

1:20:28 · Here's what's been reported. You can kind of like think through and sort through it on your own. It's like I equate it to like I like the publication The Economist quite a bit. I'm like write me an economist article on this exact thing. a thousand words that like covers every possible aspect of it. It also has, interestingly enough, this is super helpful, a section called what others are saying.

1:20:48 · This is the second section of this three-part brief where it basically go find me the hot takes, go find me what the experts are saying about I'm just curious what are the opposing views, what are people validating, just kind of give me a a a subjective sense of that. And then finally is uh the technical briefing.

1:21:04 · So for each of these topics, it actually will go in and identify one or more technical aspects or areas or like even in some cases like policies, technologies, how things work that I need to know about and build me like a several thousandword narrative about explain this to me like a non-technical person or a non-policy person or a non-legal person.

1:21:29 · And so what's really cool is like took a few hours, but I got to like a really usable format for this I found really really helpful to prepare for this week's episode I'm probably going to use moving forward. But between the however many topics we covered this week, this thing will automatically now do the research and produce uh I'm looking at it now. It's in our brief.

1:21:50 · It's 21,000 words of briefing. So about a third of a book, right? Um which and for whatever reason I like reading it in this format. format may be terrible for someone else, but this is just kind of customized to me. I went back and forth iteratively on a single topic to get the format down and went tons of iteration like back and forth took a long time.

1:22:12 · Once I got the segment like perfect, I then said, "Okay, go do it for everything else." And within, you know, probably took an hour of codecs working, burned a lot of my usage. Thankfully, OpenAI is throwing out usage resets for codecs like candy, which is amazing. So, I got lucky on that, but it burned a lot of tokens. But, man, it's like reading through it, I'm like I basically created my own personal magazine for the podcast this week, and it's I really enjoy reading it.

1:22:40 · Well, and then you could throw it into the notebook, Google notebook, and have it turn it into like a 10-minute podcast version maps for you. Yeah. Y um now, why codeex? Why not chatbt work?

1:22:51 · Could you not have achieved the same thing using chat?

1:22:54 · You could do this same exact thing. And this is I I think you could do most of the same stuff. Uh I just happen to have gotten used to using codecs over the last four months. And this we got to do more of a segment on like the differences between chat GPT work and codecs cuz honestly I don't know them all. They seem very similar to me.

1:23:12 · I have a great article. I I don't know if I put it in the sandbox for next week yet, but I actually read I forget the guy's name. He's a he's a big AI guy, but um Simon Wilkinson or Williamson.

1:23:21 · Oh yeah, we've we've he did this whole and I was like, "Okay, I have to figure out what the difference is between chat work and codeex. Here's my best effort at it." And he said, "I'm glad I'm not alone because like I use them all the time and I'm still like I don't understand the decisions that went into like separating these."

1:23:38 · Yeah.

1:23:38 · He he said like it starts off with you know I went to chat to open eye site and I read the description of what chatubt work is for and I thought that's odd. I've been using chat to do those exact things for like six months.

1:23:51 · So yeah it is not clear. So if you're confused like join the club like everyone's trying to figure this out. Um I interest of time mine is um I there's a couple of major things I've been working on for a while. Um, both of them will probably come to light in the public in the next like 60 daysish. I'm at the point where I have to make very important decisions for the company like the future of our business and the trajectory and things like that.

1:24:18 · And um I rely very very heavily on a couple of chat GPT projects in particular to think through these decisions and and so I have to talk to attorneys and accountants and other adviserss and um I could not do it on my own. Like it's just in the timelines I have to make these decisions and to think through from every angle, make sure I'm asking the right questions, make sure I feel confident in the end decision that I end up making.

1:24:50 · So it is a human in the lead thing. Like it's just me going in and saying, "Okay, I thought about this.

1:24:56 · What do you what do you think? Here's the advice I'm getting. What should I be considering here? What should I go back?" So I am very much in in the midst of doing these two major things and it's consuming a lot of my time and a lot of my brain power and in the end a lot of my token usage is like helping me solve.

1:25:15 · So decision making is is the the front and center use for me right now assisting in decision- making.

1:25:22 · I'm just curious for that with whatever you can share. Um you know there's a lot of people still skeptical AI can reason at an expert level sometimes. It sounds like you're using this for very complex things and you would argue that it's probably at human level briefing.

1:25:38 · It's beyond.

1:25:39 · Yeah.

1:25:39 · I mean like so I present and I'm very transparent with the use of this with my adviserss and I I will share direct outputs with them and say here's what CHBT is telling me to ask you. Here's the open items it's identified within the legal documents. And almost every time it is things worth discussing that maybe we hadn't gone through previously.

1:26:01 · Wow.

1:26:02 · And so as long as you have this open relationship with your advisors where they understand that's how you're going to think about things, it it just breaks down that barrier right away and no one gets offended. It's like, "Hey man, we just we just need to make decisions and let's make the best decisions. I'm still not clear on three things that you're asking me to decide on. Like I don't have enough information." So, I went and did more research myself and here's what I think now.

1:26:26 · So yeah, I mean to the point where I've submitted legal briefs to my attorneys like here's the wording I would use like this seems better than what we were doing and so there's a lot of give and take but it is um I have very very good advisers and um it is very what we're doing with AI is very complimentary to very highlevel accomplished people across these domains.

1:26:53 · Wow.

1:26:53 · Yeah.

1:26:55 · All right. To wrap up here, we've got some AI product and funding updates.

1:26:58 · I'll go through real quick as we close out the episode. So, first up, OpenAI has talked through some of the first results with Jalapeno, its first custom inference chip. It says this system developed with Broadcom can deliver 1.5 to 1 nine times more AI work per watt and up to 3.6 six times lower latency across models that include their GPT OSS 120B model, DeepS R1, and Kimmy K 2.5.

AI Product and Funding Updates

1:27:25 · One thing I'll note real quick there, Mike, I I won't get into like specific background information that I might No.

1:27:33 · Well, I'll just say if you're wondering would would Jensen Wong be excited about OpenAI building their own chips?

1:27:43 · You would you might wonder uh about that. And I would just say I think a lot of what's happening right now is these these companies all work together, but they are also competing with each other.

1:27:54 · And sometimes um CEOs get unhappy with each other over decisions that are made that [laughter] were made a year ago and was known within the industry a year ago. And so if actually we go back in time and we look at some things that came out about a year ago, it actually starts to make a lot more sense because if Jensen knew that OpenAI was building their own chips a while back, it could cause a little bit of friction. So I think I think they continue to work together.

1:28:23 · They will continue to work together, but everybody's stepping on everybody's toes right now, I think, and it's starting to be unclear how this all plays out.

1:28:33 · Also, OpenAI added signin support to chat GPT works cloud browser on web and mobile for plus and pro users. This allows it to complete tasks on some supported websites after the user signs in securely. Anthropic added a built-in browser to claude co-work that can navigate pages, click and type without a browser extension and that is has initial availability for promax team and enterprise users.

1:29:00 · Anthropic and Salesforce announced Claude Force, an expanded partnership that launches with Salesforce and Claude. This is a plug-in for select pilot customers with 37 pre-built sales skills grounded in live revenue contexts. The open beta is planned for September while Claude is also available in Agent Force and embedded across Slack. Anthropic opened a research preview of what they call their model hardware standard.

1:29:24 · This is a model agnostic specification that uses standardized device drivers and access mechanisms, including MCP, model context protocol, to let AI agents discover, control, and coordinate programmable lab and manufacturing equipment ahead of a planned open-source release.

1:29:44 · Google introduced Gemini Enterprise for Legal, a fully governed legal plug-in for the Gemini Enterprise app that combines purpose-built skills, agents, and connectors for work, including legal research, regulatory screening, and contract drafting. Available in preview, it connects to existing enterprise and legal systems, and provides traceable citations back to source material.

1:30:05 · Real quick, I think this is a prelude of what's going to happen. So basically the labs realize that it's really hard for everyone to figure out how to use agents like give them the general agents and they build their own. So I think they're just going to industry by industry and just build packages that say okay here marketers here attorneys here accountants like we've pre-built everything you need go. Yep. Yep. Uh Google also announced expanded billing and cost controls for Gemini enterprise agent workflows. This or workloads rather.

1:30:33 · This includes a pay as you go app edition available to select customers and rolling out broadly soon. There's new projectwide poolled clo quotas for anti-gravity and Gemini enterprise. There's spendbased flexible savings plans, project level monthly spend caps and public preview and pricing calculator estimates for background agent runtime costs. It's all very well and good, but does not seem like it is less complicated. So, it'll be interesting to see how this works.

1:31:00 · Google released also Gemini Omni 1.1 Flash as a productionready generative video update. They added scene extensions in 10 sec second increments up to a total cumul cumulative length of 40 seconds first and last frame controls 36 360p previews generated up to 60% faster than 720p and 4K upscaling. We found out who is behind that secret and surprise ox alpha model. It was Z.AI.

1:31:26 · AI uh revealed that th this was their GLM 5.3 flash model and it was launched now at 7.5 cents per million input tokens and 25 cents per million output tokens.

1:31:42 · That's half its list rates through September 9th. This that anonymous test became the most popular model of the past week. figure. The robotics company said its index data app emerged from stealth with more than 16 million videos already uploaded and committed and they committed to spend more than $1 billion on data and compute over the next 12 months. Is basically a data set that they have now for robotics that can be used to train their products and their humanoids.

1:32:09 · And then finally, Moonshot AI is reportedly in early stage talks with Microsoft, Amazon, and Google over deals to host its openweight Kimmy K3 model with Moonshot seeking up to 30% of revenue from K3 related services on Azure, AWS, and Google Cloud.

1:32:27 · And just to just to clarify, that is a Chinese lab that American companies are negotiating with to infuse Chinese open models into their offerings. that that I would think would be a polit bit of a political hot point. We we shall see more about that. [laughter] I think that's a good prediction.

1:32:47 · As one final reminder here, our AI pulse survey for this week is still live at smarterx.ai/pulse. It should take you literally seconds to fill out. We're asking one question about how you are operating uh how your company is approaching rather entrylevel hiring uh due to the effects of AI on the labor market. So Paul, another packed week. Appreciate you breaking everything down for us.

1:33:11 · Yeah, good stuff. Uh hopefully we have a bunch of like really positive exciting things to share with you next week.

1:33:16 · That would be nice. [laughter] That's our goal every week. We'll see if we get there next week. Um, and actually Mike, we have was it Labor Day next Monday, but we'll drop we're dropping on the normal day still because we're going to record on Friday. Okay.

1:33:29 · Yep.

1:33:29 · All right. So, yeah, regular weekly episode as usual. Do we have an AI transformation spotlight this week?

1:33:34 · Uh, we do not. No, we had one come out this past week though. So, there is one that's pretty fresh with John Dick at HubSpot episode 234.

1:33:41 · Yeah.

1:33:41 · So, if you haven't been following the eye transformation series, Mike's done three of those now. They're really great practical inside information about like the the messy parts, the good stuff. So, go listen to those. They're super uh applicable to anyone that's kind of driving business transformation.

1:33:58 · All right. Thanks, Mike. Have a great week, everyone. Thanks for listening to the artificial intelligence show. Visit smarterx.ai AI [music] to continue on your AI learning journey. And join more than 100,000 professionals and business [music] leaders who have subscribed to our weekly newsletters, downloaded AI blueprints, attended virtual and [music] in-person events, taken online AI courses, and earned professional certificates from our AI academy, and engaged in the Smarter X Slack community. [music] Until next time, stay curious and explore AI.