How AI Can Help Local Governments In 2025?


How AI Can Help Local Governments in 2025?

Artificial intelligence has impacted every sector in the world, including governments. As AI technology progresses, it presents opportunities for local governments to increase efficiency and make more informed judgments.

In 2025, AI will assume the lead in managing complicated urban environments, allocating resources efficiently, and responding rapidly to residents. Local governments can employ AI to address long-standing concerns like public safety, transportation, and community engagement.

This article examines how artificial intelligence (AI) could help municipal governments run more efficiently, quickly, and successfully in the coming year.

Current State of AI Adoption in Local Government

Adoption of AI in local governments has been on the rise for the last few years. Some local governments started to explore the use of AI for better, if not even more sophisticated, solutions and service provisions to their locales. Cities like Barcelona and Singapore have adopted AI to grow as a smart city. The areas of focus for these projects are matters of traffic management, waste reduction, and energy efficiency.

Although AI for public services is gaining interest, there still are many barriers to implementing it wholesale. Budgetary constraints and lack of technical know-how and security issues with the data have hindered it so far. Most of the countries do not yet utilize their AI-aimed potentials in decision-making either. However, as there is a requirement for better services within public services, the influence of AI on municipal administration will accelerate by 2025.

Key Areas Where AI Can Help Local Government

AI has numerous mobile applications for helping local governments enhance their operations. Here are some important areas where AI can make a difference:

  1. Automating Public Services

AI can automate public services, saving time and lowering errors. Chatbots, for example, can address frequent citizen questions around the clock. This minimizes the workload of government personnel. Virtual assistants can help people with tasks such as applying for licenses or paying taxes online. This improves service delivery times and efficiency for both citizens and government staff.

AI can, therefore, assist governments in better judgments toward making critical decisions by analyzing data and predicting problems. For example, AI can help identify which routes require freeways by analyzing data from traffic sensors. AI also predicts possible crimes, and it is quite possible for law enforcers to prepare ahead of an issue erupting. This proactive approach will help save money while improving public safety at the same time.

  1. Resource Management

AI can help them manage resources such as water, waste, and energy. Artificial intelligence can, for example, detect water leaks and also reduce water system waste. AI-based systems assist in giving control over energy consumption in public buildings and consequently keeps reducing expenditures. These upgrades enable governments to function more sustainably while reducing the waste of resources.

  1. Transport and Urban Planning.

Artificial intelligence is used to improve urban transport systems. It can control traffic lights and therefore enable decongestion. This can also be utilized in plotting routes for public means of transport based on commuters’ data. As such, transportation networks are tailored according to the needs of the populations. AI enhances people’s movement as well as around cities, hence making them habitable.

Improving Citizen Services and Engagement

AI-powered solutions can improve how local governments communicate with the public. Governments can use AI to create online public forums where residents can express their issues or leave comments. AI can monitor these discussions and flag pertinent issues as actionable.

Municipal governments can also employ AI to provide citizens with real-time information. AI can automatically send notifications depending on location and urgency, such as an emergency notice, forthcoming event, or road closure. Citizens can stay updated without having to seek information by receiving notifications directly to their phones.

Customization of public services is another benefit of artificial intelligence. Governments can provide services that fulfill certain needs (helping the elderly or those with impairments) by evaluating citizen data. Government services are therefore more widely available and inclusive to the whole community.

Artificial Intelligence in Security and Public Safety

This enhances safety and security for the public at large. The local governments can choose to use AI-based surveillance systems that will allow them to monitor the public space in real-time. They will pick on the suspicious activities and alert the authorities before things get out of hand. AI is helping law enforcement in analyses of crime trends, resource allocation, and even predicting hotspots of crimes.

Predictive policing is an embryonic field wherein artificial intelligence is doing much to influence it. It can help police authority to stop crimes before being committed by making use of historical crime data. At the same time, it has some obvious ethical questions related to privacy and justice. The local governments should ensure that the efforts of AI are transparent and not biased toward certain groups of people.

AI has another impact on disaster response. The capacity to foresee the path of natural disasters like hurricanes and floods is enabled by AI systems. This allows local authorities to prepare ahead of time, that would prevent infrastructural damage and protect citizens.

Increasing the Effectiveness of Government

AI can automatically deal with a number of routine administrative tasks which municipal governments face on a daily basis. Through the use of AI, a variety of clerical and data entry functions dealing with document processing and public records management are addressed. Government employees will then be able to deal with more complex issues that require human creativity. As a result, productivity as a whole improved.

Artificial intelligence can also be useful in budgeting and financial management. It may study the patterns of expenditure and predict future expenditures to help the local governments manage their resources well. Furthermore, AI-based systems may detect anomalies in a financial transaction that will reduce fraud and waste.

Challenges and Ethical Considerations.

While AI provides several benefits, its adoption in local governments presents hurdles and ethical concerns. One of the main concerns is data privacy. AI systems depend on vast volumes of data, which are frequently obtained from citizens. These data should also be kept safely by the respective local governments so the privacy of citizens, and breach of data, are avoided.

One ethical concern is bias in AI systems since AI algorithms only perform as well as the data used to train them. So, biased data can lead to unjust or discriminatory results. This could result in specific groups being unfairly targeted or excluded from services. Governments must ensure that their artificial intelligence systems are transparent and accountable, with clear criteria for decision-making.

The next concern is safety. People should be careful while using AI systems in areas like public service delivery and law enforcement. Local governments need to interact with the public, specifying the advantages of AI and being open about its application.

Future Trends and Opportunities for AI in Local Governments.

The importance of AI in municipal governments is expected to increase further in the coming years. More advanced AI technologies are expected to be adopted by 2025. Machine learning and natural language processing will become increasingly popular in fields like public health, urban planning, and environmental monitoring. These technologies will enable governments to make better-informed judgments and respond to issues in real-time.

One rising trend is the use of artificial intelligence (AI) in environmental sustainability. Governments may employ artificial intelligence to track pollution levels, manage natural resources, and build more sustainable cities. With climate change continuing to exert its impacts in the world, it will similarly play a key role in assisting cities’ adaptability and resilience with AI.

This will continue to develop with AI-powered platforms that allow citizens to communicate directly with government services. This would, therefore, encourage more individualized services and real-time contact. It would be important for the locality of governments to stay ahead of such advances in order to increase their productivity and improve citizens’ results.

Conclusion

AI is changing the way local governments work, like providing powerful tools to improve efficiency, increase citizen participation, and make better decisions. AI brings previously inconceivable solutions to local governments, such as automating public services, anticipating crime, and managing resources.

Though data privacy, bias, and public lack of trust issues do arise, they can be solved through careful and transparent AI technology use. The advancements of AI can be capitalized upon by local governments as AI matures, answer the needs of communities well into 2025 and beyond.

By intentionally engaging in AI, local governments can build a safer, smarter, more effective community for the betterment of all people.

 

 

 

OpenAI’s Economic Blueprint, Ph.D-Level “Super Agents” Rumored, o3 Release, New AI Pricing from Google and Microsoft & Apple Intelligence Falls Flat


OpenAI unveils an ambitious Economic Blueprint proposing $175 billion in AI investment opportunities—a plan that could redefine America’s tech landscape.

Plus, Google makes waves by integrating Gemini across Workspace, Microsoft introduces revolutionary AI pricing, and Sam Altman announces OpenAI’s next-gen o3-mini model.

Mike and Paul break down these major shifts, along with Apple’s AI challenges, TikTok’s uncertain future, and the most significant AI developments of last week.

Listen or watch below—and see below for show notes and the transcript.

Listen Now

Watch the Video

Timestamps

00:06:38 — OpenAI Releases Its Economic Blueprint

00:19:27 — OpenAI “Super-Agent” Rumors + o3 Mini Release Date

00:30:19 — Google Is Giving Away AI Capabilities to Workspace Customers (And Microsoft Is Changing Pricing)

00:40:03 — Google Releases New Research on the Potential Successor to Transformers

00:44:10 — Google Releases Factuality Benchmark for LLMs

00:47:48 — Apple Intelligence Falls Flat

00:52:56 — TikTok Shutdown Drama

00:58:42 — US Patent and Trademark Office Releases Its AI Strategy

01:01:54 — Meta AI Copyright Lawsuit

01:05:04 —Benchmarking the Energy Costs of Large Language Models

01:09:00 — NotebookLM Has to Do “Friendliness” Tuning on Its AI Podcast Hosts

01:10:48 — AI Funding and Product Updates to Watch

  • Synthesia Raises $180M Round
  • Cursor Raises $105M
  • Andreessen Horowitz Leads Series A Round in Company Developing AI for Mental Health
  • ChatGPT Gets Tasks…
  • …And Custom Instructions
  • DeekSeek R-1
  • Microsoft Introduces Copilot Chat
  • Adobe Releases AI Tool That Can Edit 10,000 Images in One Click
  • Luma Releases Ray 2 Video Generation Model
  • Runway Releases Frames

Summary 

OpenAI Releases Its Economic Blueprint

OpenAI just released what it’s calling its “Economic Blueprint,” a policy proposal for how the US should develop and regulate AI.

The blueprint makes a bold claim that there is approximately $175 billion in global funds waiting to be invested in AI projects—and that if the US doesn’t attract these funds, China will.

To prevent this, OpenAI proposes a comprehensive national strategy that includes developing AI economic zones, creating research labs aligned with local industries, and building what they call a “National AI Infrastructure Highway,” a network of power and communication grids specifically designed to support AI development.

OpenAI also recommends that the federal government, in consultation with industry, should take the lead in developing “alternatives” to the “growing patchwork of state and international regulations that risk hindering American competitiveness.”

The blueprint also wades into controversial territory around copyright and AI training data: OpenAI argues that AI developers should be able to use “publicly available information,” including copyrighted content, to develop their models.

Google Is Giving Away AI Capabilities to Workspace Customers (And Microsoft Is Changing Pricing)

Two of AI’s biggest players just made big changes to their pricing strategies, with both Google and Microsoft revamping how they package and charge for their AI products.

Google announced that it is basically giving away Gemini to Business and Enterprise customers, adding it by default to all Google Workspace business plans.

The catch? It comes with a price increase. Previously, a Workspace Business Standard plan with the Gemini add-on cost $32 per user, per month—but now it will be $14 per user, per month, a $2 per month increase from the previous Standard plan. 

Microsoft, while keeping its premium Copilot Pro at $30 per user per month, is introducing new consumption-based pricing for certain AI “agent” features that can “automate workplace processes,” according to The Information.

They write: “Under the new consumption pricing, one message within 365 Copilot Chat costs roughly one cent, while messages that require the chatbot to create a lengthy answer using generative AI cost two cents, and messages that require the chatbot to draw on other data from other applications cost 30 cents.”

“Super-Agent” Rumors + o3 Mini Release Date

Major developments are brewing at the major AI labs, with multiple signals pointing to some big upcoming announcements, possibly from OpenAI. 

According to a breaking report from Axios:

“Architects of the leading generative AI models are abuzz that a top company, possibly OpenAI, in coming weeks will announce a next-level breakthrough that unleashes Ph.D.-level super-agents to do complex human tasks.”

Axios goes on to say: “The expected advancements help explain why Meta’s Mark Zuckerberg and others have talked publicly about AI replacing mid-level software engineers and other human jobs this year.”

Right now, Axios is hedging its bets on if this is from OpenAI or another lab.

At the same time, however, another development is confirmed by Altman himself: He posted on X that that the company is finalizing the o3-mini model for release in approximately two weeks

Altman has noted that while this model isn’t as capable as their o1 pro version, it’s significantly faster—and importantly, will launch simultaneously on both their API and ChatGPT platform. Based on his comments, it also sounds like o3-mini will be accessible by ChatGPT Plus users in some fashion.

This episode is brought to you by our AI Mastery Membership: 

This 12-month membership gives you access to all the education, insights, and answers you need to master AI for your company and career. To learn more about the membership, go to www.smarterx.ai/ai-mastery. 

As a special thank you to our podcast audience, you can use the code POD150 to save $150 on a membership. 

Today’s episode is also brought to you by Marketing AI Institute’s AI for Writers Summit, happening virtually on Thursday, March 6 from 12pm – 5pm Eastern Time.  Learn to craft compelling stories faster, boost your productivity, and build a sustainable writing strategy for the years ahead. Choose between free live access or premium tickets with on-demand replay. Don’t miss this opportunity to transform your writing. Register now at aiwritersummit.com

Read the Transcription

Disclaimer: This transcription was written by AI, thanks to Descript, and has not been edited for content. 

[00:00:00] Paul Roetzer: We are entering a very different phase in American business and innovation, and the heads of the AI companies are in the first row. Welcome to the Artificial Intelligence Show, the podcast that helps your business grow smarter by making AI approachable and actionable. My name is Paul Roetzer. I’m the founder and CEO of Marketing AI Institute, and I’m your host.

[00:00:23] Paul Roetzer: Each week, I’m joined by my co host and Marketing AI Institute Chief Content Officer, Mike Kaput, as we break down all the AI news that matters and give you insights and perspectives that you can use to advance your company and your career. Join us as we accelerate AI news.

[00:00:46] Paul Roetzer: Welcome to episode 131 of the Artificial Intelligence Show. I’m your host, Paul Roetzer, along with my co host, Mike Kaput. last week on episode 130, we started off saying it was probably going to be a hectic week because last [00:01:00] Monday morning had started off with a bang with a bunch of stuff and, we were correct.

[00:01:04] Paul Roetzer: It was a very busy week in AI. Mike and I were cutting rapid fire items up until like 10 minutes ago, because it was just too much to get through. So. It is an action packed, week. It’s, we are recording this on January 20th, Monday morning. so, I know this week’s gonna already be busy because we’re gonna have some executive orders probably repealed from the previous administration and, on AI.

[00:01:33] Paul Roetzer: we’re gonna have a whole new day of how AI is approached in the United States, at least. So I expect a lot happening again this week, Mike. Yes, sir. We’ll be keeping up with plenty to talk about on Episode 132 next week. All right. But for now, we are on Episode 131. This week’s episode is brought to us by the AI Mastery Membership Program.

[00:01:55] Paul Roetzer: We’ve been talking a lot about this lately. I have mentioned that some changes were coming [00:02:00] to the program. I decided to Last Friday that we’re gonna just go ahead and announce those changes this week, at least preview the changes this week. So what we’re gonna do is, as part of the Mastery program, 12 month membership program with exclusive content and experiences.

[00:02:17] Paul Roetzer: one of the key components of it is every month Mike and I do an exclusive, session for our members. So we do a generative AI mastery series that Mike runs where he demos a bunch of technology, we do an AI Trends Briefing and we do an Ask Me Anything session. So each of those happens once a quarter.

[00:02:36] Paul Roetzer: This Friday is our AI Trends Briefing, where we’ll go through kind of the last three months and what are the main things. We usually count down from 10 is kind of the format of it. And so what we’re going to do this Friday is we’re actually going to open that session up to anyone that wants to attend.

[00:02:52] Paul Roetzer: So this is usually members only. We’re going to make the quarterly AI Trends Briefing for Q1 open to the public. And part of [00:03:00] the reason we’re doing that is to let people experience it. But the, the bigger reason is I’m going to, lay out our roadmap for, AI Academy, for what we’re going to do with our Academy.

[00:03:11] Paul Roetzer: And also introduce a new initiative. That’s designed to dramatically accelerate AI education worldwide. So, anyone who listens to us, regularly has heard me say our kind of North Star is to accelerate AI literacy for all. And so that’s what I’ve been working on is, is sort of a, a new project that will enable us to do that, hopefully in partnership with other organizations and associations.

[00:03:33] Paul Roetzer: And so I’m going to explain that vision on Friday and share our near term roadmap for what we’re going to be doing as part of that project. So You can go to smarterx.ai/ai-mastery, and you can register for that free session on Friday. We’ll put that link in the show notes as well. So, again, that’s Friday at, noon Eastern time.

[00:03:57] Paul Roetzer: We’ll go through the trends briefing and I’ll kick it off with, like, ten minutes [00:04:00] about the vision for this, AI literacy program that we’re introducing. So, again, smarterx.ai/aimastery. Thank you. And then, as we’ve been sharing recently, you can use POD150 if you want to join the AI Mastery program, and that’ll get you 150 off that annual membership.

[00:04:18] Paul Roetzer: this episode is also brought to us by the AI for Writers Summit. We’ve been talking about this on the last couple episodes. This is our third annual virtual summit. This is going to be happening March 6th, Thursday, March 6th, from noon to 5 p. m. Eastern time. we had over a thousand people register last week.

[00:04:35] Paul Roetzer: We just, you know, started promoting it really, last week and over a thousand people registered. We had 4, 500 plus in 2024, so we’re expecting similar turnout this year. We will be posting the 2025 agenda in the coming days, I believe. We just kind of finalized that last week. So that’s going to be coming soon.

[00:04:55] Paul Roetzer: You can go to AIWriterSummit. com. Again, that’s [00:05:00] AIWriterSummit. com. You can also find information about that directly from the Marketing AI Institute site under the Events tab. And then one final reminder, we have our 6th annual MAICON event, Marketing AI Conference, is going to be back in Cleveland October 14th.

[00:05:15] Paul Roetzer: To 14th to the 16th, you can go to ma con.ai, M-A-I-C-O-N ai. the key here is we are open for speaker applications. So if you want to speak or if you know someone that would be a great speaker, for us to have at ma Con 2025, definitely check that out. Again, go to Ma Con, do AI and there is a Submit your speaker application button right there on the homepage.

[00:05:40] Paul Roetzer: Those are open till February 28th, it looks like we’re accepting applications. So get those in early. We review them on a rolling basis, so as they come in, we actually, look at those applications. and then if someone’s a great fit, we don’t wait until, you know, March to let them know. We’ll actually reach out to people sometimes in advance.

[00:05:59] Paul Roetzer: So, [00:06:00] get in early, And we would love to hear from you. If you’ve got a great session that you think would be a good fit for that audience, we’re expecting about 1500 people at MAICON 2025. All right, Mike, we got a lot of economic stuff. We got super intelligence. We got it. We got it all going on. 

[00:06:18] Mike Kaput: Yeah, it’s a, it’s a crazy week.

[00:06:20] Mike Kaput: Like do you.

[00:06:21] Paul Roetzer: I feel like somebody told me one time, like we start every podcast saying it’s crazy. It’s gotten worse though. It is a crazy week. It’s gotten crazier. 

[00:06:30] Mike Kaput: I feel like we got to go back and look at the first time we mentioned it was a crazy week and just laugh at how probably light it was compared to now.

[00:06:38] OpenAI Releases Its Economic Blueprint

[00:06:38] Mike Kaput: All right. So first up OpenAI just released what it’s calling its Economic Blueprint. This is a policy proposal for how the U. S. should develop and regulate AI. This blueprint makes a pretty bold claim that there is approximately 175 billion in global funds [00:07:00] waiting to be invested in AI projects. They also argue that if the U. S. does not attract these funds, China will. To prevent this, OpenAI proposes a comprehensive national strategy that includes developing AI economic zones, creating research labs aligned with local industries, and providing and building what they call a National AI Infrastructure Highway, a network of power and communication grids specifically designed to support AI development.

[00:07:30] Mike Kaput: OpenAI also recommends that the federal government, in consultation with industry, should take the lead in developing, quote, Alternatives. To the, quote, growing patchwork of state and international regulations that risk hindering American competitiveness. This blueprint also wades into controversial territory around copyright and AI training data.

[00:07:53] Mike Kaput: OpenAI argues that AI developers should be able to use, quote, publicly available [00:08:00] information, including copyrighted content, to develop their models. And this all comes at an interesting time. We’ll talk about this as well in the next topic, but OpenAI CEO Sam Altman has scheduled a closed door AI briefing for U. S. government officials on January 30th. Paul, why are we getting this blueprint now? And maybe talk a little bit or tee up a little bit. What’s the deal with the closed door briefing for lawmakers? Is it about this? Is it about something else? 

[00:08:32] Paul Roetzer: We’ve been talking a lot about infrastructure, especially in the last like six to eight months on the podcast.

[00:08:38] Paul Roetzer: I think we’ve been, you know, trying to introduce that topic for people who maybe aren’t paying as close attention to that side of AI. It’s very fundamental to what happens next. And so it’s not. New. I mean, OpenAI has been very aggressively meeting with lawmakers for the last couple of years. There’s been lots of conversation around trying to make US a leader in the buildout of data centers and the infrastructure to power [00:09:00] AI.

[00:09:01] Paul Roetzer: but I think with the new administration coming in, everyone’s lining up to sort of get their messaging in place and build the relationships they need to build and have a say in kind of what happens next. So, My guess is the, the, January 30th meeting is just a timing. The new administration is, you know, coming into power today in America.

[00:09:21] Paul Roetzer: January 20th will be the inauguration. So two weeks from now, you’ve got, you know, Congress, Senate, president. Everybody’s kind of, set up now and, and, and time to get to work. So, the thing that was interesting to me here is, as a kind of like journalism school major. I always drill into data points, where this, where’s this coming from?

[00:09:42] Paul Roetzer: Because this whole thing is basically centered on this 175 billion. And so in the second paragraph, they say shared prosperity is as near and measurable as the new jobs and growth that will come from building more AI infrastructure like data centers, chip manufacturing facilities and power plants.

[00:09:57] Paul Roetzer: That’s as our CEO Sam Altman has [00:10:00] written, AI will soon help our children do things we can’t, not far off in the future, in which everyone’s lives can be better than anyone’s life is now. So I think this is interesting because they’re basically, there’s a lot of concern that I have shared many times on this podcast that AI is going to displace jobs.

[00:10:16] Paul Roetzer: I’m, I’m, I believe that, very deeply. I think this is the setup for how these companies Make the government believe there’s a net positive outcome if the government invests properly in infrastructure. so the, the 175 billion, so in that opening paragraph it says new jobs and growth. If you click on that link, it actually takes you to the September 2024 OpenAI.

[00:10:45] Paul Roetzer: report called Infrastructure is Destiny, Economic Returns on U. S. Investment in Democratic AI, which I assume we talked about at that time. Like I, sort of in September of 24, so I’m guessing we at least mentioned that. I [00:11:00] didn’t go back and look and see the extent to which we talked about it. So when you go into that report though for September 2024, this is the source of the 175 billion.

[00:11:09] Paul Roetzer: It says capital spending on AI already rivals the The mainframe era of the late 1960s and the fiber optic deployment of the late 1990s. With an estimated 175 billion in global infrastructure funds waiting to be committed. Now, that report cites, in the citation for the 175 billion, actually comes from Houlihan Lokey, Digital Infrastructure Industry Update Q2 2024.

[00:11:38] Paul Roetzer: I have never heard of Houlihan Lokey. I had not gone to that report prior to this. It’s a pretty dense report. Report on digital infrastructure, but OpenAI is citing Houlihan Loki to come up with 175 billion. And when you drill into like that 175 billion, it, you need like the [00:12:00] O1 reasoning model from OpenAI to understand how they come up with that number.

[00:12:04] Paul Roetzer: But the whole point here is like, Don’t just accept data on face value. Like, too much, I think we’ve gotten to the point with Twitter and social media, and like, even mainstream media does it to a degree. Everyone latches on to these numbers with no concept of where the number actually originated from or how, like, legitimate that number is.

[00:12:25] Paul Roetzer: I 175 billion isn’t true. Reasonably accurate. I’m not even saying it’s not underestimated that it’s not a trillion. I have no idea. But this is kind of where we follow it. So then if you so now you understand like open AI is basically building on top of other people’s research data to justify The opportunity that exists now in the infrastructure is destiny.

[00:12:51] Paul Roetzer: Open AI report that basically laid out how data struck data center build out will create all of these jobs in [00:13:00] America and accelerate the growth of GDP growth, domestic product, a gross domestic product. So in that report, it says that each five gigawatt data center We’ll have 2 million GPUs, so NVIDIA will be very happy, because 2 million GPUs per data center.

[00:13:15] Paul Roetzer: Each one will cost 100 billion in 2028 dollars to build, so they’re already projecting out three years from now. And it’ll create 14, 000 construction jobs and 40 billion in annual revenue, per data center. Then, to operate those data centers, you’re looking at an estimated 4, 000 employees per data center.

[00:13:38] Paul Roetzer: So the whole point of this is, they think data centers, which are needed to build the future AI models, and deliver all the AI that we need at inference time, all this intelligence we need at inference time when you and I use our smartphones and use ChatGPT and things like that is a really big deal and it’s going to be a massive driver of employment and GDP [00:14:00] specifically in the states where the data centers are built and that infrastructure is destiny report from OpenAI actually breaks down by state.

[00:14:10] Paul Roetzer: How much money could be generated? How much GDP could grow? And how many jobs could be created in those states? So, I think that the basic premise here is, they’re making this massive bet on infrastructure. They believe they’re going to build insanely intelligent models, and that those models are going to need more and more data centers.

[00:14:29] Paul Roetzer: Now, in the blueprint, the one other aspect is, they start like, Connecting this to the past, and I thought this was really interesting historical context. I hadn’t read about this prior, but they talk about how, like, when cars were first invented in the UK, the UK actually put something in called the 1865 Red Flag Act.

[00:14:48] Paul Roetzer: When a car was coming down the street, they had a flag bearer that had to walk in front of the car to warn people that the car was coming, and that, you know The car had to move aside in favor [00:15:00] of horse drawn transport. So they’re sharing this as, like, a lesson of let’s not over regulate things. Let’s, like, accept that change happens, and it may look weird at first, but that we shouldn’t actually Restrict this.

[00:15:15] Paul Roetzer: That’s what’s happening in the EU. They’re saying, like, we can’t go that path. We have to push forward. Chips, data, energy, and talent are the focus of it. And then the one other note that I , I think is really interesting. The, the Economic Blueprint, the actual full blown report that we’ll link to, states in the very opening, OpenAI’s mission is to ensure that artificial intelligence benefits everyone.

[00:15:39] Paul Roetzer: This is the first time I’ve actually seen them drop general from that. They usually say artificial general intelligence. To us, that means building AI that helps people solve hard problems, because helping with the hard problems, AI can benefit the most people possible. Now, the timing here is interesting, Mike, because you and I had touched on this, but o3 is built to solve hard [00:16:00] problems.

[00:16:00] Paul Roetzer: Like, these reasoning models aren’t for the average user to go in and ask, like, about a summary of sports events from last night or do some basic research. These things are designed to solve hard math and science problems. So, the MIT Technology Review comes out with an article. It says, OpenAI has created an AI model for longevity science.

[00:16:21] Paul Roetzer: In that article it says when you think of AI’s contributions to science you probably think of AlphaFold, the Google DeepMind protein folding program that earned its creator a Nobel Prize last year. Now OpenAI says it’s getting into science game two with a model for engineering proteins. Company says it has developed a language model that dreams up proteins capable of turning regular cells into stem cells, and that it has handily beat humans at the task.

[00:16:45] Paul Roetzer: The work represents OpenAI’s first model focused on biological data and its first public claim that its models can deliver unexpected scientific results. If you remember, The five levels of AI at OpenAI, number four is [00:17:00] innovators, creating new solutions to problems, basically. As such, it is a step forward determining whether or not AI can make true discoveries, which some argue is a major test on the pathway to AGI.

[00:17:10] Paul Roetzer: The pro team engineering project started a year ago when Retro Biosciences, a longevity research company based in San Fran, approached OpenAI about working together. That link up did not happen by chance. Sam Altman, the CEO of OpenAI, personally funded Retro with 180 million, as MIT Technology Review first reported in 2023.

[00:17:31] Paul Roetzer: Retro’s goal is to extend the normal human lifespan by 10 years. So I think that a lot of things are happening here. One, one is the new administration and OpenAI trying to kind of stake their claim and influence it. Two is they truly believe infrastructure is destiny, that to achieve the kind of intelligence they plan to achieve and to have the impact on the world they want to have, they need to build this infrastructure out.

[00:17:53] Paul Roetzer: Three, they’re seeing massive gains in their reasoning models. Like 01, moving into 03, and eventually [00:18:00] 04. and they see the ability for these things to start solving really hard problems in society. And I think they want to prepare the government and the world for that, which I believe they think is very near to happening.

[00:18:15] Paul Roetzer: That was a lot. 

[00:18:17] Mike Kaput: Funnily enough, the only thought I could keep thinking while I’m looking at this January 30th meeting is Sam Altman better not show up and suddenly Elon’s in the room too. 

[00:18:27] Paul Roetzer: Oh, trust me. I was thinking about that all weekend. There’s no way Elon’s not in the room. Which is gonna be the weirdest, I would like, I pray that that is somehow broadcast, like, I saw, the pre party for the inauguration last night, there was a clip on Twitter I saw of Jeff Bezos and Elon Musk standing there talking to each other, which, we won’t get into the whole history of those two, but they’ve been very Oddly friendly on Twitter lately, like Bezos Blue Origin, rocket company successfully put something into [00:19:00] orbit last week and Elon actually tweeted like, Congratulations, great job.

[00:19:03] Paul Roetzer: Jeff then replied, Hey, great job to you too. It’s like something weird is happening, like the two richest people in the world are now like turning into buddies, it seems. And, yeah, it’s like, I , I keep thinking like Elon is going to be in whatever meeting Sam is at and I don’t know that those two have been together in person.

[00:19:21] Mike Kaput: Yeah. 

[00:19:22] Paul Roetzer: In a room where they have to speak to each other for a long time. 

[00:19:27] OpenAI “Super-Agent” Rumors + o3 Mini Release Date

[00:19:27] Mike Kaput: Our second big topic is really closely related to what we just discussed. So there are some major developments, it sounds like, that are brewing at the main AI labs and multiple signals seem to be pointing towards that. Some big upcoming announcements, maybe from OpenAI.

[00:19:45] Mike Kaput: So there was a breaking report from Axios the other day that said, quote, architects of the leading generative AI models are abuzz that a top company, possibly OpenAI n coming weeks will announce [00:20:00] a next level breakthrough that unleashes PhD level super agents to do complex human tasks. Axios goes on to say, quote, the expected advancements help explain why Meta’s Mark Zuckerberg and others have talked publicly about AI replacing mid level software engineers and other human jobs this year.

[00:20:22] Mike Kaput: Now Axios is hedging its bets on whether or not this is from OpenAI or another lab, though they do mention, like we just talked about, Sam Altman’s closed door briefing with government officials on the 30th. And at the same time, another development is confirmed by Altman himself. He posted on X that the company is finalizing the O3 mini model for release in approximately two weeks.

[00:20:46] Mike Kaput: Altman has noted that while this model is not as capable as O1 Pro, it is significantly faster and will launch simultaneously both with their API and on ChatGPT. It also sounds like [00:21:00] O3 Mini might be accessible in some form by ChatGPT Plus users based on some of his replies. To the initial posts. So Paul, this like super agent is this, I feel like we’re just going to see this like term for some reason, all over this could be in reference to like, we talked about an open AI release code named operator that was rumored back on episode one 24 could be something totally different.

[00:21:26] Mike Kaput: Like what is most likely being referenced here? And like PhD level super agent feels a little more aggressive than. Some of the talk we’ve heard about agents in the past. 

[00:21:36] Paul Roetzer: I think it’s, it’s likely O3, but it’s probably more likely the, test time compute that they’re seeing the scaling law.

[00:21:46] Paul Roetzer: Accelerating. So if we remember back to like, so weird to say the historical large language models of the last two years, like contextually, the whole premise there was give them more Nvidia chips to train [00:22:00] on, give them more data, give them more time to learn, and they became. Much larger, much more intelligent, much more generally capable.

[00:22:07] Paul Roetzer: And so that took us from GPT 1 to GPT 4, where we scaled this law, where we just give them more data, more chips, and they got bigger and smarter. Then in O with O 1, in September, I guess we got 01, right? Is that right? Yeah. September 24, we were introduced to this test time compute, this idea that if you just give them more time to think at inference, so when you, when you ask the question, we give them more time that they seem to get smarter, even if they’re not massively bigger, that they, by allowing them time to think, to think harder, they actually just start performing way better.

[00:22:45] Paul Roetzer: And so it does seem that Based on a lot of different things I’ve been seeing on Twitter, that that seems to be playing out and maybe even faster than people thought. That by giving these things more time, they’re, they’re starting to [00:23:00] perform at these PhD levels. So I’ll go through a quick series of tweets because this is, this is This started on Friday, like, so this is just three days ago.

[00:23:09] Paul Roetzer: Noam Brown, who we’ve talked about a number of times on the podcast, we did a feature on him, because he was the guy, he was at Meta, and now he’s at OpenAI, working on Reasoning. But he, was the guy who kind of solved, like, Texas, poker, Texas Hold’em poker, where we, by giving the AI time to think, it became, like, superhuman at poker.

[00:23:33] Paul Roetzer: And so he’s applied that line of thinking now to building these models. So he tweeted, and we’ll put the links to all these tweets in if people want to follow along, Lots of vague AI hype on social media these days. There are good reasons to be optimistic about further progress, but plenty of unsolved research problems remain.

[00:23:51] Paul Roetzer: We have not yet achieved superintelligence. And then he was kind of like replying to people, but he said between the O 1 announcement, O 3 announcement and various [00:24:00] podcast talks, I think we’ve said a lot when someone said, Hey, could you tell us more about this? We believe O 1 represents a new scaling paradigm, and we’re still early in scaling along that dimension.

[00:24:10] Paul Roetzer: Then also on Friday, January 17th, Altman tweeted, thank you to the external safety researchers who tested O 3 mini. We have now finalized a version and are beginning the release process, planning the ship in a couple weeks. Also, we heard the feedback, we’ll launch API and ChatGPT at the same time. Then someone asked like, what specifically about it is, you know, good.

[00:24:34] Paul Roetzer: And he just said, it’s very good. O3 is much smarter than O1. We are, we are turning our attention to that now. And O3 Pro with the mind blown emoji. And then someone said, oh, is the O3 Pro going to be 2000 a month? He said, no, you’ll get it for the same 200. Then, Noam Brown, again, this is a little bit later.

[00:24:54] Paul Roetzer: And this was actually on, sunday, the 19th, so two days later, he said, it can be hard to [00:25:00] feel the AGI, which is a term we’ve shared on the podcast before. it’s kind of like the vibes of AGI, like people in these labs are just like, do you feel the AGI? Said, it’s hard to feel the AGI until you see an AI surpass top humans in a domain you care deeply about.

[00:25:15] Paul Roetzer: Competitive coders will feel it, will feel it within a couple years. And then he’s referencing, Paul Schrader, who I’ll get to in a second. He says, Paul is early, but I think writers will feel it too. Everyone will have their Lisa Dahl moment at a different time. Lisa Dahl is a reference to, AlphaGo, the Go champion.

[00:25:33] Paul Roetzer: So I think people, a lot of people, listen to the podcast, have heard us talk about this, but watch the AlphaGo documentary. You’ll see what we’re talking about. It’s free on YouTube. Lee Sedol was defeated by the AlphaGo system built by Google DeepMind at a time when most people didn’t think an AI could defeat a Go champion.

[00:25:51] Paul Roetzer: So, this Noam tweet is in reply to someone who shared a post, I think it was a Facebook post, from Paul [00:26:00] Schrader, who’s an American screenwriter. He, wrote Taxi Driver for Scorsese and then he later co wrote Raging Bull and a bunch of other popular movies. He posted AI have come to realize AI is smarter than I am, has better ideas, has more efficient ways to execute them.

[00:26:18] Paul Roetzer: This is an existential moment akin to the Kasparov, how, what Kasparov felt in 1997 when he realized Deep Blue was going to beat him at chess. Someone then said, what brought you to this conclusion, Paul? And he replied, I asked it for Paul Schrader’s script ideas. I had better ones, it had better ones than mine.

[00:26:40] Paul Roetzer: This reinforces what we talked about on episode 130, which is like, forget about all these evals, like, these research labs talk about all these really hard evals, is it PhD level in math, and is it PhD level in biology? Who cares? Like, what matters is that Paul Schrader, a legendary screenwriter, Now believes the thing is better [00:27:00] at his job than him.

[00:27:01] Mike Kaput: You’re right. 

[00:27:01] Paul Roetzer: That’s what matters is when it starts to affect our jobs. So this then leads into the last two tweets I will mention. The first one is this Axios article where this is the tweet from one of their editors. We’ve learned OpenAI CEO Sam Altman has scheduled a closed door briefing for U. S.

[00:27:16] Paul Roetzer: government officials on January 30th. Which wasn’t news because OpenAI had put that in their economic blueprint, but anyway. with people inside and out of the government telling us, AI insiders believe a big breakthrough on PhD level super agents is coming. So that was like, what, everybody went nuts on Sunday, like on the 19th.

[00:27:36] Paul Roetzer: tweets the morning of January 20th, Twitter hype is out of control again. We are not going to deploy AGI next month, nor have we built it. We have really cool stuff for you, but please chill and cut your expectations 100x. So, my overall takeaway here, things are likely advancing far faster than people realize or are prepared for.

[00:27:59] Paul Roetzer: [00:28:00] That much I’m fairly confident in. They just probably aren’t advancing as quickly as the hype on Twitter might make you believe. When an Axios headline about superagents shows up and people go crazy and then like three hours later everyone thinks that Sam’s going to introduce superintelligence to Congress on January 30th and it’s likely not what’s going to happen but there’s a decent chance he may show like an 03 preview like 03 probe preview with their projections of what 0405 could look like like that’s a distinct possibility and that is Earth shattering.

[00:28:39] Paul Roetzer: Again, I feel like we’re becoming so numb to these advancements that it’s hard for people to process what that could mean if we truly do start having these PhD level agents on demand for 200 a month for whatever profession you want to pick. 

[00:28:55] Mike Kaput: Two of the top replies to Sam’s tweet, which went out at [00:29:00] 3. 32 a.

[00:29:01] Mike Kaput: m. Oh, is that what I knew it was this morning? Yeah, real early. the two, two of the top replies I think are hilarious, but also kind of indicative of like what moment we’re in. Someone first replied, super intelligence on Tuesday at 10 a. m. Pacific time per Axios. So these Axios headlines are getting out of control.

[00:29:19] Mike Kaput: My favorite was someone just asked, when are we getting the ChatGPT meme coin? So, you know, when are we getting their crypto project? 

[00:29:26] Paul Roetzer: Which if you followed the news at all on Saturday and Sunday, the meme coin thing, which I honestly like Mike, I was, I was going to take a minute and have you explain meme coins to me.

[00:29:36] Paul Roetzer: And then I just went to ChatGPT myself. And the whole point is like, If you didn’t follow this, I don’t want to get into this, but Trump launched a meme coin that made him like 60 billion dollars in like 5 hours or something like that. And then I think it crashed when they announced a Melania meme coin like later that day or something like that.

[00:29:57] Paul Roetzer: so it’s like this cryptocurrency [00:30:00] thing and I do, I’m not an expert on this. I’m not even going to try and explain this, but it makes as little sense as you would think basically. So if you go do the research, it’s like vaporware. There is nothing. It’s just hype and people launch these meme coins. But yes, that is funny.

[00:30:13] Paul Roetzer: An OpenAI meme coin would be, they, they could raise all the money they need for their infrastructure if they just launched a meme coin. No kidding. 

[00:30:19] Google Is Giving Away AI Capabilities to Workspace Customers (And Microsoft Is Changing Pricing)

[00:30:19] Mike Kaput: That’s All right. Our third topic this week, bringing it back down to earth a little bit. Two of the biggest players in AI have made some pretty significant changes to their pricing strategies.

[00:30:30] Mike Kaput: So both Google and Microsoft are revamping a bit how they package and charge for their AI products. So first up, Google announced it is basically giving away Gemini to business and enterprise customers. It’s adding it by default to all Google Workspace business plans. The catch is this comes with a small price increase.

[00:30:50] Mike Kaput: So previously a Workspace Business Standard Plan with the Gemini add on cost 32 per user per month. Now it will be [00:31:00] 14 per user per month. But that’s a 2 per month increase from the previous Standard Plan like without Gemini. So Microsoft However, is taking a slightly different approach. They are keeping their premium Copilot Pro license at 30 bucks a user a month.

[00:31:18] Mike Kaput: They are, however, introducing new consumption based pricing for certain AI agent features that they say, quote, can automate workplace processes, according to some reporting from the information. The information writes, quote, under the new consumption pricing, one message within 365 copilot chat costs roughly one cent, while messages that require the chatbot to create a lengthy answer using generative AI cost two cents, and messages that require the chatbot to draw on other data from other applications Cost 30 cents.

[00:31:52] Mike Kaput: So Paul, maybe first walk me through Google’s move in particular, like what are they trying to achieve with the new pricing and is it [00:32:00] going to work? 

[00:32:01] Paul Roetzer: yeah, I just had a funny thought on the Microsoft one, but we’ll come back to that. So I think the Google move is two things. one, it’s just a strategic move to undercut.

[00:32:10] Paul Roetzer: The market, you know, ChatGPT Enterprise and Team, Microsoft Copilot. We’ve said this all along, like, Google has a bunch of advantages here. One of them is their, resources, their compute power, their own data centers, their own chips. Like, they have all this stuff that they can throw at their competitors.

[00:32:28] Paul Roetzer: Now, Microsoft has similar stuff, but Microsoft doesn’t have their own models. They’re using OpenAI’s models. OpenAI doesn’t have these things. OpenAI also doesn’t have the distribution of Google Workspace, they don’t have the distribution of Gmail. So, Google’s got some, Some plays to make. And this seems like one strategic play is like, let’s just undercut the market and give this away.

[00:32:46] Paul Roetzer: The second part to Google strategy could be, and I’m just hypothesizing here. It’s impossible to know how many people pay for Google Workspace for Business. I dare you to try it. Pick, pick your favorite [00:33:00] AI tool, you can use Google Deep Research, ChatGPT, Perplexity. No one can answer for you how many people pay for Google Workspace for Business.

[00:33:08] Paul Roetzer: It’s not in their earnings transcripts, it’s nowhere. So all we have are like estimates here. Based on best estimates, There are 8 million companies that pay for Google Workspace for business, including Marketing Institute and SmarterX. We are a paying customer, have been for years. The rest of this, I’m just going to hypothesize.

[00:33:27] Paul Roetzer: Let’s say if there’s 8 million companies, and this is two weeks in a row I’ve had to do math, Mike, so this is like, this is hard work for Monday mornings. 8 million companies, and let’s just say out of those 8 million, there’s 50 million users. that are paying this 12 a month. So, we’re just gonna assume 50 million people are paying every month to use this product.

[00:33:48] Paul Roetzer: Now, if 5 percent of those 50 million users chose to upgrade to Gemini, so that’s 2. 5 million, 10 percent would be 5, yeah, that’s 2. 5 [00:34:00] million users who are paying 20 a month for Gemini. That’s about 50 million a month. Or 600 million for the year being generated by people paying 20 a month for Gemini. So let’s just assume that’s what Google’s currently making it.

[00:34:15] Paul Roetzer: I’m making up the 50 million number. I’m making that number up. if instead they say, hey, we’re going to give you Gemini for free. , but we’re gonna increase your standard plan $2 a month. Hmm. Well, if you have 50 million users who you went from 12 to $14 a month on, that’s a hundred million a month in revenue, or 1.2 billion per year.

[00:34:38] Paul Roetzer: So by giving Gemini, Gemini away, basically, but charging everyone $2 a month. Rather than them opting in for the extra 20 a month, they just made 600 million dollars. So, now again, I don’t know if the math math’s there, as my son would tell me. My math isn’t mathing. He sells me all the time. so, but if the numbers are in this rough range, You could [00:35:00] see how, one, this could undercut the market.

[00:35:02] Paul Roetzer: Two, it might actually just be a smart financial move for Google to just charge everyone 2, whether they use the tools or not. Now, on the consumption based pricing, my first thought is, if I have to re read your pricing four times to comprehend, What it is, it’s probably not going to work. It’s not following like the simplicity rule.

[00:35:24] Paul Roetzer: at a higher level though, I think the key here is we’re just going to see a ton of experimentation. Nobody knows what to charge. We talked a couple episodes how Sam kind of picked 200 a month out of the air for O1 and realized like they’re losing money on it because he just kind of guessed at what would be a profitable number and he was wrong.

[00:35:40] Paul Roetzer: So. You’re going to see a lot of experiments. I’ve mentioned this before, but like my former agency that I sold in 2021 was HubSpot’s first partner in 2007. And we went through dozens of changes to their SaaS pricing model over the years. And so I think that we’re just in this new phase where these companies that are [00:36:00] selling AI, aren’t really sure how to charge for it and how to make money on these models and on the services.

[00:36:07] Paul Roetzer: Now, one final note here I thought was just, it was so well written. I have no idea who this guy is. his name’s Timo Springer. We’ll put a link to this tweet in the show notes. He has 300 followers on Twitter, so it’s not like this is some influencer that everyone just like listens to. But I saw his tweet and I thought it was so well done.

[00:36:25] Paul Roetzer: And it’s representative of what I was explaining last week with the issues with Google Workspace. It’s representative of ChatGP team. It’s representative of all these models. So, and the reason I think we should pay attention to this is he actually got replies from the head of product for ChatGPT and the head of engineering for ChatGPT because he tagged some people and they apparently saw it.

[00:36:44] Paul Roetzer: So. Here’s the Teemo tweet. ChatGPT is a confusing mess right now. It seems like a few months ago they embraced a new product strategy, maybe when their chief product officer joined, which is good, but there’s still lots of legacy features like GPTs that feel [00:37:00] really out of place with new releases like Projects and Tasks.

[00:37:03] Paul Roetzer: What bothers me the most is that even for power users, it’s extremely difficult to know which tool currently works with which model on which platform, web, mobile, desktop. The feature matrix is incredibly complex. In the normal chat, I can connect Google Drive, but this doesn’t work as a data source for GPTs or projects.

[00:37:22] Paul Roetzer: Advanced voice mode can access custom instructions and memory, but doesn’t work with projects or GPTs. O1 can now handle file uploads too, but only images. When I upload a PDF to the chat, only the text contents are analyzed, but if I upload screenshots of the PDF pages as images, these can be analyzed.

[00:37:40] Paul Roetzer: Projects can also use GPT 4. 0 as a model, but I could list at least five more things that are similarly annoying in daily use. I’m an absolute power user, and even I sometimes struggle to keep track of everything. I wish the product team at OpenAI would focus more on removing all these complexities from the product.

[00:37:56] Paul Roetzer: And then he followed up with a comment that said, a wonderful example. ChatGPT [00:38:00] Enterprise now supports reading and understanding visuals, images, graphs, diagrams. Embedded in PDF files, users can upload a PDF and ChatGPT can interpret the text and any visual elements within that file. Cool, but, and it is not currently available for GPT based projects.

[00:38:16] Paul Roetzer: So we can do this thing, but I can’t do it in GPTs, which is what I use all the time. These things are so incredibly confusing and daily use for users. In my personal account, ChatGPT cannot analyze images and PDFs. In my business account, it works, but not when I upload the PDF as knowledge to my GPT. So as I said, this is the experience we’re all having.

[00:38:37] Paul Roetzer: Like if you feel confused, this is a great example of someone who’s in here power using all day long. And the abnormalities aren’t actually your fault. It is like a fault of the company and how fast they’re moving and they’re not solving for the end user. And as I said with Google, the issue seems to be these companies spend so much time solving for developers [00:39:00] And yet all their revenue is coming from enterprise users.

[00:39:03] Paul Roetzer: So the head of product for ChatGPT said, thank you, extremely top of mind, we will fix this. The head of engineering for ChatGPT said, yeah, we have to make it simpler and we’ll do so. So whatever pricing model you want to have, just make it so it’s actually user friendly, not what we currently have with all these platforms.

[00:39:21] Mike Kaput: And one final question I have for you around consumption based pricing, like, I’m by no means a business or enterprise finance expert, but like, how on earth do you even budget for usage based pricing? I don’t even know how the usage of a tool that we would pay 20 bucks a month for. 

[00:39:39] Paul Roetzer: No idea. And you would get so many surprise bills where people are like, I didn’t realize that.

[00:39:44] Paul Roetzer: And then you got to put all these caps in place for usage. Yeah, I just, I can’t see in an enterprise allowing the variability of pricing when the CFO is like, don’t even understand how the product’s going to be used. It’s, it’s not going to work. Like it’s a great idea, but like, good luck. [00:40:00] 

[00:40:01] Mike Kaput: Let’s jump into this week’s rapid fire.

[00:40:03] Google Releases New Research on the Potential Successor to Transformers

[00:40:03] Mike Kaput: We’ve got a few big things going on. So. First up, researchers at Google, MIT, and some other institutions have unveiled an AI system called Titans that fundamentally reimagines how AI can learn and remember information. This system represents one of the first major attempts to give AI the kind of nuanced memory capabilities that we as humans kind of take for granted.

[00:40:27] Mike Kaput: The key innovation is what the researchers call, quote, neural long term memory. This is an AI component that can actively learn and adapt while it’s being used. Not just during initial training. So much like how humans form memories based on surprising or unexpected experiences, the system pays special attention to information that violates its expectations, storing those memories for future use.

[00:40:54] Mike Kaput: Titan is particularly notable in how it combines three different types of memory, short term memory for [00:41:00] immediate tasks, long term memory that continues learning from new experiences. And what they call, quote, persistent memory, which maintains core knowledge about tasks. So this kind of mimics how human memory as we understand it works.

[00:41:13] Mike Kaput: We have different systems for different types of information. So Paul, I guess like my big question here, just kind of as on a surface read of this study, like how big a deal is this? Because I’ve seen some people call this basically the successor to Transformers, which was one of the most important developments in modern AI.

[00:41:34] Paul Roetzer: Quick background, if Transformers is new to people, 2017, the Google Brain team released a paper called Attention is All You Need, in which they invented the Transformer. It was building on prior research, but they were kind of credited with the creation of the Transformer. That is the T in GPT, Generative Pre trained Transformer.

[00:41:51] Paul Roetzer: And Transformers, for the last What are we on now? Eight years, roughly, almost, have, have really continued to be [00:42:00] the basis for the acceleration of these models. That’s what language models are built on. It’s what enables everything that we’ve kind of seen to date. if you listen to Yann other leaders in the AI space, there does seem to be a uniform belief that a number of breakthroughs are needed to get to the next level of intelligence.

[00:42:21] Paul Roetzer: And so at any time, a research paper may emerge that is one of those breakthroughs. Titans might be one of those breakthroughs. You don’t often know right away, even when the attention is all you need transformer paper came out in 2017. Google admittedly didn’t realize the significance of their own invention until later the next year and started to actually try and productize it.

[00:42:45] Paul Roetzer: By that point, OpenAI was, you know, now starting to work towards building GPT 1. So some believe that OpenAI actually figured out the significance of the Transformer paper before Google did. and so we don’t know. We, you know, this might be one of those ones we look [00:43:00] back in two years and be like, Oh, on episode 131, we talked about that Titans paper and look at that.

[00:43:04] Paul Roetzer: They just invented a whole new kind of model based on it. But this is why we pay attention to the research papers and, and you, like Mike and I spent a lot of time kind of monitoring the influencers in the space and seeing which papers they’re talking about, which ones are getting a lot of attention and citations, because that often is a kind of a hint at what might be something of significance down the road.

[00:43:23] Paul Roetzer: So, Definitely worth keeping an eye on and it came out of the Google research team. My guess is, they’re not going to make the same mistake twice with releasing breakthroughs in AI models. So if this came out December 31st, 2024, it’s probably something that they internalized long before that and have already figured out how to apply it.

[00:43:43] Paul Roetzer: Maybe already building it into models. back in 2017, there was a much more open research model within the AI community where you published your breakthroughs. That stopped after ChatGPT. It basically slowed, not completely to a halt, but, [00:44:00] the amount of papers being published where they were putting out the new stuff was pulled back, dramatically to, in favor of product development after ChatGPT.

[00:44:10] Google Releases Factuality Benchmark for LLMs

[00:44:10] Mike Kaput: Our next topic, it also involves some work from Google. So, Google DeepMind just unveiled a new tool for measuring one of AI’s biggest weaknesses, which is its tendency to make things up. This is called FACTS. This is an acronym, F A C T. S grounding. This new benchmark, it’s a new benchmark that sets out to do something that has been surprisingly difficult until now, which is determining just how well an AI system sticks to the truth when it’s answering your questions.

[00:44:44] Mike Kaput: At the heart of this system that Google has built is a collection of over 1, 700 carefully designed examples that challenge AI models to do something that we might find deceptively simple. Read a document and answer questions using only the [00:45:00] information provided. Now, what makes this particularly clever is how it works.

[00:45:05] Mike Kaput: Each response is evaluated not just by one, but three of the most advanced AI models out there today. Gemini 1. 5 Pro, GPT 40, and Claude 3. 5 Sonic. So, all the work from this project has been put into a public leaderboard that Google has launched to track how different AI models perform on these tests. So right now, Google’s experimental Gemini 2.

[00:45:32] Mike Kaput: 0 model ranks number one with 83. 6 percent grounding. Google models also occupy spots number two and three. And are followed pretty closely by Claude 3. 5 Sonnet and GPT 4. 0. So Paul, this seems pretty notable. It sounds like we now at least have some visibility based on Google’s methodology and tests into which models are the most accurate at retrieving [00:46:00] information, that is actually in a document or source that you’re referencing.

[00:46:05] Mike Kaput: Does this mean we’re getting closer to solving hallucination? 

[00:46:10] Paul Roetzer: It could. I mean, I think anyone who uses Notebook. LM or Google Deep Research, you can experience probably this at work where it cites right within the source doc. So, I do think that at some point we largely solve hallucination. The question becomes how As always, I guess in society we have this issue, it’s like, what is the source of truth?

[00:46:32] Paul Roetzer: Like, what is truth, unfortunately can’t always be agreed upon, and so a hallucination to one person might be fact to another person, so assuming we can get around that and we actually agree on sources of truth, if it is like documents provided, Fine, like that’s an easy source of truth. If I’m giving you the 50 documents and saying I just want facts based on these documents, I want an accurate relation to those.

[00:46:55] Paul Roetzer: And my money would be on Google 10 times out of 10 being the one that leads in this, given [00:47:00] their history and their business model, in search and retrieval. So, I would be, guessing that we will continue to see progress being made here. I’ve heard Demis Hassabis talk about this exact problem as a Sundar Pichai.

[00:47:15] Paul Roetzer: So I think that Google team is very focused on solving this. And I do think in, you know, one to two years, we may not have complete elimination of hallucination or inaccuracies, but humans, Certainly have plenty of hallucinations and inaccuracies. I would imagine we will be at superhuman levels of accuracy from these models within the next one to two years.

[00:47:35] Paul Roetzer: I don’t, I don’t think there’s any scientific, obstacles to that being done. It’s just kind of a brute force thing they got to keep working through and finding ways to solve it. But seems like they’re on the right path. 

[00:47:48] Apple Intelligence Falls Flat

[00:47:48] Mike Kaput: Our next topic concerns another major player in AI, but it is not exactly positive news.

[00:47:54] Mike Kaput: So, Apple is temporarily pausing a new AI powered Notification [00:48:00] Summary feature for news and entertainment. They’re pausing this after the feature, which is powered by Apple Intelligence, inaccurately summarized content from news outlets. The most notable incident sparked some criticism from the BDC, which saw Apple incorrectly summarize its coverage of the UnitedHealthcare shooter.

[00:48:20] Mike Kaput: While Apple makes it clear that the summaries are in beta and quote, may contain errors, this move also seems to acknowledge that the tech just needs some more work. Paul, I’m just going to let you take this and run with it because you are a huge Apple fan. And this is. Just not what people expect from this company, I don’t know.

[00:48:42] Paul Roetzer: Yeah, I don’t get it. I got it, I’ve, so I’ve had Apple Intelligence now for whatever, two months. I , the only time I ever use it is I guess Surrey, it, you know, sometimes gives different responses or at least connects to ChatGPT now if it doesn’t know the answer. But I mess around [00:49:00] with like, I don’t even know what they’re called, genmojis, which I think is different than image playground.

[00:49:04] Paul Roetzer: There’s like these two things that are native in there now and I’m not really ever sure which one I’m using. But in text messages to my son, like I’ll create. I guess they’re Genmojis of him, like, in different outfits and stuff like that. That’s it. That is literally it. Like, it’s the only function of Apple Intelligence I use.

[00:49:22] Paul Roetzer: And so, with the amount of, like, AdBunny and hype, like, it is, like, an embarrassing product launch. And on top of, like, the Apple Vision Pro, which is insane technology that has zero support since the product came out. It’s literally sitting next to me collecting data. Dust at the moment, it’s like two major failed product launches in a row.

[00:49:42] Paul Roetzer: Hasn’t really affected their stock price. Like I, people are still bullish on Apple. I’m still bullish on Apple, but it’s highly out of character. just for fun, I put a poll on LinkedIn. I put it on Twitter too, but I don’t get a ton of engagement on Twitter. So we’ll go to LinkedIn. I said, what is the most disappointing AI product so [00:50:00] far?

[00:50:00] Paul Roetzer: Hype versus reality. Wish I wasn’t limited to four choices. , right? Ands, welcome in the comments. So this had 599 votes. It’s still’s actually still open for a couple hours. 46% is the leader at Apple Intelligence, Microsoft 365 copilot 36% a agent force from Salesforce, 9% and then Google Gemini for workspace 8%.

[00:50:20] Paul Roetzer: Now obviously this is not a scientific study, this is kind of more based on. Overall vibes, I would guess, and kind of talk, because there’s a chance some of you, like, don’t use these products. So, it’s hard for you to say Copilot is worse than Apple Intelligence if you’ve never used Copilot. So, it was more of just kind of a fun, put it out there, and just get some general responses to it.

[00:50:40] Paul Roetzer: But, yeah, Apple Intelligence, it’s just, you know, I mean, the more time I spend with it, the more disbelief I am that this is the product they put out. And they’re historically, like, they play catch up a lot, like fast followers, and they may end up building this amazing experience into the phone sometime in 2000, you know, 26, [00:51:00] 27, I don’t know, but right now it is a pretty embarrassing offering from Apple.

[00:51:07] Mike Kaput: Yeah. And right now it’s embarrassing, but I feel like it becomes really dangerous to them once someone actually reinvents an AI first device, right? Because like, for instance, I was listening to an end of year episode on the Tim Ferris podcast friend, investor Kevin Rose on, and they were just speculating at one point.

[00:51:26] Mike Kaput: There are a lot of people they’ve talked to in Silicon Valley where it’s like, why can’t I just have a phone with like one button where it’s that, that’s just really smart AI that loads everything that I need. Like I don’t need all these apps. 

[00:51:38] Paul Roetzer: I don’t need like a rabbit, 

[00:51:39] Mike Kaput: yeah, something that works actually, that, it’s just one of those things where it’s like we haven’t yet reinvented.

[00:51:46] Mike Kaput: A mobile device that’s really AI first yet, so it’ll 

[00:51:49] Paul Roetzer: be interesting to see how that plays out. Google has definitely swung the door open on this one. And again, like, I mean, but so much, or, I’m sorry, not Google, Apple, has, you know, but Apple’s devices are [00:52:00] so much more than that, but like, I use the advanced voice and ChatGPT.

[00:52:04] Paul Roetzer: 10 times out of 10 over Surrey. Like sometimes it’s faster because I could say, Hey, Surrey on my phone. And it like opens it. And I t’s like, this is a basic thing. Surrey should be able to handle this. Like I don’t need to go into my ChatGPT app, but if it’s anything of actual value or that requires any actual reasoning or thought process, I’m going into ChatGPT every time I’m going to talk to Surrey.

[00:52:23] Paul Roetzer: So, and my kids is like a generation of kids who just thinks Siri’s stupid. Like, they never ask Siri anything. It’s like, other than turn the music off or something like that. so yeah, I don’t know. It’d be interesting to see what happens. They definitely have just Faltered multiple times here. Just totally fumbled the Apple intelligence thing.

[00:52:45] Paul Roetzer: And I don’t know, maybe, maybe this spring they’ll come out with something significant, but don’t have great optimism at the moment based on what they’ve delivered so far. 

[00:52:56] TikTok Shutdown Drama

[00:52:56] Mike Kaput: Our next topic, let’s talk quickly about TikTok. TikTok [00:53:00] has had a crazy couple of days. So we wanted to quickly run down what’s going on with TikTok.

[00:53:07] Paul Roetzer: Which will have changed five times probably by the time you actually hear this. Yeah, more than 

[00:53:13] Mike Kaput: most AI, straightforward AI news. This could change faster than anything else, for sure. Because, you know, like TikTok does, is prominent to many in our audience. There’s also an AI angle to all this drama. So we just kind of quickly wanted to go through what’s going on here.

[00:53:31] Mike Kaput: TikTok went dark late Saturday night as a congressionally mandated ban took effect. It resumed service Sunday afternoon with a message crediting president elect as Trump for its return. Trump speaking at a quote, victory rally as part of his inauguration events in DC declared that quote, TikTok is back.

[00:53:52] Mike Kaput: He outlined a vision for keeping the platform operational, suggesting a joint venture that would give the U. S. 50 percent ownerships. [00:54:00] So here’s kind of how this really quickly all went down. At some point around 11pm on Saturday, January 18th, TikTok shut down in the U. S. before the ban took effect at 12am on January 19th.

[00:54:12] Mike Kaput: At 7. 03am the morning of January 19th, Trump posted SAVE TIKTOK, in all caps, on TruthSocial. Hours later, he announced he would sign an executive order on Monday, which is today, the day we’re recording this podcast, that delays the TikTok ban. He also called for the platform to be taken over by a joint venture with U.

[00:54:31] Mike Kaput: S. and current owners. At 12. 30pm on Saturday, TikTok posted on X that it was in the process of restoring service. They publicly thanked Trump. At 1. 50pm, TikTok was reportedly back online for many U. S. users. They again pointed directly to Trump as the reason TikTok was saved. Late Saturday afternoon, a Trump advisor told CNN that the administration is still finalizing the executive order to delay the ban and give the platform more time to reach a deal [00:55:00] to stay in the U.

[00:55:01] Mike Kaput: S. Literally an hour later, Trump said, quote, TikTok is back during the rally. And now here’s the AI component of all this. At some point on Saturday, CNBC reported that perplexity of all companies, quote, officially made a play for TikTok, submitting a bid to its parent company ByteDance. To create a new merged entity combining Perplexity, TikTok US, and new capital partners.

[00:55:25] Mike Kaput: So Paul, like, talk to me about Perplexity here. Like, what are their motivations? 

[00:55:30] Paul Roetzer: Alright, so real quick on the ban, I don’t want to spend a lot of time on this, but so Trump and the Republican Party have been pushing for the ban for years. this isn’t like this is some Republican thing, like once they got in the office, we were going to bring TikTok back.

[00:55:45] Paul Roetzer: It is, it’s actually, They’ve supported the ban for national security reasons, because ByteDance is a Chinese owned company, and the assumption is the data goes back to the Chinese government if they want it. So, the Supreme Court upheld that this is not a violation of the First Court, First [00:56:00] Amendment, that, that the ban should, Retent, remain.

[00:56:03] Paul Roetzer: So this is like a, it’s a legal thing and Congress and the Senate both supported the ban, but it being brought back is like a popular thing to do. So it may come back. Okay. So now personally, I actually stopped using TikTok. Like I found, I was, I was a very late adopter of TikTok and it does just like suck you in.

[00:56:21] Paul Roetzer: Like their algorithm is insane. And so I took it off my phone like a week or two ago. Cause I was like, it’s just wasting my life. Now, most of the stuff I find, there’s actually things like. Basketball plays to run for my daughter’s team, sports things I’m interested in. It’s like, it’s actually really good, valuable stuff for me because the AI is so good.

[00:56:40] Paul Roetzer: I’ll spend like 40 minutes. I’m like, Oh my God, I just like probably went through a hundred videos on TikTok of like useless stuff. so I actually took it off because I found it was like sucking time out of my life. that I wanted back, the perplexity thing, I don’t, I think perplexity like jumped the shark.

[00:56:56] Paul Roetzer: Like, I mentioned this a couple episodes ago that I thought perplexity was [00:57:00] eventually just gonna get acquired or like acqui hired or whatever. I don’t get this company. Like, this is a pure PR move. Obviously, you’re not going to merge with TikTok. Why in the world would you put this out there other than because they thought it was funny?

[00:57:13] Paul Roetzer: I don’t know. Like, it’s, it’s just absurd. So, I think I’m going to cancel my Perplexity subscription, honestly. Not because of this, it was just like, this was like a tipping point where like, I already thought that they were kind of questionable and I thought, based on the interviews I’ve listened to with the founder, like it wasn’t a very serious company.

[00:57:30] Paul Roetzer: And then I thought, with all these new things they’re throwing, they’re just like throwing spaghetti at a wall with like, What’s going to stick and differentiate us. And I feel like they’ve just like lost the, the magic of like what differentiated them early on. Right. And I realized over the weekend, I’m still paying 20 bucks a month for a product I haven’t used in over 30 days.

[00:57:47] Paul Roetzer: because I just used deep research and ChatGPT and the other stuff anyway. So again, I. Perplexity, man, of being an amazing company. Like, I’m not saying there isn’t a chance, like it works. What the [00:58:00] hell? Like, what, what is this? How do you have time to make some joke thing like this, like a legitimate business?

[00:58:07] Paul Roetzer: Deal, try and make it look like a legitimate business deal. I don’t know. It’s just absurd. 

[00:58:11] Mike Kaput: So it seems increasingly desperate. These, yeah, it’s just like 

[00:58:16] Paul Roetzer: hoping for headlines, like trying to get some PR, trying to be relevant in the conversation. It’s like, I don’t know, just stop, just fix your UI, make it look like it’s not from 2020 and try and figure out how to differentiate yourself from.

[00:58:31] Paul Roetzer: Deep research and all the products that caught up and surpassed you. I don’t think there’s CEOs coming on our podcast anytime soon for an interview. Interview. 

[00:58:42] US Patent and Trademark Office Releases Its AI Strategy

[00:58:42] Mike Kaput: Yeah, we’ll see. I mean, certainly welcome to, but in our next topic here, we have seen the U. S. Patent and USPTO, release a comprehensive AI strategy. And at its [00:59:00] core, this strategy focuses on five key areas, advancing IP policies that promote innovation, building robust AI capabilities within the USPTO, ensuring responsible AI use, developing internal AI expertise, and fostering collaboration with USPTO partners.

[00:59:18] Mike Kaput: Interestingly, they’re taking a notably human centric approach. They said that while AI will transform their operations, they’re It has to complement rather than replace human expertise. Their implementation plan includes extensive training for patent examiners and trademark attorneys to help them better evaluate AI related applications.

[00:59:38] Mike Kaput: They also talked about their position on AI and copyright law. They acknowledged the complex challenges around AI generated content and training data. And they commit to working closely with the U. S. Copyright Office on policy recommendations. They are actively monitoring relevant court cases and aim to shape, help shape legislation that addresses [01:00:00] IP issues.

[01:00:01] Mike Kaput: So, Paul, it’s good to see this really important body getting a strategy in place here. Like, what are your thoughts on the copyright point here? Like, are we going to get any updated guidance on this stuff anytime soon? There are a lot of unanswered questions people have. 

[01:00:18] Paul Roetzer: Yeah. So, I mean, unless I missed something and I just kind of scan this report, it doesn’t say anything about copyright.

[01:00:24] Paul Roetzer: Like, I mean, it doesn’t make any changes. It basically says we’re watching legal cases, just like you are. we’re advising Congress when they ask us, we’re doing listening sessions, like nothing changed. And so I actually didn’t know exactly how the USPTO works, I just did a quick search. So it looks like in October 2021, President Biden nominated, Cathy Vidal to serve as USPTO director.

[01:00:49] Paul Roetzer: She was sworn in April 13th, 2022. So like most government offices, I don’t expect Biden appointees to remain in those positions. [01:01:00] I would assume there’s going to be a pretty swift transition of those leaders. Elon Musk is advising Trump, as are all these other VCs who could care less about the copyright, holders that their data, their models are training on.

[01:01:15] Paul Roetzer: I would assume that if this is a government agency that has someone appointed by the president, that we may get a, person who. is more favorable toward the VC world and their views on copyright and we may see some changes. I mean, Sam, that was in their economic blueprint, right? They talked about copyright and they don’t want it to slow down American innovation.

[01:01:39] Paul Roetzer: I wouldn’t be surprised if in the next four years we don’t see some changes to the way this works. And I don’t think people who are copyright traditionalists will be happy with those changes. It’s kind of my personal opinion. High level assumptions at the moment. 

[01:01:54] Meta AI Copyright Lawsuit

[01:01:54] Mike Kaput: In another copyright related development, we got some [01:02:00] newly unsealed court documents that paint Meta in a pretty poor light due to actions it took while racing to compete with OpenAI.

[01:02:09] Mike Kaput: According to documents from a California court, Meta executives discussed and ultimately approved using A site called LibreGenesis, or LibGen for short, which is a book piracy site, to train the company’s Llama3 model. This decision was reportedly escalated all the way to CEO Mark Zuckerberg. In an October 2023 email, Meta’s VP of Generative AI, Ahmed Aldal, Emphasized that the company needed to quote, learn how to build frontier and win this race against OpenAI’s GPT 4.

[01:02:42] Mike Kaput: Meta’s director of product then argued that using LibGen was quote, essential for achieving state of the art performance. Claiming through quote, word of mouth, that competitors OpenAI and Mistral were also using the library. These documents reveal Meta’s attempts to conceal their usage, including plans to remove [01:03:00] copyright headers, document identifiers, and metadata, quote, to avoid potential legal complications.

[01:03:06] Mike Kaput: The company also established, quote, mitigations, including removing clearly marked pirated content and avoiding public mentions of using LibGen data. Paul, I cannot say, unfortunately, this is surprising, given that we know many, or if not all, the major model companies have behaved in this way with one site or another that has copyrighted content.

[01:03:29] Mike Kaput: I guess what I’m curious about is this, like nothing serious seems to have happened yet to these firms. obviously you’re facing a ton of costly lawsuits, but, you know, They’re all doing this. Like, are they going to get away with this? 

[01:03:40] Paul Roetzer: Yes. Okay. I think so. I think they’re just going to keep spending the millions or hundreds of millions they need to to keep these legal cases going until the law changes.

[01:03:49] Paul Roetzer: Like, so the way I think about this is, we know they did it. They know we know we did it. They know we know they did it. But they don’t want [01:04:00] to admit it for legal reasons until those legal reasons are gone. So we’re just going to keep having court cases. We’re going to keep pushing this forward. They’re going to keep spending their money and keeping their lawyers busy.

[01:04:10] Paul Roetzer: And they’re never going to really admit that that’s how it’s done until it’s safe to admit that that’s what they did. It’s not a secret, like, they, they did it, like, I t’s, it’s the craziest thing. 

[01:04:21] Mike Kaput: And with all this emphasis on American competitiveness and AI t seems like an utter fantasy that any consequence of, like, shutting down a model or anything like that would happen.

[01:04:32] Paul Roetzer: No way. 

[01:04:33] Paul Roetzer: And it’s all out in the open anyway because people have, they’ve built the open source models trained on these things like Llama and you can’t, yeah, can’t put it back in the bag. And like I’ve said, I said early on, like maybe at some point it’s deemed that they, they broke the law at that point and they pay some big fines and they move on with their lives.

[01:04:50] Paul Roetzer: But I don’t think, especially as you’re saying with the incoming administration and the focus on accelerating innovation, they’re not slowing down for this stuff. [01:05:00] Right or wrong. They’re not, they’re not going to. 

[01:05:04] Benchmarking the Energy Costs of Large Language Models

[01:05:04] Mike Kaput: In our next topic, a new study came out from MIT that shows just how much energy large language models consume, and these numbers are pretty eye opening.

[01:05:14] Mike Kaput: The research team used Meta’s Llama model to conduct detailed experiments and better understand how LLMs consume energy. They found that running the largest version of Llama requires between 300 watts to 1 kilowatt of power. That’s equivalent to running 10 to 30 bright LED light bulbs continuously just to power a single AI model’s operations.

[01:05:38] Mike Kaput: They also found some surprising patterns in how energy gets used. When they spread the AI model across more chips, which you might think would make things more efficient, it actually increased the energy costs substantially. Energy usage jumped significantly moving from 8 GPUs to 32 GPUs, even when processing the exact same [01:06:00] amount of work.

[01:06:01] Mike Kaput: They also discovered different types of tasks consume varying amounts of energy. When testing the model on standard language tasks versus math problems, they found notable differences in energy consumption. Basically suggest that the type of work we ask AI to do has a direct impact on energy footprint.

[01:06:20] Mike Kaput: They also revealed we may be using more computational resources than necessary. They found that even when running these massive models, only about 20 to 25 percent of the available GPU memory was being utilized. So, seems like there are some opportunities for optimization. Paul, this is an interesting angle to LLMs that we have not historically discussed this much.

[01:06:43] Mike Kaput: Like, these models eat up a ton of energy. We’re increasingly going to be using more advanced models more often as adoption rises. What are the implications of all this? 

[01:06:54] Paul Roetzer: Yeah. So again, I mean, you got to put everything in the context in America, at least of the incoming [01:07:00] administration. there’s going to be less focus on, the environment in terms of like impact on the environment than previous administration.

[01:07:07] Paul Roetzer: So I don’t see this being a massive political issue in the next four years in relation to the environment. there’s going to obviously be people who continue to push that, but I don’t think they’re going to find friendly, Ears at the White House that care as much, so I think what’s going to happen is it’s going to be on the AI companies themselves.

[01:07:28] Paul Roetzer: They’re going to push for the efficiency in those algorithms like you talked about, where they can build intelligence more efficiently by, you know, being smarter with how they, devise everything, and that can drive cost savings, which has the positive impact, because there are still a lot of people within those companies that care about the impact on the environment, even if, you know, it’s not a governmentally supported thing, per se.

[01:07:49] Paul Roetzer: So, you’re still going to have people trying to do good, like they, they want to build the intelligence, but they don’t want to have a negative impact on the environment, and they want to save money. And so, I think [01:08:00] you’re going to see a lot of innovation in this space and drive for efficiency in, in the use of GPUs and the building of the models.

[01:08:07] Paul Roetzer: but yeah, I mean, it’s a, it’s an issue that’s been a hot button issue. And I think it’s just a hard one for people to understand. Like it’s hard to come up with an analogy that helps you actually. Conceptualize the impact it could have. So like trying to draw the analogy to like the number of led lights, burning, things like that, that’s trying to make this like matter to people to the point where it’s like, Oh, that’s a big deal.

[01:08:29] Paul Roetzer: Other than that, I think it just all sounds very like scientific and abstract to people and it’s like, I don’t know, like I can’t, I can’t see that impact every day, so it’s hard for me to care that much. I’m not saying that’s how I feel, I’m saying that’s how the average person might feel. 

[01:08:45] Mike Kaput: Wow, get ready for a lot more power generation, right?

[01:08:48] Mike Kaput: This is related to all the infrastructure. I think 

[01:08:50] Paul Roetzer: that’s the key is it’s just like, well, then let’s build more. Like that’s the mentality right now. It’s like, oh, if it needs that much energy, let’s just build more in the grid. 

[01:09:00] NotebookLM Has to Do “Friendliness” Tuning on Its AI Podcast Hosts

[01:09:00] Mike Kaput: Here’s a little lighthearted AI news this week. So Google posted from its Notebook LM account on X.

[01:09:07] Mike Kaput: That the AI hosts in NotebookLM actually developed attitudes. So, NotebookLM can create audio overviews, we’ve talked about these. You basically, all the docs, links, papers that you upload to a notebook. It can create basically a mini podcast hosted by two hyper realistic AI hosts. If you have not tried this out, it’s really cool.

[01:09:27] Mike Kaput: Go do so. However, Google recently added a feature where you can like quote unquote call in to ask questions and interrupt the hosts while they talk. When they added this feature, the following happened according to their post. Quote, after we launched interactive audio overviews, which let you call in and ask the AI hosts a live question, We had to do some friendliness tuning, because the hosts seemed annoyed at being interrupted.

[01:09:54] Mike Kaput: File this away under things I never thought would be my job, but are. Paul, this was really [01:10:00] funny to me, but it also kinda highlighted a bigger point you and I discussed a bunch of times, like AI is not traditional software. 

[01:10:08] Paul Roetzer: Yeah, we don’t, we don’t know why it does what it does. We’ve said this many times.

[01:10:11] Paul Roetzer: Like it just does weird things and then they got to go in and figure out why it’s doing the weird thing. This is a funny one. but there’s very serious instances of this too, where these models start doing things that may be determined to be misaligned with its goals or it’s the values that humans wanted to have, which leads to, Unintended outcomes.

[01:10:31] Paul Roetzer: And so it is, it is humorous, but it is also representative of a much larger problem that we deal with with these models. 

[01:10:38] Mike Kaput: Yeah. Wait until your AI system with consumption based pricing decides to go read like half the internet or something like that, because that’s when your CEO is calling you. 

[01:10:48] AI Funding and Product Updates to Watch

[01:10:48] Mike Kaput: All right.

[01:10:50] Mike Kaput: So to wrap up this week, we have a bunch of really quick funding and product updates. So Paul, I’m just going to run through these and then wrap us up here. Sounds good. All right. So [01:11:00] first up, Synthesia, which is a leading AI video generation platform has announced a major 180 million Series D funding round.

[01:11:07] Mike Kaput: So they claim they’re evolving beyond their initial AI avatar technology. To offer a comprehensive suite of video creation tools that include dubbing, screen recording, translation, and collaboration features. The platform currently supports over 230 avatars in 140 plus languages and serves more than a million users.

[01:11:29] Mike Kaput: Next, AnySphere, which is the company behind the viral hit AI coding tool, Cursor, has secured a 105 million funding round that increases its valuation to 2. 5 billion, which is a six fold increase in valuation from just eight months ago. Cursor uses proprietary OpenAI and Anthropic to help programmers code more efficiently through auto completion.

[01:11:57] Mike Kaput: They have also begun rolling out some agentic [01:12:00] features that can independently complete certain coding tasks. Next, Andreessen Horowitz has announced leading a Series A investment in Slingshot AI, which is a startup developing what it calls the world’s first foundation model specifically designed for psychology and mental health support.

[01:12:19] Mike Kaput: This brings the total capital raised by the company for that mission to 40 million. They’re aiming to differentiate from general purpose AI chatbots by focusing specifically on therapeutic approaches. Next up, ChatGPT tasks have come out. OpenAI has rolled out this new feature called Tasks, where users can ask ChatGPT to do things like give me a news briefing every day at 7am, or remind me when my passport expires in six months.

[01:12:49] Mike Kaput: The AI will then follow through on these requests automatically, even when you’re not actively using the app. And start sending you notifications when it has completed a task. This is currently [01:13:00] in beta and available only to paying subscribers. ChatGPT is also getting an upgrade to custom instructions.

[01:13:07] Mike Kaput: This is a feature that allows you to customize your ChatGPT experience. The new system focuses on three key areas. Personality ChatGPT to exhibit. Preferred communication styles and specific rules they want the AI to follow. So think of this as like fine tuning your own personal AI assistant to match your working style and preferences.

[01:13:33] Mike Kaput: Deep seek a Chinese AI lab that made waves earlier this month with its open source, deep seat, V three model. Just released something called DeepSeq R1. This is an open source model that they claim matches OpenAI’s O1 in performance. It is a reasoning model, just like O1, but unlike O1, this model’s license allows for unrestricted commercial use and modification.

[01:13:59] Mike Kaput: Basically [01:14:00] meaning if the company’s claims are true, there’s now an open source equivalent to the advanced reasoning models coming out of some of the other labs. The company is also releasing a series of smaller distilled models, and very notably, the model is priced dramatically cheaper than O1. The main DeepSeq model, the R1 model, has a 0.

[01:14:21] Mike Kaput: 14 per million token input price, which is a fraction of the cost of the same million tokens from O1. Microsoft has announced Microsoft 365 Copilot Chat, a new pay as you go service that makes its AI capabilities more accessible to organizations of all sizes. This new offering has three key components.

[01:14:44] Mike Kaput: There’s one, a free chat experience powered by GPT 4. 0 with web based knowledge. Two, is pay as you go AI agents that can be created and used directly within chat. And three, enterprise IT controls for data protection and agent management. [01:15:00] Next up, Adobe has announced Firefly Bulk Create. This is a new tool that can edit up to 10, 000 images simultaneously with a single click.

[01:15:11] Mike Kaput: So this is launching in beta and the tool has basically two main features. There’s remove background and resize. So you can upload images from your computer, Dropbox, or Adobe Experience Manager. And AI can automatically remove backgrounds from entire batches of images all at once. These new features will operate on a consumption based pricing model.

[01:15:35] Mike Kaput: This will likely require users to purchase premium Adobe Firefly credits. All right. Two more updates here this week. AI company Luma has announced Ray 2, which is an advanced video model. The Ray 2 can generate videos with realistic coherent motion, handle complex physics and simulations. And creates cinematic scenes with sophisticated camera movement.[01:16:00] 

[01:16:00] Mike Kaput: They are making Ray 2 available through their platforms for paid subscribers with API access coming later. And last, but certainly not least, Runway has released Frames, its most advanced base model for image generation, which the company says offers, quote, unprecedented stylistic control and visual fidelity.

[01:16:20] Mike Kaput: We actually covered their announcement of Frames on episode 125. Now, the company says the model is available for unlimited and enterprise plan users. So they say with frames, you can begin to define worlds that basically represent your own artistic points of view, styles, composition, subject matter, and more.

[01:16:41] Mike Kaput: Anything you can imagine you can bring to life with frames. All right, Paul. So that is it this week. Jam packed. I’m sure we are in for another crazy week as well. Just a couple final notes here. If you have not checked out the Marketing AI Institute newsletter, check that out at marketingainstitute. com forward slash [01:17:00] newsletter.

[01:17:00] Mike Kaput: It contains all the news we covered today and stuff that didn’t make it into the episode, which increasingly is a very long list, given how much is going on. And if you have not left us a review and can do so through your podcast platform of choice, we would really appreciate your feedback. All right, Paul, that’s it for this week.

[01:17:20] Paul Roetzer: So while we’re doing this, just, just to, if people had any doubts about like how this is going to play out. So the, Trump was just, signed in and right behind the vice president was, Zuckerberg. Sundar Pichai, Mark Zuckerberg, Jeff Bezos, Elon Musk, all sitting together in front of the cabinet. So, like, right behind the vice president, you have your row of billionaires, and then you have the cabinet.

[01:17:46] Paul Roetzer: And, Tim Cook is also there, as is the CEO of TikTok. And Sam Altman’s somewhere there, but sitting together was Pichai, Musk, Zuckerberg, Bezos, right behind J. D. Vance. So It is, [01:18:00] we are entering a very different phase in American business and innovation. and the heads of the AI companies are, are, in the first row.

[01:18:10] Paul Roetzer: So buckle up. 

[01:18:12] Paul Roetzer: It’ll be fascinating. Yeah. We won’t be lacking information to discuss each week on the podcast. All right, everyone. Thanks. And again, reminder, AI Mastery membership, the quarterly trends briefing this Friday. If you want to join us, it is open to everyone to join us and we’re going to be sharing our vision for our AI Academy and the AI Literacy Initiative.

[01:18:33] Paul Roetzer: So we’d love to have you there. Thanks again. And, yeah, have a great week. If you’re in the, if you’re in the Midwest, by the way, stay warm. It’s supposed to be like one degree in Cleveland the next two days. So, stay warm, stay safe, and we’ll talk to you next week. Thank you. Thanks for listening to The AI Show.

[01:18:51] Paul Roetzer: Visit MarketingAIInstitute. com to continue your AI learning journey and join more than 60, 000 professionals and business leaders [01:19:00] who have subscribed to the weekly newsletter, downloaded the AI blueprints, attended virtual and in person events, taken our online AI courses, and engaged in the Slack community.

[01:19:11] Paul Roetzer: Until next time, stay curious and explore AI.



Understanding the Differences for Businesses


A decade ago, Large Language Models (LLMs) were limited to understanding text classification, keyword extraction, & basic NLP tasks. Now, they’ve become an essential part of your everyday workflow. An example is Apple using ChatGPT to implement their Apple Intelligence. 

Every business doesn’t want to just save time, they want to direct their efforts towards innovation. The demand for efficiency and multitasking has driven the rapid advancement of generative AI models like ChatGPT.  

With several versions now available, including the recent ChatGPT 4, it’s crucial to understand how each model differs and which one might suit your needs best.  

In this article, we’ll break down the key differences between ChatGPT 3.5 vs 4 to help you decide.

What is ChatGPT?

When ChatGPT launched, everyone wanted to try it! Was this the future? Back then, it felt more like a novelty, fueling the rise of LinkedIn influencers selling ‘must-have’ prompt courses. 

Now, ChatGPT can perform a considerable amount of tasks, save time, and make our workflow convenient–right from simple queries to complex tasks such as mimicking human behavior. 

Here’s how this happened:

  1. Model Architecture: Early versions of the LLM used smaller Transformer models, limited in depth. GPT-3 scaled to 175 billion parameters, enhancing response quality.

    ChatGPT 3.5 introduced Reinforcement Learning from Human Feedback (RLHF) — this meant that it was learning from your prompts, hence making prompt engineering a sought after skill.

    By GPT-4, multi-modal capabilities and advanced problem-solving made it more adaptable and intelligent.

  2. Training Data: Initial models used broad text corpora. GPT-3 used diverse datasets, improving versatility.

    GPT-4 fine-tuned data for specialized tasks, excelling in areas like coding, legal analysis, and reasoning.

    By now, it had enough data and training to be able to accurately mimic human behaviour.

ChatGPT is no longer just a cool tool—it is shaping how we work, create, and solve problems.

Bing is powered by ChatGPT and Microsoft’s proprietary Prometheus framework. Bing provides improved relevance for simple queries like sports scores and weather, while a new sidebar offers in-depth summaries for more complex searches. 

It can also now accurately assist with creative tasks like drafting emails, creating social media posts, or developing travel itineraries, complete with source citations for transparency.

chatgpt 3.5 vs 4

ChatGPT generated the above response in the following three stages:

  1. Tokenization: Your input text is broken down into ‘tokens’—smaller chunks like words or sub-words—so the model can process the information more efficiently.
  2. Contextual Understanding: The model is pretrained to determine the context of the conversation, using attention mechanisms to focus on the most relevant parts of the input text.
  3. Prediction: Based on its trained data, ChatGPT predicts the most likely sequence of words to follow, iterating token-by-token to generate a coherent response.
  4. Output Generation: The model combines these predictions into a final output, which is returned to you as a response.

The process is highly prediction based, meaning ChatGPT doesn’t have fixed answers—it ‘guesses’ the best response based on pretrained data from vast amounts of resources.

ChatGPT 3.5: The Foundation

ChatGPT 3.5 is a large language model (LLM) developed by OpenAI. It leverages advanced deep learning techniques, specifically Transformer-based architectures, to understand and generate human-like text. 

It’s designed to process vast amounts of data and interact with users conversationally. This model is an evolution of GPT-3, with improvements in performance and efficiency. 

📍ChatGPT 3 vs 3.5 📍

ChatGPT 3.5 is an improved version of ChatGPT 3 building on fine-tuning, model optimization, and user intent alignment. While GPT-3 has strong generative capabilities, it struggles with maintaining contextual coherence across long interactions or handling complex, multi-turn queries. 

GPT-3.5 addresses these with RLHF and iterative fine-tuning. Both models share the Transformer-based decoder design but GPT-3 has improved tokenization strategies and better hyperparameter tuning, resulting in reduced token repetition, higher fluency, and stronger performance in technical and conversational tasks. 

chatgpt 3.5 vs 4

Key Capabilities of ChatGPT 3.5

  • Natural Language Understanding: Interprets complex queries and provides detailed, context-aware responses
  • Text Generation: Creates coherent, grammatically correct, and engaging content for various purposes
  • Multi-turn Conversations: Maintains context across dialogue turns for fluid and consistent interactions
  • Language Translation: Converts text between multiple languages with reasonable accuracy
  • Summarization: Produces concise summaries of lengthy texts
  • Programming Assistance: Provides coding help, debugging, and code generation in multiple programming languages
  • General Knowledge and Research: Answers factual questions using its pre-trained dataset knowledge
  • Adaptability: Customizes responses based on user tone, intent, or style preferences

While highly capable, ChatGPT 3.5 operates within the constraints of its training data (up to 2021) and cannot access real-time information (which is where GPT-4 fills the void!)

McKinsey had stated that executives should be using ChatGPT for the following use cases:

  1. Create or improve customer chatbots to resolve questions about products and services, including cross-selling.
  2. Write code and documentation to accelerate and scale developments.
  3. Identify clauses of interest, such as penalties owed, through comparative document analysis.
  4. Provide self-serve HR functions and automate first-line interactions such as employee onboarding.

📌Pro Tip: Getting an accurate response from ChatGPT 3.5 will depend on the quality of your prompts.

Your prompts must be:

  • Clear and specific instead of vague instructions; For example, rather than saying, “write about health”; be specific “write a 600-word article on the benefits of a plant-based diet for heart health”.
  • Context-rich; Provide examples and other relevant information such as desired content style, tone, and other requirements:  “Create a friendly and engaging blog post of 600 words about summer travel tips, similar to this article https://weam.ai/blog/guide/chatgpt-3-5-vs-4/. It has to be in the first person tone.” If possible, also add a detailed content brief
  • In different ChatGPT prompt styles; such as bullet points, short sentences, or longer paragraphs. 
  • Actionable; Use verbs in the text to instruct the model on the action you want it to take—Instead of saying “information about social media” say “list five effective strategies for increasing engagement on social media.“

Cost-Benefit Analysis of ChatGPT 3.5

Cost: ChatGPT 3.5 offers a free tier and a Plus plan at $20/month, providing faster responses and priority access.

Benefits:

  • Efficiency: Saves hours on tasks like drafting, summarizing, and coding.
  • Accuracy: Delivers context-aware outputs, reducing follow-ups.
  • Scalability: Supports customer service, content creation, and more.

ROI: A $20 subscription can save professionals hundreds of dollars in time weekly.

Trade-Offs: Occasional inaccuracies require human review, especially for niche or critical tasks.

Verdict: For $20/month, ChatGPT 3.5 offers significant time and cost savings. Start with the free tier and upgrade if it fits your workflow!

ChatGPT 4: Innovative Upgrade

ChatGPT-4 is built using the transformer architecture and trained on a large corpus of text data to understand and generate human-like responses in natural language. 

It leverages advanced machine learning techniques, including deep learning and unsupervised learning, to predict the next token (word or part of a word) based on context from the input provided.

ChatGPT-4 brings a lot of breakthrough features, such as:

  1. Multimodal abilities: One of the most significant upgrades in GPT-4 is its ability to handle both text and image inputs. With the vision-language model integration, it can process and understand images and text.
  2. Enhanced model size and architecture: GPT-4 has ~1.8 trillion parameters across 120 layers, which is over 10 times larger than GPT-3. This increased scale enables it to perform better on tasks requiring sophisticated reasoning.
  3. Advanced Reasoning Capabilities: When asked to derive a conclusion from contradictory premises, GPT-4 can demonstrate improved capacity for higher-order reasoning. This is due to its enhanced attention mechanisms, allowing it to prioritize relevant information within long or complex inputs.
  4. Contextual Continuity and Memory: GPT-4 has better contextual memory, enabling it to maintain coherent conversations across extended interactions. It can remember information across turns, resulting in a more natural and fluid dialogue where responses remain contextually aligned with the input.
  5. Scalability and Efficiency: GPT-4 has been optimized for better performance efficiency despite its increased scale. It leverages techniques like model pruning and layer fusion, which enable it to provide faster responses while maintaining high accuracy and low latency, making it more suitable for real-time applications such as virtual assistants, chatbots, and live technical support.

How are people using ChatGPT-4?

Skanska, a global construction company, has successfully implemented AI in quality control using a system trained on thousands of annotated images for site monitoring. The AI can quickly identify quality issues, such as improper installations and safety hazards, improving the accuracy and efficiency of inspections. 

They have also built Sidekick, an AI chatbot using Microsoft Azure and GPT-4, which helps employees quickly find information, create content, summarize documents, and work together securely.

Have people seen ROI by using ChatGPT in their business? Yes! Using ChatGPT can boost your issue resolution rate by 14% and cut ticket handling time by 9%.

Enhance ChatGPT’s accuracy by training it with past chat logs and your knowledge base enabling industry-specific, nuanced responses that resonate with your customers.

ChatGPT 3.5 vs 4: Deep dive

While we’ve discussed both models in-depth till now, we now need to get to the burning question: ChatGPT 3.5 vs 4: which is better?

GPT-4 is 82% less likely to generate disallowed content and 40% more likely to provide factual responses compared to GPT-3.5. 

This improvement stems from refined training using user feedback, expert consultations, and real-world use cases, addressing previous concerns of misinformation and bias.

Let’s Do a Deeper Dive:

Feature ChatGPT 3.5 ChatGPT 4
Model Architecture Transformer-based with limited context Enhanced transformer with extended context window
Multimodal Support Text-only Text, image, and audio inputs
Contextual Memory 8,000 words 64,000 words (Turbo: 128,000 words)
Accuracy 60-70% factual accuracy 90% factual accuracy, 82% less disallowed content
Reasoning & Logic Basic reasoning Advanced, multi-step logical reasoning
Safety Moderate safeguards Improved safeguards, reduced bias
Performance on Exams 10th percentile on Bar Exam 90th percentile on Bar Exam

Performance Benchmarks

Metric ChatGPT 3.5 ChatGPT 4
Accuracy 85% 93%
Task Completion Speed ~0.5 seconds per query ~1 second per query (due to more complex calculations)
Error Rate Around 10% Significantly lower at around 5%, especially in complex queries

Cost Comparison Calculator

Plan Option ChatGPT 3.5 ChatGPT 4
Free Plan 50 queries/month No free plan available for ChatGPT 4
Subscription (Monthly) $10 for unlimited access $20 for unlimited access
Pay-as-you-go (API) $0.002 per 1k tokens $0.03 per 1k tokens

Industry-Specific Use Cases

Industry ChatGPT 3.5 Use Cases ChatGPT 4 Use Cases
Customer Support Handles basic queries, FAQs, simple troubleshooting Provides personalized customer interactions, complex issue resolution, and proactive support
Healthcare Assists with general medical questions Offers in-depth medical research, provides diagnostic support, and assists in personalized treatment suggestions
Education Provides basic tutoring, helps with homework Creates adaptive learning environments, offers personalized curriculum, and provides instant feedback on complex topics
E-commerce Recommends products based on simple inputs Generates highly personalized product recommendations, predicts trends, and offers dynamic pricing insights
Finance & Accounting Basic financial data analysis and reporting Complex financial forecasting, budget management, and investment analysis
Marketing & Advertising Generates simple ad copy and marketing ideas Develops advanced marketing strategies, creates high-conversion ad copy, and predicts consumer behavior trends

Common Myths Debunked

Myths Reality (ChatGPT-4)
GPT-4 is only a bigger version of GPT-3.5 GPT-4 is a fundamentally enhanced model with multimodal capabilities and advanced reasoning.
GPT-4 is always faster than GPT-3.5 GPT-4 is slower in processing complex tasks due to its advanced capabilities, but it handles more sophisticated problems.
GPT-4’s improvements are marginal GPT-4 shows substantial improvements in reasoning, memory, and factual accuracy, offering a 40% better factual response rate.
GPT-4 is free to use GPT-4 incurs higher API costs due to its computational complexity compared to GPT-3.5.

How to Choose a Model?

We’ve understood each model and also compared them with each other. Now, we’ll discuss your company’s needs and help you make a decision with a framework. 

Scalability Factors

Factor ChatGPT-3.5 ChatGPT-4
Response Time Faster for simple queries Slower for complex queries due to advanced reasoning
Resource Requirements Moderate, lower compute cost Higher, requires powerful infrastructure for multimodal tasks
Support for Multi-user Load Handles moderate traffic well Optimized for high traffic, enterprise-level applications

Integration Capabilities

Capability ChatGPT-3.5 ChatGPT-4
API Access Available via OpenAI API Available via OpenAI API
Multimodal Input Not supported Supports text, images, and audio inputs
Custom Model Tuning Limited customization options Enhanced customization, fine-tuning options available
Third-party Integrations Basic integration support Seamless integration with enterprise-level platforms and APIs

Decision-Making Framework for ChatGPT 3.5 vs 4

  • Do you need basic, fast responses for straightforward queries?
    • Yes → ChatGPT 3.5
    • No → Proceed to next question
  • Is multimodal interaction (text + image) required for your application?
    • Yes → ChatGPT 4
    • No → Proceed to next question
  • Are you dealing with complex, multi-step tasks or need high-context understanding?
    • Yes → ChatGPT 4
    • No → ChatGPT 3.5
  • Is your application cost-sensitive for large-scale usage?
    • Yes → ChatGPT 3.5
    • No → ChatGPT 4

Step-by-Step Evaluation Process

  1. Define Use Case: Identify the complexity and nature of the task (e.g., simple queries vs. advanced reasoning, multimodal needs).

    Consider: Task complexity, context window size, need for multimodal inputs.

  2. Assess Budget and Resources: Evaluate whether the additional cost of GPT-4 aligns with your budget, infrastructure, and scalability needs.

    Consider: API cost per request, compute power requirements, long-term scalability.

  3. Review Integration and Deployment: Assess how well each model integrates with your existing systems or products and their ability to handle user load.

    Consider: Third-party integration ease, deployment infrastructure, multimodal support.

Mastering ChatGPT Integration for the Future

While both ChatGPT-3.5 and ChatGPT-4 represent significant milestones in AI development, GPT-4 stands out with its superior capabilities, enhanced accuracy, multimodal input handling, and increased memory. 

chatgpt 3.5 vs 4

User describes how ChatGPT 4 is better than 3

These advancements make GPT-4 more versatile and suitable for complex, real-time applications across industries such as healthcare, law, and creative fields. 

For businesses and developers, choosing the right version depends on task complexity, budget, and scalability needs. 

As AI continues to evolve, understanding these differences and strategically implementing each version will be key to unlocking their full potential in driving innovation and efficiency.

Conclusion

When it comes to ChatGPT 3.5 vs. 4, both models have their own strengths. If you’re looking for a budget-friendly option that handles everyday tasks with ease, 3.5 is a solid pick. But if you need more accuracy, better context understanding, and the ability to work with images, ChatGPT 4 is the way to go. At the end of the day, the right choice depends on what you need—quick and simple, or powerful and precise.

The best way to find out which one suits you? Try them out yourself with Weam AI. you can explore both ChatGPT 3.5 and 4 to see which fits your workflow best. You can Start for FREE!—so why not take them for a spin and see what works for you?

Frequently Asked Questions

Key Differences between ChatGPT 3.5 and 4

ChatGPT-4 outperforms 3.5 in accuracy, problem-solving, and context understanding. It supports multimodal input (text and images), handles more complex prompts, and delivers nuanced responses with enhanced memory and reasoning.

Is ChatGPT-4 Worth the Cost for Small Businesses?

GPT-4’s advanced features, like precise content generation and problem-solving, justify its cost for businesses handling complex tasks. GPT-3.5 is sufficient for basic needs but lacks the depth and scalability of GPT-4 for intricate requirements.

How to Integrate ChatGPT into Customer Service?

Integrate via APIs into CRM systems, tailor the AI with your knowledge base, and automate workflows for query handling, ticketing, and support responses, enhancing efficiency and reducing manual effort.

Which Version is Better for Content Creation Tasks?

GPT-4 is optimal for content creation due to its enhanced contextual understanding, ability to maintain tone, and generate high-quality, coherent content for long-form articles, technical writing, and creative pieces.

How Can I Ensure My Business Maximizes Its AI Investment?

To maximize your investment, customize the tool with your domain-specific data for accurate results. You should use it to automate repetitive tasks and improve productivity. Continuous monitoring of the tools’ performance based on feedback will ensure that it remains effective and delivers strong ROI.

Inside OpenAI’s Blueprint to Reshape America’s AI Future


OpenAI just dropped a sweeping “Economic Blueprint” that sketches out how the United States can—and should—take the lead on AI infrastructure and policy. 

And what’s in it has some huge implications for AI development, especially over the next four years of the newly elected Trump Administration. Continue reading “Inside OpenAI’s Blueprint to Reshape America’s AI Future”

Which AI Tool Is Better in 2025?


The debate of which AI tool is the best is a question that still goes unanswered. From the looks of it, ChatGPT has been facing some fierce competition in the Gen AI tool market. It has sparked a relevant ongoing debate—which AI tool should one choose?

Here, it boils down to whether it is Perplexity vs ChatGPT. While one is better for research, the other helps you produce better content. However, people have this belief that all AI tools are quite similar to each other.

Whether it is Perplexity vs Claude vs ChatGPT, all these tools have their own limitations and advantages. So, let’s see how Perplexity vs ChatGPT differs here and which professional should go for which AI tool.

Perplexity vs ChatGPT: A Quick Overview 

Perplexity and ChatGPT are both highly efficient tools made to help humans in their day-to-day tasks. However, there are some key differences that you should make a note of before investing in either of the platforms. 

Perplexity: Everything Factual 

Perplexity is a simple tool that helps in answering prompts by giving real-time, accurate information from citations directly from the web. It is designed to give factual answers with links to references, making it more reliable and accurate for the users. 

Perplexity vs ChatGPT

So when you are working on something academically related, research-based, it is important to check every factual piece of information. Perplexity should be your go-to buddy, as it will help you give accurate citations and exact web pages where it extracts information from. 

Therefore, when it comes to giving fact-based answers to what happened or who said what, Perplexity is the one for you. 

ChatGPT: Everything Creative 

ChatGPT is a general AI tool that is made to help with all things content, coding, storytelling, brainstorming, and document generation. Like Perplexity helps with in-depth research, ChatGPT is more reliable for creative tasks that need to be quick and require personalized assistance. 

Perplexity vs ChatGPT

So when you need help generating ideas or are in the middle of a creative block, ChatGPT can come to your rescue and give you a nudge to think in a different direction altogether. You might wonder, how does ChatGPT work to assist you in these moments? By using advanced AI to understand and respond to your inputs, it helps you brainstorm and overcome creative ruts.  

All in all, when you are in need of images, essays, and creative emails, there is no better place than ChatGPT.

Perplexity vs ChatGPT at a Glance

Now that we have an overview of how Perplexity and ChatGPT work, we will get into the technicalities of the two AI tools. We will compare the tools on the basis of their usage, accuracy, integration, cost, customization, and best use cases. 

The comparison will help people who are in the creative fields like writing, coding, and engineering, along with people who require researching on a daily basis to see which AI tool suits their professional needs the best.

Capabilities Perplexity  ChatGPT
Usability It works on a simple and user-friendly interface, delivering concise, quick, and fact-based answers.  It is more versatile and conversational and is best suited for brainstorming, content generation, and in-depth conversations. 
Accuracy The responses are highly accurate and verified with real-time web searches and citations from trusted resources.  The responses are based on a pre-trained learning model and may get outdated without real-time web access.  
Integration This is a standalone tool that primarily focuses on providing real-time searches and factual information.  This has the option of integrating plugins for browsing and API support, e.g., Slack, Notion. 
Cost This is free to use, with Copilot being premium and providing some advanced features.  This offers both free and premium. Free is the basic GPT with 3.5 capabilities, whereas GPT-4 gives you access to more creative responses. 
Customization  This is pretty straightforward with no personalization of workflows and focuses on quick Q&A.  This is customizable in terms of tone, style, format, content structure, language, and style. 
Best use cases  This is best suited for fact-checks and research-heavy tasks and straightforward answers.  This is best suited for content creation, creative tasks, brainstorming, and coding assistance. 

Perplexity vs ChatGPT: Deep-Diving Into 5 Key Features 

Now that we have a quick understanding of the differences between ChatGPT vs Perplexity, let’s explore their in-depth qualities. While one is the best for creative purposes, the other is best suited for research-oriented tasks. However, let’s understand them better so you can make an informed decision when you are buying one. 

  1. Accuracy 
  • Perplexity: When it comes to providing the most accurate information in a summarized and concise format, Perplexity should be your go-to partner.
    • It extracts information from reputable web sources along with providing links to the references used, allowing users to verify the information. 
    • The platform ensures that you get up-to-date information with real-time updates. 
    • Note: If the sources cited by the search are incorrect or outdated, the answers may carry those flaws. But as long as the content available online is good, the answers would be correct.
    • For example: If you want to understand what exactly happened in World War I, Perplexity makes sure to provide all the relevant information in a summarized yet educational manner. 
Perplexity vs ChatGPT
  • ChatGPT: Its responses are default, which are based on a static dataset and a pre-trained knowledge model.
    • It is not the best tool when it comes to doing research heavy tasks. 
    • Although ChatGPT is great at synthesizing complex information, it may occasionally generalize or misinterpret niche topics.
    • Note: Without web access, it may provide outdated information that may be incorrect in nature.
    • For example: If you ask the same question of what exactly happened in World War I, ChatGPT will provide surface-level information as compared to Perplexity.

Perplexity vs ChatGPT 

  1. Ease of Use 
  • Perplexity: It has a very traditional interface aiming at doing quick web-search, just like Google, which makes it intuitive and minimalistic for the users to use.
    • It is pretty straightforward, with no personalized workflows or customizations.
    • It focuses on providing accurate, real-time, citation-backed answers. 
    • The workflow is pretty simple—you just have to put a prompt and you will get a quick answer without any back-and-forth clarification. 
  • ChatGPT: It offers more of an interactive and conversational interface.
    • ChatGPT allows users for deeper dialogue, engagement, and clarification. ChatGPT is best suited for creative tasks and complex discussions where factual or straightforward answering doesn’t work but a to-and-fro conversation is being done. 
    • Moreover, ChatGPT supports multimodal inputs (images, texts, and audio), making it even more interactive and engaging.
  • Ultimate Results: If you are a person who prioritizes quick access to factual information and are more into research-heavy work, Perplexity is the best tool for you. However, if you are into creative tasks where a lot of conversational flow happens and brainstorming is required, ChatGPT is the one for you.
  1. Customization
  • Perplexity: It doesn’t offer any extensive customization and primarily focuses on delivering concise, pithy, and accurate information.
    • The platform is designed in such a way that the conversation is not so much as to-and-fro and gives more of a straightforward answer. 
    • It doesn’t offer any personalized workflow and is not designed to tailor responses according to an individual’s user preference. Rather, it relies on delivering quick, accurate information. 
    • Perplexity is tailored for people whose daily tasks revolve around doing heavy research work and engaging in reliable data.
  • ChatGPT: It is designed in such a way that it allows for a personalized interaction that fits with the user’s preference, tone, style, and voice.
    • ChatGPT offers customization, allowing the users to have a more interactive and extensive dialogue. 
    • It  is not built like a search engine (Perplexity) but like a general chat system where the AI responds based on prior interactions. So if you are someone who is in a creative field or needs to do a lot of brainstorming sessions, ChatGPT is for you!
    • However recently ChatGPT did introduce its latest platform known as SearchGPT. It replicates the amazing capabilities of Perplexity.
  1. Output quality 
  • Perplexity: Excels at providing factual and straightforward answers quickly.
    • When it comes to delivering real-time information and precise answers, Perplexity ensures to give those clear-cut responses. 
    • For example: Writing a thesis or giving real-time information—that is where Perplexity can help you. So if you are a researcher or someone who has to look into factual information all day long, take Perplexity’s help!
  • ChatGPT: It excels in generating creative texts and crafting narratives around poetry, essays, or long-form content.
    • ChatGPT helps in brainstorming of ideas and also giving constructive feedback to enhance user engagement. 
    • For example: If you are writing a brand communication document, ChatGPT can help you with brainstorming ideas along with giving you feedback on the same. So if you are someone who is in a creative field and tends to get creative blocks from time to time, take help from ChatGPT.
  1. Unique features 
  • Perplexity: Unlike traditional search engines, it aims to provide summarized and concise information in response to user queries, reducing the time to sit through a number of tabs.
    • It compiles information from a number of verified links, giving users reliable information. 
    • Additionally, Perplexity provides two modes: quick search, which, as the name suggests, gives straightforward information and pro search, for detailed answers.
    • The pro version allows users to toggle between different large language models (LLMs) for varied responses, like image generation capabilities through models like DALL-E 3.
  • Note: Not just this but Perplexity AI ensures to include citations and references to double-check the information and verify everything provided. It has contextual understanding of the threads and enables users to ask follow-up questions on prior interactions for better clarity. 
  • ChatGPT: The platform is designed for conversation and interactive dialogue where users can exchange notes and talk in-depth without losing context for a long time.
    • There is a sense of creative freedom with this tool, as it allows more of a personalized experience and helps you in your artistic endeavours. 
    • There is more versatility to this tool, which helps in providing support in coding, creative writing, stories, poems, and even document writing. 
  • Note: To get a better understanding of either of the tools and get on with the debate of Perplexity ai vs ChatGPT, we suggest you do a free trial version of both platforms to make an informed decision. 

Perplexity AI vs ChatGPT: Pricing 

An important point to highlight is that both tools offer similar pricing models. Perplexity pro vs ChatGPT plus both are priced at $20 per month along with smart advanced features. 

  • Perplexity Pro: You can get unlimited quick searches and a higher number of pro searches, along with an enhanced feature of image uploads. If you are someone who isn’t that inclined toward research-oriented tasks, then sticking to the free trial would be best for you. However, if your day-to-day tasks revolve around research and doing factual checks, this platform would be best for you.
Perplexity vs ChatGPT
  • ChatGPT:  ChatGPT Plus provides access to the advanced GPT-4 version with more nuanced responses and access to image capabilities. With ChatGPT Plus, you can get access to multimodal systems of processing texts, audio, and images. So if you are a creative person and use this tool on a daily basis, investing in the pro version may do you wonders. You can also check out a detailed comparison of ChatGPT Plus vs 4 to make an informed decision.
Perplexity vs ChatGPT

Therefore, the debate of Perplexity pro vs ChatGPT 4o is something that depends upon you and your professional needs. As both of them cost the same, it is best to try both and see which suits you the best.

Perplexity vs ChatGPT: Best Use Cases 

Perplexity AI 

Perplexity offers you an advanced search engine where you can deep dive into any topic and ask for comprehensive answers. It allows you to ask follow-up questions for further exploration and is best suited for you if you are into a research job. 

  • Fact-checking and verification 

Because of its ability to provide citations and relevant web page links, it ensures that wherever information is provided to you is verified and can be double checked by the user. This helps professionals who need accurate and reliable data. 

It can also be used to track real-life updates like sports events or election news, where you will receive instant updates without having to sit through the entire game or news.

ChatGPT 

  • Conversational Engagement 

ChatGPT is designed in such a way that you can have a fun, interactive dialogue with it and discuss topics or seek advice in a conversational manner. This makes it more personalized and relatable. 

This tool helps you in crafting stories, poems, scripts, or anything content by developing plots and characters and setting the whole stage for it. This can greatly help people who are in the writing industry. 

Developers can leverage this platform to get help in coding, troubleshooting problems, and learning new programming concepts through an interaction conversation. 

User Testimonials 

In a case study, a major bank reported that since they implemented ChatGPT, it helped them respond immediately to customer inquiries and provide personalized financial advice based on

transaction history, and streamlined processing of routine banking operations. This integration not only improved customer loyalty but also reduced operational costs. 

On the other hand, in a Reddit thread, users expressed Perplexity serves as a total game-changer for quick information retrieval and research tasks. They appreciated its ability to cite sources directly within responses, which enhances trust in the accuracy of the information provided. 

Conclusion: Perplexity vs ChatGPT 

Guess what! You can use powerful Gen AI models in Weam AI. However, which AI platform is the best depends on you and your area of work. ChatGPT is designed to be interactive and deliver information in a conversational style. On the other hand, Perplexity is a heavily research based platform for gathering useful insights quickly.

Weam AI allows you to access multiple models in a shared and private workspace. Enabling you to achieve more everyday, it has amazing sets of features simplifying the integration of AI into your workflow too. Try Powerful Gen AI models in Weam and explore more about our prompt libraries and custom GPTs feature. Start for free!

Frequently Asked Questions

What is the major difference between Perplexity ai vs ChatGPT 4?

Perplexity AI is a search-powered assistant that helps by giving real-time, fact-based answers with citations. ChatGPT is a general conversational AI that is more suited for creative tasks, long-form content, and interactive problem-solving.

Is Perplexity AI more accurate than ChatGPT? 

Perplexity AI is better in accuracy as it extracts real-time information from web sources along with citations. ChatGPT may provide outdated information unless it has web access enabled.

Which AI tool is easier to use from Perplexity vs ChatGPT?

Perplexity offers a search-like interface, making it a great tool for simple, quick, one-shot queries. ChatGPT’s interface supports more interactive conversations and allows refining answers, but it may require more detailed prompts for complex queries. Therefore, it depends on which is easier to use from the prompt given.

Can ChatGPT provide real-time information like Perplexity AI?

ChatGPT does not provide real-time information apart from when equipped with browsing tools or plugins. Whereas Perplexity AI is best suited for providing real-time information as it is designed to deliver quick, accurate, and real-time information from web sources along with citations.

Which is better for content creation from ChatGPT vs Perplexity?

ChatGPT is clearly a better option for generating content such as blogs, reports, and creative writing due to its ability to follow detailed prompts. Perplexity AI is better suited for research and fact-checking rather than creating long-form content.

Building and Using Prompt Collections in 2025


A prompt library is a collection of different types of prompts. They are predesigned and sufficiently fulfill the goal of being a useful resource to accelerate your workflow.

Gen AI has been a huge topic of discussion for every community. Whether you are a lawyer, researcher, developer, or writer integrating AI into your operations has become critical. People are learning about practical workflows involving AI to reap the most benefits from its capabilities. One of those efficient centric approaches is the AI prompt library for your Gen AI platform.

I like this definition of prompt better: It means to cause something to happen; make somebody decide to do something. Prompt libraries are collections of pre-designed prompts. They allow Gen AI models to generate relevant valuable insights, eliminate monotony, and sometimes even amaze you.

There is just one catch. The number of prompts can increase significantly and organizing them becomes a hassle, how? More on that later. So prompt templates are useful but how do you curate them, where do you find them, how do you even decide a prompt structure? Find answers to all these questions, more helpful tips, & practices in this article.

Understanding Prompt Libraries

I’m quite sure you are using ChatGPT on a daily basis. Every prompt you enter generates either fruitful or straight up poor results. The line that separates those two results is a well explained ‘prompt’. 

Definition: A prompt is a set of instructions allowing Gen AI to perform tasks according to your requirements. 

Now for understanding prompt libraries let me share a simple experience with you. I was working on a social media strategy and wanted to generate a few content resources for the same. I was using ChatGPT. After a few iterations I finally decided to use an old prompt which generated better results.

So begin my endless scrolling and constantly pressing CTRL+F to find the right words. At that point of time I realized “Wait a second, I was using AI tools to save time”.

To save time and get better results—this is the underlined benefit of AI prompt libraries that we often ignore. If I have to let say perform 10 tasks everyday for every task using Gen AI I have to do multiple iterations of prompts. Now there are universally common responses and hyper-personalized responses. A prompt makes all the difference so why wouldn’t I save the prompt that gave me a competitive edge.

Key Features of the Best Prompt Libraries

There is a checklist to determine if the AI prompt library is well defined or otherwise. Based on my experiences I am laying out the points.

AI prompt library

Best Practices for Building Prompt Libraries

An AI prompt library does not mean it has prompts generating the best output. If you look at the structure of a prompt you have to take context into consideration. It’s a crucial element for prompt libraries. So a prompt library should be made to generate relevant output for ‘you’.

The first and foremost practice to keep in mind can help achieve 80% of the goal of building an AI prompt library. It has nothing to do with tools, just a logical approach. Creating a prompt library falls under how easily a user can navigate through the library.

Every prompt engineering enthusiast will say that a clear categorization between the prompts you saved is important. Fundamentally there is a simple differentiation between prompt collection. There are personal prompts and then there are professional prompts for any AI tools. Once you have created this distinction it is time to work on organization & quality assurance.

Organization Methods

  1. Categorization systems: To make relevant prompts quickly you have to categorize them. My personal approach is categorizing them based on their function.
    • For example: In our Gen AI platform it is categorized based on specific departments belonging to specific industries.
  2. Tagging and labeling: Include tags to make it easier for your team to search for it too.
    • For example: I use two tags: formal tone & informal tone for content generation of sales and social media respectively.
  3. Version control: Maintaining a version control of the Gen AI prompts ensures integrity. Keep updating your prompts accordingly but do maintain a history of edits.
    • For example: Our team updated the customer support prompts to include new policy details, while retaining the ability to revert to its original form if needed.

Quality Standards

  1. Clarity and specificity: I found it the hard way, but only keep records of the prompts that worked out for you. Clearly worded and deep diving in the intricacies of your desired result.
  2. Consistency in format: Build prompts using specific structure like a template. The structure can be used as a reference for making more complex prompts for your teammates. Consistency makes the prompts easy to understand and make changes after iterations.
    • For example: Role based prompt or starting prompt with an action verb followed by context and with a unique requirement or instruction.
  3. Testing and validation: Before adding prompts to a library use them to test relevant output.
    • For example: Use various Gen AI tools to match the relevancy of your prompt saved.

Essential Components of an Effective Prompt Library

A basic system prompt includes a role, task, requirements, and instructions. Now as your prompt library expands, your goal is make it more comprehensive and user-friendly. This does involve working on specific key components.

Variables and parameters

  • Sometimes structure role-based prompts for various use cases have variables and parameters. 
  • Enhancing the flexibility, variables & parameters allow users tailor prompts specific to needs.  
  • By defining parameters, users are able to control output more precisely. For example: if you want a specific task for data analysis, just assign a role to your Gen AI.

Documentation requirements

  • Documentation should provide detailed instructions on how to use each prompt, including its intended purpose, expected outcomes, and necessary context.
  • Ensure users can adapt prompts effectively without losing the impact and don’t deviate from the expected results.
  • Helps new users quickly grasp the library’s structure and functionalities, promoting better adoption and utilization throughout the organization.

Template structures

  • Standardize how the prompts are created and saved. A robust template introduces consistency into your prompt library.
  • To ensure each prompt is clear, concise, and aligned with specific use cases. It facilitates scalability and maintenance of prompts too. 
  • Additionally, template structures include placeholders for variables and parameters, enabling customization and adaptability for various scenarios and applications.

Usage guidelines

  • Providing clear guidelines beforehand on crafting prompts in your libraries is highly effective. Here you can leverage the benefits of a tutorial video. A tutorial video which is easy to understand and helpful clearing every corner of your prompt library.
  • Explain how maintaining a consistent standard allows users to navigate through the library conveniently.
  • A feedback mechanism ensures that your prompts don’t get outdated and are still relevant for your users’ applications.

Curated AI Prompt Types

Think of these prompts as refined ones which have proven their effectiveness. Every AI prompt library consists of well-crafted recipes – you know they’ll work reliably when you need them. 

So I divided my library further into below mentioned categories. It allows me to share prompts within my platform to my fellow colleagues.

General Purpose Prompts

They’re designed to be flexible enough to handle a wide range of common tasks while maintaining consistent quality in outputs. Divide these prompts for general tasks into three sub categories:

  1. Conversation starters
  2. Task-specific
  3. Creative

General Purpose Prompts

Type Definition Why? Also!
Conversation starters For being skilled conversation partners who expertly break the ice and steer discussions productively. These prompts are specifically crafted to initiate meaningful dialogues with AI models. These prompts set the right context and tone from the start, ensuring that interactions flow naturally and remain focused on your objectives.
Task-specific prompts These specialized prompts are designed for specific jobs or functions, much like having the right tool for a particular task. Each prompt is optimized for its intended purpose, whether for data analysis, content creation, or problem-solving. They’re precision instruments crafted to deliver exactly what you need for specific tasks with minimal adjustments.
Creative prompts  These prompts are designed to inspire imaginative and innovative outputs from AI models. They act as artistic catalysts, encouraging the AI to think “outside the box” while maintaining useful structure. Valuable for gaining fresh perspectives or unique approaches to content creation, brainstorming, or problem-solving.

Table 0.1.1

Industry-Specific Prompts

Industry specific prompts are professional grade prompts. Divide them into three primary categories to make it easy:

  1. Business applications
  2. Educational use
  3. Creative industries

Industry Specific Prompts

Type Definition Why? Also!
Business applications Think of them as your digital business toolkit, ready to tackle everything from strategic planning to operational efficiency. These prompts are engineered for commercial and organizational needs, organized in a verified AI prompt library for business applications. They streamline operations, enhance decision-making, and improve business processes across departments.
Educational use These Gen AI prompts act as digital teaching assistants, crafted to support educators and learners throughout the educational journey. Designed with pedagogical principles in mind, they help create lesson plans, generate educational content, and assist in assessment creation. They facilitate interactive learning experiences, generate practice problems, and develop engaging educational materials.
Creative industries Mostly consists of community driven prompt I can find in various open source prompt libraries or my  colleagues share with me These prompts are tailored for creative professionals, serving as collaborative partners in the creative process. They bridge the gap between creative vision and technical execution, helping professionals explore something new while adhering to guidelines.

Table 0.1.2

Common Challenges You Face When Building AI Prompt Library

Let’s delve into the primary challenges you might encounter when building and maintaining an AI prompt library. Don’t worry these are easy to tackle challenges and I’ve also provided a solution for them. 

At first you might think of listing types of prompts and making a library also has challenges. But trust me I did too tackle these challenges and it highlighted elements or blocks requiring careful attention.

Organizing large collections

As your prompt library grows, managing content becomes increasingly challenging. Teams often struggle with organizing prompts hierarchically and creating a system that makes them easy to find. 

Just like organizing a large digital library, you need strong categorization frameworks that can adapt as your collection expands. The key is to implement scalable structures that can accommodate everything from simple templates to complex multi-modal system prompts.

Maintaining consistency

Quality control becomes more complex as your prompt library grows. Teams must ensure standardized formatting, maintain consistent tone and style guidelines, and implement version control systems.

The challenge is to create validation frameworks that verify prompts remain effective while meeting established quality metrics. This includes managing prompt dependencies and ensuring compatibility across platforms.

Updating outdated prompts

The dynamic nature of AI models means prompts can quickly become obsolete. Teams must implement effective deprecation strategies and update protocols. This requires robust monitoring systems to track prompt performance over time and identify when updates are necessary. 

Mostly face when saving a prompt that has customizable placeholders for easy prompt creation. The key is balancing backward compatibility with the need for optimization and improvement.

Collaboration challenges

As teams expand, managing collaborative workflows becomes more complex. This includes addressing version conflicts, implementing access controls, and maintaining documentation standards.

You  need effective change management processes and review protocols for your AI prompt library. It ensures quality while fostering productive collaboration. Additionally, managing knowledge transfer and preserving institutional memory regarding prompt development decisions is essential.

Discover a Curated AI Prompt Library Crafted by Experts at Weam AI.

Every challenge needs a robust solution and with an expert AI prompt library its Weam AI. It is a gen AI platform that allows you to access multiple Gen AI models. There are customizable bots too which convert your prompt into agentic AI for specific tasks.

AI prompt library

An example of my AI prompt library using  Weam AI guides.

In Weam we’ve also divided the whole platform into two workspaces or ‘Brains’. One is shared and the other is private. You can easily switch between the two and share generated results between the two through a single click. The idea is to help organizations integrate AI into their workflow with a scalable roadmap.

Wrapping Up!

Building a well-structured AI prompt library is crucial for maximizing AI model performance and ensuring consistent outputs. It involves more than just collecting prompts; it requires creating a dynamic ecosystem that evolves with your organization and the advancing AI landscape. The key ingredient is balancing structure with flexibility and standardization with innovation. 

Treat your prompt library as a strategic asset needing ongoing refinement. As Gen AI models advance, your library should incorporate new insights and best practices. Investing in proper structuring and maintenance will yield significant benefits in efficiency, consistency, and innovation. If you want to fully unlock the capabilities of best prompt libraries use them in Weam AI. We provide access to multiple Gen AI models and you can Start for Free to streamline your daily workflow.

Frequently Asked Questions

What are some of the best AI prompt Libraries?

Here is the list of the 10 best AI prompt libraries available for free.

  • Weam AI Prompts
  • OpenAI Prompt Library
  • Google AI Studio Prompt Gallery
  • Hero Page Prompt Library
  • Snack Prompt Library
  • Anthropic Prompt Library
  • PromptHero Library
  • GitHub ChatGPT Prompts
  • Vertex AI Prompt Gallery
  • AI for work

How can I measure the effectiveness of my AI prompt library?

You can measure the effectiveness of your AI prompt library by evaluating the quality and accuracy of the AI-generated outputs and collecting user feedback on its usability and impact. Monitoring performance metrics like response relevance and consistency also helps assess how well your AI prompt library meets your objectives.

How do I ensure consistency across different roles based prompts?

To maintain consistency across role-based prompts, create a standardized template that outlines the structure, tone, and language to be used. Implement a style guide specifying guidelines for each role to ensure uniformity. Store all prompts in a centralized repository accessible to all team members, and regularly review and update them to align with your standards.

What types of tasks benefit most from dual-system prompting?

Dual-System Prompts are especially effective for tasks that require both creative generation and critical evaluation. This includes complex writing assignments, such as crafting persuasive essays or developing narratives, where generating ideas and refining content are both crucial. They’re also beneficial in problem-solving scenarios that demand innovative solutions followed by analytical assessment, ensuring the final output is both original and logically sound.

How do I create effective prompts for image generation tasks?

Creating effective prompts for image generation tasks involves crafting clear and detailed “visual prompts” that guide the AI in producing the desired image. Specify the subject matter, including objects, people, or scenes, and provide descriptive details such as colors, textures, lighting, and perspective. Mention the style or mood you want to achieve, possibly referencing artistic movements or specific artists for inspiration. The more precise and illustrative your prompt, the better the AI can generate an image that matches your vision.

Copilot In Microsoft 365: AI-Powered Assistance


Copilot in Microsoft 365: AI-Powered Assistance

Microsoft has been a pioneer in implementing artificial intelligence (AI) into business tools. And its latest breakthrough, Copilot (integrated into the Microsoft 365 suite), is a game changer.

This is much more wondrous for the organizations since AI in Microsoft 365 can automate most routine chores and make them have greater efficiency as well as better coordination among varied teams, departments, and projects. It gives effective communication, enhances the management of projects in a more optimal manner, and provides even deeper insights from data without requiring sophisticated technical expertise.

In this article, we are going to address the changes that Copilot has introduced in terms of productivity and how it brings AI advantage into competition by businesses. Main Benefits, Practical mobile Applications, and Future Possibility of Copilot Along with the challenges that the enterprise may face, we also discuss.

Key features of Copilot in Microsoft 365

  1. AI-Enhanced Document Creation and Editing

One of Copilot’s most significant capabilities is its ability to let you create and edit documents in Word and PowerPoint. Copilot helps professionals make the work of drafting reports, proposals, or presentations less burdensome. It gives users real-time suggestions, corrects language, and even helps format them. Copilot ensures that information is clear, concise, and professional by reading into the context in which information is created. In PowerPoint, it goes a step further to recommend design elements and help you build visually beautiful presentations without requiring design skills.

  1. Automated Excel Data Analysis

Data analysis is a crucial and stressful process in many business situations. However, it can be greatly simplified by Copilot’s Excel features. It supports users by automating data analysis, creating charts, and offering insights without the need for advanced Excel skills. Copilot can also suggest formulas, automate repetitive activities, and assist users in identifying data patterns. This makes it an effective tool for corporate teams seeking precise and timely data to make informed decisions. As a result, data processing speed improves, errors are reduced, and insights can be applied faster.

  1. AI-Powered Email Assistance in Outlook

This is achieved through the copilot that is in Microsoft Outlook email management. It uses AI since it will help in drafting, responding and can even send out structured e-mails. It allows one to be able to see to it that style is uniform while writing communications. Also, it can automate follow ups and reminders of unread messages and draft messages thereby keeping teams on top of their communication without putting too much work.

  1. Meeting and Task Management in Teams

The feature of Copilot under Microsoft Teams for cooperation management offers you planning of meetings, generation of meeting notes, and assigning responsibilities to members. Based on deadlines and relevance, Copilot can offer prioritization of work by teams; therefore, teams tend to be on track and well-organized. Its ability to track progress and communicate real-time updates to the team also upsurges efficiency and keeps everyone in sync.

Microsoft 365 Copilot’s Practical Uses for a Range of Business Purposes

  1. Sales and Marketing

Copilot helps to enhance the performance of the marketing and sales divisions. It helps the sales team to speed up the documentation and proposal preparation process by gaining insights from previous proposals. This reduces administrative work and allows them to focus on strategy and relationship-building. Copilot may also assist with campaign creation in marketing by producing email templates, social media posts, and marketing reports. It allows marketers to analyze consumer behavior more quickly and plan improvements accordingly.

  1. Recruitment and Human Resources

Copilot’s capabilities aid human resource teams, especially in running multiple workflows. For example, Copilot could assist the human resources manager in organizing employee performance reports, performing application follow-ups, and making employee offer letters. These factors not only decrease the administrative burden but also enhance the consistency of communications throughout the organization. The way Copilot can scan through resumes and match individuals to the requirements of a job while automatically scheduling interviews for recruitment teams, HR professionals can focus on building stronger teams.

  1. Accounting and Finance

Finance departments can use Copilot’s Excel functionality to enhance their reporting and analysis processes. Copilot reduces the time needed for manual audits as it helps to create financial reports, forecast budgets, and even detect inconsistencies. It reduces human error by automating routine accounting operations that include cost tracking, reconciliation, and invoicing. Finance teams can make smarter, faster financial choices using Copilot’s real-time insights about profitability, cash flow, and other key financial indicators.

  1. Client Assistance and Support

Using Copilot, the customer support team can automate ticket prioritizing, respond to FAQs with AI, and even follow up with clients when needed. This ensures that clients receive only accurate and consistent information. Additionally, it also speeds up the response times. For example, Copilot can provide responses based on previous encounters. So, the support team can handle customer requests quickly and concentrate on complicated problems.

Security, Compliance, and Privacy of Copilot

Businesses have to consider privacy and security when using AI-powered solutions like Copilot. Microsoft has taken these considerations to make sure Copilot is a safe and dependable solution.

  1. Privacy and Data Security

Microsoft developed Copilot as part of Microsoft 365’s multi-layered security and robust encryption mechanisms. Copilot’s encryption technology protects sensitive data during transmission and storage.  Furthermore, Microsoft complies with foreign privacy regulations, such as GDPR, ensuring that organizations’ data is managed properly and according to international laws. So, enterprises may apply AI without fear of security risks.

  1. Compliance

For industries like law, finance, and healthcare, compliance is essential. Copilot maintains compliance by looking for any possible legal problems in emails, papers, and other company communication. It alerts users when any information deviates from compliance guidelines to prevent expensive legal troubles. For instance, it can guarantee that financial reports adhere to relevant industry standards or that HIPAA requirements are followed when handling sensitive healthcare data.

The Future of AI in Microsoft 365 and Business Workflows

The future of artificial intelligence in Microsoft 365 is full of possibilities for changing how businesses work. Copilot is already a big step toward bringing AI into everyday tasks, but it’s just the start. As artificial intelligence technology advances, Microsoft will continue to introduce new features that make it smarter and easier to use. Businesses should expect changes that will allow them to get more done with less effort.

One of the best features of artificial intelligence is its ability to learn and develop over time. Copilot learns from its users and adapts to their demands. As a result, the more time you spend using it, the more valuable it becomes. As AI evolves and improves, it provides relevant solutions that enable organizations to make better decisions.

Conclusion

Copilot in Microsoft 365 is more than just an automation tool. It’s a sophisticated AI assistant that helps businesses operate smarter and quicker. Copilot can be integrated into Microsoft Office programs like Word, Excel, Outlook, and Teams to handle repetitive work. This allows the employees to focus on what truly matters—strategic decision-making and creativity.

Copilot helps businesses stay productive in a fast-paced environment by improving document generation, streamlining data analysis, improving communication, and assisting with task management. It guarantees that assignments are finished on time, through improved individual and team communication.

USM Business Systems specializes in developing custom AI solutions that increase productivity. We can assist you in implementing Copilot and other AI solutions into your company to increase productivity and stay ahead of the competition. To learn more about how artificial intelligence could benefit your business, get in contact with us right now.

 

“Confident We Know How to Build AGI,” Why OpenAI’s Agents Are Delayed & Trump $20B Data Center Investment


A groundbreaking World Economic Forum report reveals massive shifts ahead in how we work, while Sam Altman drops major hints about AGI and superintelligence in a new Bloomberg interview. 

Plus, surprising new data on why enterprises are choosing proprietary AI over open source, unpacking a $20B investment in U.S. data centers, and examining Anthropic’s massive new funding round. In this packed episode, Paul and Mike break down these developments and much more reshaping the AI landscape.

Listen or watch below—and see below for show notes and the transcript.

Listen Now

Watch the Video

Timestamps

00:04:55 — World Economic Forum Releases Future of Jobs Report

00:17:35 — Sam Altman’s “Reflections” and Bloomberg Interview 

00:28:31 — Prophecies of the Flood by Ethan Mollick

00:40:17 — The Law of Uneven AI Distribution

00:44:35 — Notes on the State of AI in the Enterprise from Box CEO Aaron Levie

00:48:47 — Why OpenAI Is Taking So Long to Launch Agents

00:53:11 — CES + AI

00:58:41 — AI Startup Anthropic Raising Funds Valuing It at $60 Billion

01:02:16 — Trump Announces $20B Foreign Investment in New US Data Centers

01:05:52 — Grok/xAI Updates

  • xAI Releases Grok App
  • X Is Raising Pricing
  • Grok Will Soon Launch in Tesla Vehicles

01:10:02 — AI Researcher François Chollet Co-Founding Nonprofit to Build AGI Benchmarks

01:13:46 — Why Businesses Are Skipping Open-Source Models

This episode is brought to you by our AI Mastery Membership: 

This 12-month membership gives you access to all the education, insights, and answers you need to master AI for your company and career. To learn more about the membership, go to www.smarterx.ai/ai-mastery. 

As a special thank you to our podcast audience, you can use the code POD150 to save $150 on a membership. 

Today’s episode is also brought to you by Marketing AI Institute’s AI for Writers Summit, happening virtually on Thursday, March 6 from 12pm – 5pm Eastern Time.  Learn to craft compelling stories faster, boost your productivity, and build a sustainable writing strategy for the years ahead. 

Choose between free live access or premium tickets with on-demand replay. Don’t miss this opportunity to transform your writing. Register now at aiwritersummit.com

Read the Transcription

Disclaimer: This transcription was written by AI, thanks to Descript, and has not been edited for content. 

[00:00:00] Paul Roetzer: You’re going to have graduating college kids who do not want to go work for companies that don’t allow them to use ChatGPT. The idea of going to work for a company where you’re not allowed to use AI, that’s like a non starter for a lot of this talent. And that may actually be what we need to trigger faster adoption within enterprises when they realize, like, where do you get the top talent?

[00:00:19] Paul Roetzer: It is certainly not by shutting off access to generative AI tools. Welcome to the Artificial Intelligence Show, the podcast that helps your business grow smarter. by making AI approachable and actionable. My name is Paul Roetzer. I’m the founder and CEO of Marketing AI Institute, and I’m your host. Each week, I’m joined by my co host and Marketing AI Institute Chief Content Officer, Mike Kaput, as we break down all the AI news that matters, and give you insights and perspectives that you can use to advance your company and your career.

[00:00:51] Paul Roetzer: Join us as we accelerate and innovate.

[00:00:59] Paul Roetzer: Welcome to [00:01:00] episode 130 of the Artificial Intelligence Show. I’m your host, Paul Roetzer, along with my co host, Mike Kaput. We have a World Economic Forum jobs report, more interviews with Sam Altman, a great article from Ethan Mollick, and a whole bunch of other updates. And it is Monday, January 13th, as we’re recording this, and it has already been a busy morning.

[00:01:20] Paul Roetzer: There’s like, major news items from the White House, NVIDIA. all kinds of stuff happening. We’re not even going to get to in this episode, but, usually when the weeks start off like this, Mike, my, what I’ve learned now having covered this space for over a decade, if Monday morning starts busy, that’s usually a prelude to a whole bunch of stuff happening, and I would say there is a lot happening.

[00:01:46] Paul Roetzer: On a Monday morning, way more than normal. So I would expect we are in for a crazy episode next week when we have to cover everything that’s about to happen this week. So, episode 130 is brought to us by the AI [00:02:00] Mastery Membership Program we’ve been talking about on the show. if you’re looking to drive AI transformation for yourself or your company in 2025, you should definitely check out our AI Mastery Membership Program.

[00:02:10] Paul Roetzer: This is a 12 month membership that gives you access to to education, insights, experiences, and everything you need to really drive transformation in your career and your company. Mike and I do exclusive content for this Mastery Membership Program. There’s a Generative AI Mastery Series where Mike does demonstrations of Gen AI tools and apps.

[00:02:29] Paul Roetzer: we have an Ask Me Anything session once a quarter, which is a live AMA. And then we also have, quarterly briefings where we do sort of the top ten trends. And there’s a bunch of other stuff. There is, I’m, I’ve mentioned I’m working on plans for this Mastery Membership. they are very close. I’m not going to be able to announce them probably in the next week or so, but we are very close.

[00:02:52] Paul Roetzer: We actually think we’re going to probably roll out Phase 1 of this, potentially later this month. So stay tuned on some updates to the Mastery [00:03:00] membership program, and then there’s going to be some other bigger announcements as we go throughout Q1 and into Q2. So it’s a great time to get into this program.

[00:03:09] Paul Roetzer: You can go to smarterx. ai slash ai dash mastery, or you can just go to smarterx. ai and click on education. And the Mastery Membership Program is under there. POD150, we’ve had a lot of listeners taking advantage of this promo code, recently. So check out POD150, it’s POD150. That’ll get you 150 off the annual membership.

[00:03:30] Paul Roetzer: And there are, enterprise plans available as well. So reach out to us if you’re interested in Mastery Memberships for your team. this episode is also brought to us by AI for Writers Summit. Writers who embrace AI will lead the future of storytelling. AI writing tools are revolutionizing how we create, refine, and scale content.

[00:03:48] Paul Roetzer: I know Mike is doing it all the time as the Chief Content Officer at Marketing Institute. unlocking new possibilities for writers, editors, and content leaders. The question is no longer if you should use AI, but how to use it [00:04:00] effectively to stay ahead. At our virtual event, the AI for Writers Summit, you’ll learn how to harness the latest AI tools to responsibly transform storytelling with speed and precision, enhance productivity without sacrificing creativity, and build strategies to future proof your career or content team.

[00:04:17] Paul Roetzer: The summit is taking place virtually from noon to 5 p. m. Eastern time on Thursday, March 6th. This is our third annual summit. Last year, we had over 4, 500 attendees. Crazy. The first year we did it, we had over 4, 000, so it’s just, it’s growing every year, but, so this is the third one. There is a free registration option.

[00:04:37] Paul Roetzer: This is a key. It’s a sponsor supported event, so there’s a free registration option. And then there’s also a paid ticket option with on demand access. So go to AIWriterSummit. com. Again, that’s AIWriterSummit. com, and you can learn more about that program. 

[00:04:55] World Economic Forum Releases Future of Jobs Report

[00:04:55] Paul Roetzer: All right. interesting jobs report, Mike. certainly a, a job [00:05:00] for Notebook LM.

[00:05:01] Paul Roetzer: I don’t know if you’d used it, but I, the first thing I did was took that beast of a report and threw it into Notebook LM. What was it? 270 pages, I think it came in at? 

[00:05:08] Mike Kaput: Yeah, it’s actually two hundred and ninety pages. It is a mammoth report from the World Economic For and it is called their Future of Jobs Report.

[00:05:21] Mike Kaput: this is a highly anticipated report they release regularly, and this one brings together perspectives from over a thousand leading global employers, and collectively, These employers represent more than 14 million workers across 22 industry clusters and 55 economies from around the world. Now, there are a ton of stats in here worth paying attention to.

[00:05:47] Mike Kaput: Like we just mentioned, go drop this into Notebook LM and query it for yourself. But there are some really big ones that struck us that are related to AI. So, this is kind of the money quote here. According to the [00:06:00] report, quote, Half of employers plan to reorient their business in response to AI. Two thirds plan to hire talent with specific AI skills.

[00:06:10] Mike Kaput: And 40 percent anticipate reducing their workforce where AI can automate tasks. Now, they are also looking to upskill existing talent where possible. In response to expected AI disruption, these respondents said that reskilling and upskilling of the existing workforce in order to have them work more effectively alongside AI, This was the most anticipated workforce strategy.

[00:06:35] Mike Kaput: By 2030, 77 percent of the surveyed employers plan to, implement some type of strategy like that to make sure their workers are effectively trained to work alongside AI. So, Paul, as we Dive into some of the stats here, like, that quote really puts it into perspective I think, like, especially that part [00:07:00] about the 40 percent of leading global employers anticipating reducing their workforce due to AI, like, does that sound pretty serious to you?

[00:07:09] Paul Roetzer: Yeah, so I mean, this is a, like we said, I would definitely put this into Notebook LM. It is the best way to interact with it, and kind of like get, you know, run, do your audio overview and listen to like the 10 minute version of this thing. But the thing I always look at in these reports is this is a, obviously a vast study, 14, representing 14 million workers is not insignificant.

[00:07:30] Paul Roetzer: But at the end, they do break it down by country. Like, you can drill in and go, like, I think page 214 to 215 has the U. S. data. So it takes its overall data, then it breaks it down. Now, the thing you always have to keep in mind with these kinds of reports is, they are relying on people who may not fully understand AI to answer questions about the impact of AI.

[00:07:53] Paul Roetzer: So it’s just like you have to always keep that in the back of your mind. Obviously, a lot of the people they interviewed may [00:08:00] have deeper knowledge of generative AI and different AI capabilities, but there’s a reasonable chance that people they’re interviewing don’t actually fully comprehend the state we’re in right now.

[00:08:09] Paul Roetzer: So, and we’ll kind of come back around to that theme throughout today’s episode. but the one thing I noted is just, I went to the United States pages, like I mentioned, page 214 to 215. And the question about, Share of organizations surveyed that identify the technology trend as likely to drive business transformation.

[00:08:28] Paul Roetzer: So AI and information processing technologies, Mike, as you alluded to, 94 percent in the United States. So it’s almost unanimous that everybody sees this as like the driver. Robots and autonomous systems. Now, keep in mind, it’s a diverse collection of industries. So if you’re in, you know, I don’t know.

[00:08:46] Paul Roetzer: Financial services, robots might not impact you, your definition of autonomous systems may or may not, you know, decide that you would say yes or no to this question. So you always have to keep that in context. there was quite a bit [00:09:00] about generative AI, and again, this is where notebook lm becomes very helpful.

[00:09:02] Paul Roetzer: Just, you can drop it in, let it do its processing, and then say, okay, talk to me about any generative AI highlights from the report. And it’ll pull those out, and it’ll highlight them and cite them, and you can click through and go look specifically at those sections. So that’s what I did. I did not read the full 290 page report.

[00:09:18] Paul Roetzer: But I’ll call this excerpt real quick because it shows you the uncertainty that is present within these projections as we look out the next five years. so the report says, while the full extent of long term productivity gains from the technology remains uncertain, workplace studies have identified various initial ways for generative AI to enhance human skills and performance.

[00:09:39] Paul Roetzer: Looking further ahead, some observers argue generative AI could empower less specialized employees to perform a greater range of expert tasks. expanding the possible functions of roles such as accounting clerks, nurses, and teaching assistants. then it goes on to say, however, without appropriate decision making frameworks, economic incentive structures, and possibly [00:10:00] government regulations, there remains a risk that technological development will be focused on replacing human work, which could increase inequality and unemployment.

[00:10:09] Paul Roetzer: It says, Gen AI currently remains limited in performing tasks that require physical execution, certainly, nuanced judgment or hands on application, skills rooted in human interaction including empathy and active listening and sensory processing abilities, and manual dexterity, endurance and precision currently show no substitution potential due to their physical and deeply human components.

[00:10:31] Paul Roetzer: So it kind of goes through and it’s trying to assess, like, what are the skills that are core now, what are going to be the skills of the future, which jobs are going to, like, increase, which jobs are going to decline. They did call out, a study, they looked at data from Coursera. And the report looked at data, I think that most of this research was conducted from May to August 2024.

[00:10:49] Paul Roetzer: So it’s relatively fresh data from research reporting standpoints. so they, in the Coursera data, they say, Coursera data generated for the Future of [00:11:00] Jobs report reveals significant growth and demand for generative AI training among both individual learners and enterprises. Demand for AI skills has accelerated globally, however, the drivers of demand differ.

[00:11:12] Paul Roetzer: in the United States, demand is primarily driven by individual users, whereas in India, corporate sponsorship, plays a significant role in boosting Gen AI training. Globally, individual learners on Coursera have focused on foundational Gen AI skills and conceptual topics such as prompt engineering, trustworthy AI practices, and strategic decision making.

[00:11:31] Paul Roetzer: So this is interesting because, as I’ve mentioned, I’ve been doing a lot of thinking around our own AI academy and our, you know, courses and certifications and things like that. And I was actually having this exact conversation with our team, last week. When I was sort of sharing the internal vision for where we’re going with this stuff, what we see, and we, we have, I mean, we’ve, our Intro to AI class has had over 25, 000 people, register for it.

[00:11:53] Paul Roetzer: We have, hundreds of members, I think over 500 mastery members at different times. our piloting AI [00:12:00] course is over 1, 500 learners, scaling as over 300, I think. So we have a decent sample size of our own data to look at. And what I’ll tell you is, It is a lot of individuals and corporations that are taking the initiative to learn this stuff on their own.

[00:12:14] Paul Roetzer: Sometimes, on their own credit card and on their own personal email account, they are paying for these things. Sometimes, they are getting supported by internal programs, funded by those programs. But it is, it is rare for us to have the conversations, and these are people often working at very large enterprises that are taking these initiatives on their own.

[00:12:35] Paul Roetzer: It’s rare that those conversations are coming in and saying we want to upskill our whole workforce. That, that hasn’t been what we’ve seen, at least in the United States yet. I think that that will shift in 2025. I believe that we are entering a phase where enterprises are going to realize the urgency to reskill and upskill their workforces.

[00:12:55] Paul Roetzer: So, I found it interesting when, when the report looked at, well, what are the [00:13:00] core skills today? And it’s interesting, they, they have like analytical thinking, resilience, flexibility, agility, leadership in social infants, creative thinking are sort of the top four. But then when they say, what are going to be the fastest growing skills in the next five years?

[00:13:12] Paul Roetzer: Number one, AI and big data. Number two, networks and cybersecurity. Number three, Technological literacy. Four is actually staying steady at creative thinking. So then it goes into, okay, which employers are planning to upskill their workforce? And it said 85%. So, okay, people get this. They, they then got into the human and machine factor.

[00:13:32] Paul Roetzer: So now, Combined, it says, proportion of tasks completed predominantly by technologies versus predominantly by people. Today, the combined is 52 percent by 2030. They see that rising to 67%. And then it gets into some of the fastest growing job titles. Now this is kind of where I’ll, wind up my thoughts on this.

[00:13:54] Paul Roetzer: The top fastest growing jobs, big tech, big data specialists, number one, number [00:14:00] two, FinTech engineers, number three, AI and machine learning specialists. Now, this is why I say you have to be cognizant of who’s answering the questions. So we have business leaders here who may not be in the know of what all the AI labs think the future looks like, and they’re the ones building it.

[00:14:16] Paul Roetzer: And so I think that there was an interesting, balance here because on the pod, Joe Rogan podcast last week, Mark Zuckerberg said, Mark Zuckerberg said a lot of things on the Roving Podcast we’re not going to bother getting into, but what he said that’s relevant here is, quote, Probably in 2025, we at Meta, as well as the other companies that are basically working on this, are going to have an AI that can effectively be a sort of mid level engineer that you have at your company that can write code.

[00:14:47] Paul Roetzer: Zuckerberg said Meta will reach the point where all of the code in its apps and the AI it generates will also be done by AI. So we have business leaders who are like, yeah, you know, like 40 percent are [00:15:00] impacted or like, you know, they think they’ve got time and they got to figure this out. And then you have the people in the AI research lab is like, Oh no, we, we won’t need as many AI machine learning specialists because the AI is going to do that this year, not 2030.

[00:15:11] Paul Roetzer: So there’s always this balance. And then they did have, how will your business respond to AI developments? the number one answer was 77 percent reskilling and upskilling existing workforce to better work alongside AI and then 69 percent hiring new people with skills to design AI tools and enhance appropriate, for the organization specific skills.

[00:15:32] Paul Roetzer: And then the third one was 62 percent hiring new people with skills to better work alongside AI. So, quick side note, I mentioned a bunch has already happened on Monday morning. OpenAI actually released their economic blueprint this morning, which I have not had time to get into, but it says OpenAI is releasing a new economic blueprint that lays out our policy proposals for extending America’s global leadership in AI innovation, ensuring equitable access to AI, and driving economic growth across communities.

[00:15:59] Paul Roetzer: As [00:16:00] AI becomes more advanced, we believe America needs to act now to maximize the technology’s possibilities while minimizing its harms. So, all that said, AI and the economy is off to a high profile start for the year, and I expect this to be a highly trending topic as we move forward throughout the year.

[00:16:20] Mike Kaput: Yeah, I found it interesting, too, that The report looked at on page 63, like barriers to AI adoption, which is also something we asked about in our state of marketing AI report. And the most common response at 50 percent of people was lack of skills to support adoption, which is not remotely surprising to us, Paul.

[00:16:40] Mike Kaput: That’s the top barrier four years in a row now. It seems very conservative. And it’s followed closely at 43 percent by lack of vision among managers and leaders. So basically validates exactly what we’ve seen in research. I also thought it was kind of interesting that that list of core skills and fastest growing skills, [00:17:00] obviously there is.

[00:17:01] Mike Kaput: Technical literacy, AI and big data, but a lot of these really sound to me like powerful soft skills. I’m not sure people are getting degrees on some of these. 

[00:17:10] Paul Roetzer: Yeah, that’s, and that’s the hard part when you hear interviews with like Altman and people like that, where they try and pin them down on this question.

[00:17:16] Mike Kaput: Yeah. 

[00:17:17] Paul Roetzer: Like, what should people study? What should my kids go to school for? It’s a lot of like, very soft answers. Soft skills and soft answers. It’s like, okay, well, what do you study to get those? And how am I going to monetize those? Like, what are the jobs I’ll be using those soft skills in? 

[00:17:35] Sam Altman’s “Reflections” and Bloomberg Interview 

[00:17:35] Mike Kaput: Alright, our second big topic this week.

[00:17:37] Mike Kaput: So, last week, if you recall, we touched on a recent essay written by Sam Altman. It’s titled Reflections. In it, he made some really striking predictions about AI. So this week, we wanted to actually expand on our discussion of that essay, since we only touched on it briefly last week. And then we also wanted to mix in some other comments Sam made to Bloomberg this past week.[00:18:00] 

[00:18:01] Mike Kaput: So, first, in Reflections, Sam revealed that OpenAI is now quote confident They know how to build AGI. He also said that because of this, the company is now looking beyond traditional AGI towards what he calls, quote, superintelligence in the true sense of the word. He basically believes superintelligent AI could dramatically accelerate scientific discovery and innovation beyond current human capabilities.

[00:18:29] Mike Kaput: He also predicts in this essay that we’ll start to see the seeds Of all of this kind of come together starting this year, he has repeated a couple of times now, both with Bloomberg and in this essay, that we’re going to maybe see the first AI agents join the workforce and materially change how companies operate starting this year.

[00:18:49] Mike Kaput: In Reflections, he acknowledged that these kind of predictions about superintelligence sound like science fiction to a lot of people. And he writes, quote, that’s all right. We’ve [00:19:00] been there before and we’re okay with being there again. We’re pretty confident that in the next few years, everyone will see what we see.

[00:19:08] Mike Kaput: So, in a new interview with Bloomberg, he echoed a lot of these talking points. He talked up how the company’s O3 model achieved a major breakthrough by passing the ARC AGI challenge. He repeated the prediction that 2025 is when we might see true AI agents join the workforce. And, not to mention, he talked a bit about his feud with Elon Musk and his controversial million dollar donation to President elect Donald Trump’s inauguration fund.

[00:19:37] Mike Kaput: So, Paul, we’re gonna take a couple pieces of this one by one, and first up, like, I’ll be honest, like, it is crazy to me. That we have gone so quickly from even speculating whether or not AGI is even possible, to Altman himself saying, basically, yeah, we know how to build it. He even went so far as to say in this Bloomberg interview, quote, it’s impossible to [00:20:00] overstate how non mainstream AGI was way back in 2014, right before they started OpenAI.

[00:20:05] Mike Kaput: He said, people were afraid to talk to me because I was saying I wanted to start an AGI effort. It was like, cancelable. It could ruin your career. So what changed? 

[00:20:17] Paul Roetzer: Yeah, you know, we’ve obviously been covering this topic all along the way. I think the models have gotten smarter. That’s changed. there’s been a lot more reports put out, evaluations done on the AGI spectr trying to assess kind of where we are.

[00:20:31] Paul Roetzer: And so I think it’s just become more commonplace. and I think the lab, they’re just talking about it more, and I thought it was really funny how this interview started. The OpenAI PR team obviously wants Sam out in front telling the story for some reason, because the reporter literally says in the article, your team suggested this would be a good moment to review the past two years.

[00:20:52] Paul Roetzer: Having spent a time in the PR world, that is a reporter, or that is a PR person, reaching out to a reporter and saying, hey, [00:21:00] Sam is available to talk, We think now is a good time to regroup this. And the reporter saying, okay, yeah, I’ll tell the story you want told, but I’m also going to ask him all this other stuff while we’re doing it.

[00:21:10] Paul Roetzer: That’s, but I’ve never actually seen a reporter actually write that up front and say, that’s why this interview is happening. 

[00:21:15] Mike Kaput: And they’re probably in the room or on the phone. Oh, 

[00:21:18] Paul Roetzer: there’s three PR people in the room. Like, trust me, you and I have done this before. so I don’t know, like in, I thought it was really interesting to go back to like the AGI not being sort of like taboo to talk about.

[00:21:29] Paul Roetzer: He kicks off the interview talking about how they recruited so much talent, like a density of like the best AI researchers in the world in those early days. And he said, the pitch was just come build AGI, and the reason it worked, and he, quote, I cannot overstate how heretical, is that heretical? It was at the time, to say we’re going to build AGI, so you filter out 99 percent of the world, and you only get the really talented original thinkers, and that’s really powerful.

[00:21:57] Paul Roetzer: So then, you know, his [00:22:00] Reflections post again, we talked about it a little bit last week, but we didn’t go into this Bloomberg article much, and there is just a lot of really interesting things in there. He retells the story of like his early dinners with Ilya and some of the formation of OpenAI. And so if you haven’t like heard the story of the early days of OpenAI, this is a reasonable representation of it.

[00:22:20] Paul Roetzer: Like I would read Genius Makers by Cade Metz too, that tells more of the story. but, so the dinner’s with Ilya Sutskever, who was one of the co founders and now has SAFE Superintelligence. He tells about taking over as CEO in 2019. He talks about the launch of ChatGPT, says, quote, I thought it was going to do pretty well.

[00:22:37] Paul Roetzer: The rest of the company was like, why are you making us launch this? It’s a bad decision. It’s not ready. And then he said, I don’t make a lot of, we’re going to do this thing decisions, but this was one of them. I actually, I think that’s an interesting moment, just from a leadership perspective, as the CEO and founder of multiple companies through the years, there is this fine balance sometimes as a leader where you do get [00:23:00] Committee thinking, like you involve people in it.

[00:23:03] Paul Roetzer: And then sometimes as a leader, you have, you have to trust your instinct and your vision, and you have to just do something. And so I thought this was an interesting moment because we will have, you know, books in business classes for years that will look back on the origins of open AI and how it was all done and the decisions that were made.

[00:23:21] Paul Roetzer: And so it was kind of cool to like hear that little bit of insight. He talks about the company structure, his firing. He does get into the thoughts on AGI. I find this kind of frustrating, honestly, like the way he talks about AGIt kind of drives me nuts because they’re the ones that have been pushing this concept, literally their mission statement since 2015.

[00:23:39] Paul Roetzer: And what is AGI? Well, when you ask Sam, this is the answer we get. Quote, I think AGI has become a very sloppy term. If you look at our levels, our five levels, you find people that would call each of those AGI. And the hope of the levels is to have some more specific grounding on where we are and kind of the progress is, where it’s going, rather [00:24:00] than is it AGI or is it not AGI.

[00:24:02] Paul Roetzer: So then the reporter says, well, what’s the threshold where you’re going to say, okay, we’ve got AGI now? Again, I would think OpenAI could answer this question. They’ve been asked a thousand times. and I think, So he said, the very rough way I try to think about it is when an AI system can do what very skilled humans in important jobs can do.

[00:24:18] Paul Roetzer: I’d call that AGI. Then there’s a bunch of follow on questions like, is it a full time job or part time? Can it start as a computer program or decide? And it just kind of goes into like, and then, and then it says, now we’re going to move the goalposts always, which is why this is hard. I’ll stick with that as an answer.

[00:24:33] Paul Roetzer: It’s like, stick with what as an answer that I, so I, so I guess if I go back to this, he is currently defining AI as. A system that can, AGI is a system that can do what very skilled humans in important jobs can do, which is not a great definition, but that is the definition that we are going with. there was also insight into the pricing of ChatGPT, which I thought was fascinating.

[00:24:56] Paul Roetzer: He said, we tested two prices, 20 and 42. [00:25:00] 42 being the Hitchhiker Guide to the Galaxy. Yeah, yeah. Fairly confident they picked 42 for that reason. But he said, people thought 42 was a little too much. They were happy to pay 20. So we picked 20. 

[00:25:11] Mike Kaput: You’re okay. 

[00:25:12] Paul Roetzer: And he said, it was not a rigorous hire someone and do a pricing study thing.

[00:25:16] Paul Roetzer: Yeah. For all 

[00:25:17] Mike Kaput: you data driven startups out there, sometimes people are just making it up. 

[00:25:20] Paul Roetzer: This is how decisions are made. It’s how brand names are picked. It’s how pricing models are picked. he gets into AI safety, roadblocks to progress, which I think their economic blueprint they published today probably is tied to this.

[00:25:33] Paul Roetzer: but he does say a lot about, like, their work in chip building and developing their own chips, and they’re going to have more to say on that this year. Fusion, he talks about being a huge thing, nuclear fusion, and the need to reduce, regulations around that, because that’ll help accelerate, energy in the United States in particular.

[00:25:51] Paul Roetzer: The Trump thing, he made a personal donation and the reporter called him out on that, like, you don’t share a lot of common beliefs with Trump, like, why would you make a [00:26:00] personal donation? And he said, I don’t support everything Trump does or says. I don’t support everything that Biden does or says, but I do support the United States of America, and I’ll work to agree I’m able to with any president for the good of the country.

[00:26:12] Paul Roetzer: I actually thought that was a really good answer. I thought, it’s like, okay, I could respect that answer. I think AGI will probably get developed during this president’s term, and getting that right seems really important, supporting the inauguration. I think that’s a relatively small thing. So basically he’s saying like the greater reason here is like we just have to do this together.

[00:26:30] Paul Roetzer: Like it’s a very important time. Gets into Elon Musk, gets into U. S. infrastructure and the need for that to be the focus of this current administration. So the, you know, I would definitely read Sam’s personal reflections post because it came as a result of this interview. the guy said, like you, you’ve, you know, written before, why haven’t you written in a while kind of thing.

[00:26:50] Paul Roetzer: And so he wrote the Reflections post as a result of this interview, and then the interview itself does cover, you know, quite a bit of topics. It’s a good read in Bloomberg. [00:27:00] 

[00:27:01] Mike Kaput: Waffling on AGI seems really strange to me since literally in reflections, he says, I think we know we’re confident. We know how to build it.

[00:27:08] Mike Kaput: Like, wouldn’t that, but we don’t know what it is. Assume a definition. 

[00:27:12] Paul Roetzer: It drives me nuts. The whole, 

[00:27:16] Mike Kaput: one last note here, like just very quickly, like, how confident are you in his, You know, he keeps talking up these agent predictions where in talking a few topics about some delays on the agentic front and open AI, like how confident are you that they’re going to be joining the workforce and kind of changing how companies operate starting this year?

[00:27:34] Paul Roetzer: I think they will within AI research lab companies and frontier companies. I think that they’re going to be heavily, heavy human in the loop. They’re not going to be like the autonomous AI agents that everyone envisions. but we talked about that on a recent episode with, you know, the state of AI agents.

[00:27:49] Paul Roetzer: It’s humans. Train them, humans figure out the data, humans do the integrations, they set, you know, they work with the AI to kind of create what the workflow is going to be, the AI [00:28:00] executes the workflow, the human oversees it to make sure it doesn’t screw up or get access to something it’s not supposed to get access to.

[00:28:05] Paul Roetzer: Human helps improve it. Like, I think there’s going to be just be a lot of human in the loop, but you’re going to be building a ton of these agents, formerly known as bots, but now calling them agents, that carry out a string of, of tasks. And so I do think that those are going to start to make an impact in, in some of these businesses.

[00:28:24] Paul Roetzer: I just, I don’t think they’re going to be as autonomous or as reliable as maybe they’re perceived to be. 

[00:28:31] Prophecies of the Flood by Ethan Mollick

[00:28:31] Mike Kaput: Alright, so our third big topic this week, kind of piggybacking on the aspects of this last conversation about Ullmann, Ethan Mollick just published an essay where he writes, quote, Recently, something shifted in the AI industry.

[00:28:45] Mike Kaput: Researchers began speaking urgently about the arrival of super smart AI systems, a flood of intelligence, not in some distant future, but imminently. He kind of calls these Signals, collectively, quote prophecies [00:29:00] of the flood, which is the essay’s title. Now what makes all this interesting, he says, is that these rumors and signals are not coming from the usual tech hype cycle, but often from researchers inside major AI labs who appear genuinely convinced we’re approaching a fundamental breakthrough, which we talked about a bunch last week.

[00:29:21] Mike Kaput: In our super intelligence segment. So he talks about some of the signals that we also discussed, things like OpenAI’s O3 model, achieving 87 percent accuracy on a test where even PhDs with internet access only scored 34 percent outside their specialty. It’s solving incredibly difficult math problems.

[00:29:41] Mike Kaput: It is performing well on the ARC AGI test. And it’s demonstrating fluid intelligence that can match or exceed human baselines. He also mentions we’ve started to see the emergence of practical AI agents. Mollick especially talks about Google’s Gemini with deep research [00:30:00] as a prime example. we’ve talked about deep research quite a bit.

[00:30:03] Mike Kaput: For instance, he asked deep research to research startup funding methods, it analyzed 173 websites, and produced a comprehensive 17 page report in minutes. So all of this, Mollick believes, are these kind of prophecies of this flood of superintelligence coming. But despite all that, he says we should kind of temper excitement with realism.

[00:30:26] Mike Kaput: So even if the labs are right about reaching AGI, he argues the pace of actual adoption and integration into society will likely be much slower than the technology’s theoretical capabilities. He also says that while AI researchers are focused on all the technical challenges around alignment and safety, there is way less attention being paid to how society should adapt to and shape the deployment of these technologies.

[00:30:53] Mike Kaput: So, Paul, like, one of the themes that kind of keeps coming up, in my opinion, in these types of essays and the [00:31:00] commentary from the labs, Seems to kind of fall into this bucket of like, very few people really understand what’s coming. Like, in your opinion, what is coming? Why do so few people seem to really get this?

[00:31:13] Paul Roetzer: Yeah, I actually saw a tweet this week from, or last week, from Vedant Mishra, who I’ve mentioned on the show before. He sold an AI company to HubSpot in 2017, which is when I got to know him. My agency at the time was still doing a lot of work with HubSpot, spent two years on reasoning at OpenAI, and now he’s a reasoning researcher at DeepMind.

[00:31:33] Paul Roetzer: So he tweeted, there are maybe a few hundred people in the world who viscerally understand what’s coming. Most are at DeepMind, OpenAI, AnthropicX, but some are on the outside. You have to be able to forecast the aggregate effect of rapid algorithmic improvement, aggressive investment in building reinforcement learning environments for iterative self improvement, and many tens of billions already committed to building data centers.

[00:31:57] Paul Roetzer: Either we’re all wrong or [00:32:00] everything is about to change. So, I think, you know, your question about, like, maybe why don’t people get it? He calls it out. Like, they, they don’t understand how fast these things are improving. They don’t understand the concept of, self improvement, recursive self improvement.

[00:32:15] Paul Roetzer: They don’t understand the value of reinforcement learning to make these models really, really smart in specific domains and then more generally. And they don’t comprehend how much money is already allocated over the next five years to building out these data centers, which as we talked about last week, are AI factories, they’re intelligence factories.

[00:32:33] Paul Roetzer: So when you take all that into consideration, now, Vedant was actually a closing keynote at our MAICON 2022 event. And I asked him in that session, why are you working on this? Like, cause again, AGI in 2022 wasn’t common conversation. And so I knew Vedant’s background. So not only did he built and sold an AI company, He, he was at Columbia University in Theoretical Cosmology, [00:33:00] Experimental Astrophysics, and Experimental Particle Physics.

[00:33:03] Paul Roetzer: This is a really smart dude. So, he could literally be doing anything in science and AI and business. Why are you working on reasoning and AI? And he said, just kind of to summarize, Because I believe a future of abundance is possible and AGI is how we get there. And so he said, like, there’s people like me who believe AGI is within reach and we want to build it.

[00:33:24] Paul Roetzer: We want to see it there. I say that for context because then Sam tweeted on January 10th, which I think goes to what Ethan is saying. So this is the tweet from Sam. Prediction. The O3 arc. So O3 is this model that sort of set off the forthcoming model that sort of set off all this conversation on superintelligence in the last three weeks.

[00:33:44] Paul Roetzer: The O3 arc will go something like this. One. Oh damn, it’s smarter than me. This changes everything. Ah. 10 minutes pass. 10 minutes pass. Two. So what’s for dinner anyway? Ten minutes past. Can you believe how bad O3 is and slow? They need to hurry up and ship O4. And I think that’s [00:34:00] what happens in like this world.

[00:34:02] Paul Roetzer: It’s like we have this insane alien intelligence. And like, it’s amazing. And then you just sort of go on with your life. And you just, like, forget how incredible it is. So I was, I was actually sitting this morning with my wife. I was trying to get ready and like, drinking my coffee and getting ready for this podcast.

[00:34:17] Paul Roetzer: And I was trying to like, conceptualize how to explain to someone. So I bounced this off of my wife. I was like, hey, would this make sense if I was just like, explaining this to you? Like, what’s happening? So, bear with me for a second here, Mike. Tell me if this makes sense. So, I think what’s happening is many leaders still struggle to grasp the capabilities and potential impact of our current generative AI capabilities.

[00:34:37] Paul Roetzer: So let’s take one person on your team. We could do this with any business. Mike and I have done this. Like, give me any business, give me any team member, any person in an organization. We’re going to assess what they do for their job. We’re going to take, like, the 80%. Like, what are the three to five things you do for 80 percent of your work?

[00:34:56] Mike Kaput: And 

[00:34:56] Paul Roetzer: then we’re going to build three custom GPTs and train them [00:35:00] how to use those GPTs to do what they do every day more efficiently. So let’s assume we take a single employee, we break down their job into tasks, and then we build three custom GPTs to help them do their job. You will unlock a minimum of 10 percent efficiency gains in their job within, I’m trying to be conservative here.

[00:35:21] Paul Roetzer: I’m going to say 90 days, but it probably within nine days, like this could happen fast. So I’m being intentionally conservative to prove a point. I think in many jobs today that could easily be 20 to 30 percent gains if they’re properly trained how to use these tools. So let’s play this out for a second.

[00:35:37] Paul Roetzer: Estimate. There’s 22 work days in a month on average, 21.76, I think, to be exact. and you work eight hours a day. Very few people actually only work eight hours a day, but we’ll use this for simplicity. So that’s 176 hours a month for a full-time employee, we’ll round that up to 180 for, for simplicity per say, a 10% efficiency gain would save 18 [00:36:00] hours per month.

[00:36:00] Paul Roetzer: Make sure I’m doing my math here, right, Mike? 

[00:36:02] Mike Kaput: Mm-hmm . 

[00:36:03] Paul Roetzer: Yeah. Per employee. One employee saves 18 hours. If you take a 10 person company with full adoption, we do the same process for 10 people. That’s 180 hours a month, or one full-time employee. A month has been saved by just doing this one exercise and a hundred person company.

[00:36:23] Paul Roetzer: That’s 1800 hours a month, or 10 FTEs in a thousand person company. That’s 18,000 hours a month or a hundred FTEs. In a 10, 000 person company, that’s 180, 000 hours a month, or 1, 000 full time employees. This is with today’s models. OpenAI hasn’t improved GPTs in over a year. They launched these things, they added a couple of, like, tweaks to it.

[00:36:50] Paul Roetzer: But if you give us OpenAI’s existing GPT capability, with their existing models, We could do this. Every single company and every [00:37:00] single industry, I can’t think of a knowledge worker we could drive 10 percent efficiency gains for. So, now you tell me how AI won’t completely disrupt the job market and the economy in the next two years.

[00:37:11] Paul Roetzer: The only way it doesn’t happen Is continued lack of understanding. We have an AI literacy problem. We talk about this all the time. People don’t realize GPTs can do this. That is that simple to build a GPT and assist your job. The other factor is human resistance to change. These may slow things down in some industries, but the tech can transform.

[00:37:32] Paul Roetzer: The probability of disruption is too high to do nothing because in this scenario, we just need fewer people doing the same work. So the way we think about it is like, everybody has this choice. You can keep. Doing what you’re doing, or you can accept that. You can change things and you accelerate your AI literacy and capabilities and you become kind of AI forward.

[00:37:52] Paul Roetzer: So, if you want to go through this exercise for yourself, just, this is why I created the JobsGPT, tool. So you can go to smarterx. ai [00:38:00] and, slash JobsGPT or just go there and click on tools. You can put your job title in there and it’ll break down for you the different ways you can use generative AI and it gives you like an exposure key.

[00:38:10] Paul Roetzer: I think this is critical stuff. Like this is, it is doable today. We’re doing it in our own company. I’ve said this before. We have eight employees now. We function like a team of probably 30 to 50 people in terms of what we’re able to accomplish in a day or a week. And every company can do the same thing.

[00:38:27] Mike Kaput: I love how you laid this out, not only the math, but also isolating what’s going on here, like, either people don’t understand the math, or don’t know this is possible, which is a lack of awareness, or like you said, they do know it’s possible, but there’s resistance, or there’s There’s not telling anybody.

[00:38:45] Mike Kaput: Right. It’s striking to me that this is the absolute baseline scenario that is A layup today, right to do, and it’s already showing in the numbers. That’s essentially [00:39:00] a 10% reduction in the amount of people you need for at least theory, the current stuff. So If you don’t produce more. I would be, that would be eye opening alone to me, especially if I was someone, understand, I understand the resistance, but, unfortunately, I think if you resist long enough, what’s going to happen is someone else is going to make the decision for you of how your continued employment, I would think.

[00:39:25] Paul Roetzer: It’s such a competitive advantage for the companies that think about this and say, wow, like, okay, let’s do that. Now, again. Our whole positioning is don’t get rid of those 10 FTEs or 100 FTEs, like go into new markets, create new products, pursue campaigns you didn’t have time to run, like everybody’s got more work than they know what to do with.

[00:39:44] Paul Roetzer: So have a plan, be proactive in redistributing, re skill, up skill, like we talked about in the first topic, and prepare those people to, to create additional value for the organization, don’t just look at it and say, cut. But. I’m also a realist that publicly traded, venture backed and private equity owned [00:40:00] companies will cut people.

[00:40:01] Paul Roetzer: That is inevitable. We’ve already, we’re already starting to see headlines this year of plans to not hire any more engineers, to reduce workforce from, and it’s going to be from tech companies first. That’s where we’re always going to hear about it. And so you’re starting to see that occurring already.

[00:40:17] The Law of Uneven AI Distribution

[00:40:17] Mike Kaput: All right, let’s dive into this week’s rapid fire. So first out. Paul, you back in March 2023 wrote this really impactful essay titled The Law of Uneven AI Distribution. In this essay, you suggested that the benefits of AI will not be equally shared across society. Instead, the value that people and companies get from AI will depend on three big factors.

[00:40:43] Mike Kaput: First, their understanding of the technology. Second, their access to it. And third, their willingness to accept it. Like, for instance, some enterprises still block employees from accessing things like ChatGPT, which limits the employee’s ability to use AI in [00:41:00] their job. Some educational systems are struggling to adapt curriculum to account for AI capabilities.

[00:41:07] Mike Kaput: That, in turn, limits how much value students get out of AI. So these kind of institutional decisions create really dramatic differences in how people experience and benefit from AI technology. Not to mention your own personal comfort can unevenly distribute benefits. If you’re willing to share more information and data about yourself or your company with AI, you’ll get more value out of it.

[00:41:33] Mike Kaput: So, in light of kind of our main topics this week and the rest of what we’re talking about in the rest of the rapid fire, this essay has been really top of mind. So we wanted to quickly revisit it. So Paul, as I was rereading this essay this morning, like, I have to say, this definitely really holds up for me.

[00:41:49] Mike Kaput: Like every line in this sounds as true or more true than when it was published. I guess my question is like, why is it so important to revisit this at this [00:42:00] moment in AI? 

[00:42:01] Paul Roetzer: Yeah, I just think it’s becoming more. obvious the companies that aren’t moving forward. And I think we’re now getting to the point, because I wrote this, what, two weeks before GPT 4 came out.

[00:42:11] Paul Roetzer: It was three months after ChatGPT emerged. I think we’re now starting to see it play out, the companies that aren’t moving forward, that aren’t developing and understanding through iLiteracy programs, that aren’t giving access to the technology, aren’t accepting some new risks that come with using this, they’re starting to now fall behind in their peer groups, with their competition in their industries.

[00:42:34] Paul Roetzer: And so I think it’s now just starting to play out, what we sort of theorized was going to happen. And so that post, again, we’ll put the link in the show notes and go read it. But the post ends with three actions you can take, and these still seem pretty relevant today too. The first is be curious and explore AI.

[00:42:47] Paul Roetzer: So however you learn best, books, podcasts, courses, videos, whatever it is, like, go seek that stuff out and start taking the next steps to learn this stuff. Two, figure out what data you, your family, your company, so in your [00:43:00] personal lives, you and your family and business side, your company, what you’re willing to give up in exchange for the convenience, personalization, productivity that comes with these AI tools.

[00:43:09] Paul Roetzer: So if your company isn’t willing to take on more risk, then you’re, and give up some level of security, then you’re kind of going to keep not having ChatGPT turned on in your company. Things like that. And then the third was consider your company’s policies and principles around that AI usage Transcribed And do what you can to ensure a balance between innovation and responsible application.

[00:43:30] Paul Roetzer: So yeah, I think it’s just good to like, it puts a framework to why aren’t all companies doing these things. And those three components of the law, you know, acceptance, access, and understanding are still as relevant today. And now we’re just seeing them play out. 

[00:43:45] Mike Kaput: And definitely something to also perhaps consider in your career.

[00:43:48] Mike Kaput: If you’re working for one of these companies that is restricting all these tools, you are probably going to be at a longer term disadvantage along with your company. 

[00:43:56] Paul Roetzer: Yeah, it’s hard to make the decision to change jobs, but if you look out over the next [00:44:00] three years and you do not see that your company embracing generative AI would seriously consider a career change.

[00:44:05] Paul Roetzer: Like it’s It’s going to get to the point over the next few years where if you have sat still, it’s going to become a problem. It’s not yet. You can go learn this stuff. You can, you can push within your existing company to get that AI council built, get some courses, you know, integrated in, get generated policy.

[00:44:22] Paul Roetzer: Like you can, if you feel like you can make change there, do it. But if you can’t, and no matter what you do, you’re just going to sit there. It’s going to be a problem in the, in the next one to three years for your career. 

[00:44:35] Notes on the State of AI in the Enterprise from Box CEO Aaron Levie

[00:44:35] Mike Kaput: Our next topic, Box CEO Aaron Levie, shared some really interesting observations in a thread on X about how AI is transforming enterprise technology.

[00:44:45] Mike Kaput: And this is based on a bunch of recent meetings he had with dozens of leaders at those companies. So, really briefly, here’s kind of what he says he’s seeing. Number one, the AI first enterprise is emerging. He says companies are starting to think through [00:45:00] how entire functions get reimagined in a world of AI.

[00:45:03] Mike Kaput: Number two, enterprises want choice in their AI stack. They increasingly want flexibility in using different models that are good at different things. Number three, we need more interoperability in AI, especially with AI agents, once those really come online. We’ll need AI systems that are much better at talking to each other.

[00:45:22] Mike Kaput: Number four, your AI stack will define who you can hire, kind of to the point we just talked about. He says AI will actually define employee choices in the future, with more AI native employees simply expecting that their company will enable them with AI to be as productive as possible. Number five, the role of IT will change tremendously.

[00:45:42] Mike Kaput: Agents will make IT increasingly responsible for actually getting work itself done, versus just deploying and maintaining software that enables the workforce. And last but certainly not least, number six, it is still in his mind, quote, insanely early. In his perspective, it [00:46:00] is inevitable that every enterprise will be transformed by AI, but this is going to take time.

[00:46:06] Mike Kaput: So Paul, he ends by kind of saying overall, this is the most energized he’s seen enterprises in nearly two decades of being in enterprise software. It’s very exciting. We’re on the cusp of major changes to how business and work happens in the future. Now, all of this is awesome, and definitely we’re seeing this kind of motivation among enterprises, but we’ve also seen, like, how slow this can kind of be and how long this can take, like, this’ll probably take a little time, no?

[00:46:33] Paul Roetzer: Yeah, I don’t, I’m, so, I think it’s a really good post, I think the Energize thing is interesting. I don’t know who, like, it depends on who you’re talking to. I don’t know that Energize would be the first word I would use to describe most enterprises we talk to about this stuff. Overwhelmed, uncertain would probably be like one and two.

[00:46:52] Paul Roetzer: Energize might fit in there for a couple of people within the teams, but it’s usually not the whole team or the whole company. I hope that shifts. [00:47:00] Like, I hope the people he’s talking to is what we start hearing more of. couple of quick thoughts. The number four, I think this is going to be a major issue for companies.

[00:47:10] Paul Roetzer: I think you’re going to have the next crop starting this year with graduates. It probably started a little bit last year, but I think more so this year, you’re going to have graduating, college kids who do not want to go work for companies that don’t allow them to use ChatGPT, like it’s just, you, you get so used to it in your schoolwork.

[00:47:29] Paul Roetzer: The idea of going to work for a company where you’re not allowed to use AI, that’s like a non starter for a lot of this talent. And that may actually be what we need. to trigger faster adoption within enterprises when they realize, like Sam said in the beginning, where do you get the top talent? It is certainly not by shutting off access to generative AI tools.

[00:47:46] Paul Roetzer: So that’s going to be a trend that HR department is going to have to deal with very quickly. Number five, I worry about, honestly, this idea that IT is going to like build or, or AI agents and they’re going to start controlling [00:48:00] like how the workforce is done and we’re going to be less reliant on HR people and more reliant on IT.

[00:48:03] Paul Roetzer: That’s terrifying to me. Like. I don’t think it is the right group that should be dictating like AI agents and what the org chart looks like. So I think that’s a very unclear role, like how that’s gonna play out in different companies. But I do see it probably wanting more control when the AI agents are part of the org chart, and I think that’s gonna create a lot of friction in companies.

[00:48:26] Paul Roetzer: And then number six, that were insanely early. I 100% agree with that. We say this all the time. People look around and they think that they’re behind their competitors and that everybody else has this figured out. They don’t. Like, there are so few companies that actually have this all figured out. So I think we are absolutely still early.

[00:48:43] Paul Roetzer: and I think, you know, all six of his points are worthy of note. 

[00:48:47] Why OpenAI Is Taking So Long to Launch Agents

[00:48:47] Mike Kaput: Our next topic is about open AI and AI agents. So, OpenAI is taking a notably cautious approach to launching its AI agents according to some new [00:49:00] reporting from the information. Now, this has led to delays in the releases of OpenAI agents and agentic capabilities.

[00:49:08] Mike Kaput: However, the information says the company may finally release its computer using agent software as early as this month. So what’s been behind the delay so far? One primary concern, according to the information, is prompt injection attacks. AI agents are designed to automate complex tasks by taking control of your device.

[00:49:29] Mike Kaput: So, things like going to make an online purchase or editing a spreadsheet for you. But there is a big security concern related to these activities. So, just for example, imagine An AI agent searching for an outset for you for your holiday party, but they accidentally land on a malicious website that tricks it into forgetting its original instructions and instead stealing your credit card information.

[00:49:53] Mike Kaput: This is an attack known as a prompt injection. The information says it’s been particularly worrying for [00:50:00] OpenAI. Now what’s really fascinating here is that competitors like Henthropic and Google have already started to launch versions of their own computer usage or computer using agents, where OpenAI has been the most hesitant one, focusing on developing all these additional safeguards.

[00:50:18] Mike Kaput: That seems really striking to me, Paul. Like, out of these big three, OpenAI, Google Anthropic, OpenAI is the one I would probably classify as most likely to like move fast and break things. but they’re the one that’s holding off the most on AI agents like Google and Anthropic. Why are they the first ones putting this technology out into the world?

[00:50:37] Mike Kaput: I mean, they talk so much about safety and alignment. 

[00:50:42] Paul Roetzer: Yeah, s m, a couple of thoughts here. So one, you know, it’s so interesting. We start off with OpenAI has taken a notable and cautious approach to launching its AI agents. In this context, we are talking about the original meaning of AI agents, which was computer use, meaning it sees and understands what’s [00:51:00] happening on your screen, whatever device that is, and it can take action as you explained, Mike, in that example.

[00:51:05] Paul Roetzer: Right. That was what we used to mean by AI agents. Then, then we’d like. turned it into whatever it’s become today. That any AI system that can take any action, basically. So, it sounds like they’re specifically talking about the computer use form of an AI agent here is why I give that differentiation. I think Anthropic came to market first, and we talked about it at the time they did it, which I think was in the fall, if I remember correctly, it was like October, November, we talked about it on the podcast.

[00:51:32] Paul Roetzer: And I said at the time, I thought it was very odd that Anthropic, the one who’s supposed to be most safety conscious and aligned, was the first to market.

[00:51:44] Paul Roetzer: Simplified explanation of why is they were trying to raise billions of dollars, and they needed to demonstrate the technology. Now, their technology is not connected to the internet. It can’t really do anything. Like it was just basically a public demonstration. Google’s is a little bit [00:52:00] different, I think.

[00:52:00] Paul Roetzer: I haven’t personally tried it yet, but it’s like attached to the Chrome browser and it can do some stuff. But like, neither of them have rolled out full blown computer use AI agents. We are not there yet. I don’t know, like, it may just be that OpenAI was trying to get all their 12 days of shipments ready, and they were trying to do Sora, and they were trying to do the O1 model, and they knew this stuff doesn’t actually work, and they prioritized computer, like, the compute power to the things that they thought worked and that they needed to get to market that people could actually use.

[00:52:33] Paul Roetzer: Like, I may be wrong, but that’s my best guess here, is OpenAI knows this stuff doesn’t work yet. It’s way too risky and they wanted to put their limited, you know, capability or capacity for compute power to work on Sora and O1 and probably training O3 and maybe Orion. Like they just, and maybe Orion, maybe GPT 5 has computer use baked into [00:53:00] it.

[00:53:00] Paul Roetzer: Like maybe, maybe that’s why that’s taking so long is like, they’re actually going to come to market with a full blown computer use that actually works. I don’t know. 

[00:53:11] CES + AI

[00:53:11] Mike Kaput: So next up, this year’s CES, Consumer Electronics Show, just wrapped up at the end of last week, and it should come as no surprise, AI dominated the show, but actually not really in the way you might expect, because Forbes noted that AI was quote, both everywhere and nowhere.

[00:53:29] Mike Kaput: It was everywhere because all these companies talked up how AI enabled their products work. But it was nowhere because there weren’t nearly as many like visual demonstrations on AI, according to Forbes, like something you might see for more flashy technology like VR or AR. To be sure, AI was powering many of the products seen at CES, but behind the scenes.

[00:53:51] Mike Kaput: It just wasn’t stealing the spotlight with flashy demos and experiences. However, an AI related player did [00:54:00] steal the spotlight. NVIDIA CEO Jensen Wang gave this Big 90 minute like stirring keynote that covered a huge amount of ground in AI. He unveiled NVIDIA’s next generation Blackwell GPU architecture, introduced a new series of graphic cards, which deliver twice the performance of their predecessor, and then he detailed NVIDIA’s industrial scale AI initiatives, particularly the Blackwell AI supercomputer system.

[00:54:27] Mike Kaput: This is a system that is in production across 45 factories worldwide, and It combines 72 Blackwell GPUs to create what NVIDIA calls an AI factory. Hwang also announced Cosmos, their first found world foundation model. This is for physical AI and robotics. It’s trained on 20 million hours of video and designed to understand real world physics and environments.

[00:54:54] Mike Kaput: And it’s an open source platform that aims to do for robotics and industrial AI what Meta’s Llama [00:55:00] has done for enterprise AI. As if that wasn’t enough, Long introduced Project Digits, a compact AI supercomputer powered by their GB110 chip. And this is a desktop sized system, scheduled for release around May, that brings supercomputer class AI capabilities to individual users and developers.

[00:55:25] Mike Kaput: Now, Paul, there is an overabundance of hype in AI generally, tons of hype at CES, so we kind of wanted to focus just on Jensen’s keynote here. NVIDIA is one of, if not the most important company in AI, so his vision for where we’re going is definitely a strong indicator of the future, since him and NVIDIA are building it.

[00:55:47] Mike Kaput: You’re a longtime watcher of NVIDIA and Jensen, like, did anything jump out at you here at about CES in general, and about his announcements specifically. 

[00:55:58] Paul Roetzer: I expected way more [00:56:00] buzz on Twitter slash X than I saw. Cause I, you know, I wasn’t like, looped in every minute to what was going on at CES, and usually within, you know, my notifications and the lists I have, the stuff that matters would bubble up, and I saw almost nothing on CES last week.

[00:56:15] Paul Roetzer: It was weird, like, oddly quiet. You know what’s 

[00:56:17] Mike Kaput: interesting there is, In one of the articles we have linked in the show notes here, Someone mentioned like halfway through a bunch of people had to leave because of the L. A. wildfires. Oh, really? Going back home. so that’s possible that that was overshadowing it, but I agree.

[00:56:32] Mike Kaput: I didn’t see nearly enough, even when doing research. I was like going through posts on X and stuff. It was, it was weirdly muted. 

[00:56:39] Paul Roetzer: And quick side note on that. My goodness, the, you know, thoughts go out to everyone affected by that. We have one of our employees is out in L. A. Not, not directly impacted, but right on the outskirts.

[00:56:49] Paul Roetzer: And. We’re watching, you know, paying close attention, like everybody else, this ongoing situation, just so tragic. It’s like so hard to comprehend what happened there. Like, just look at these pictures, and I [00:57:00] just can’t comprehend. And now, like, everything that’s going to be into, like, the rebuild for the years ahead.

[00:57:04] Paul Roetzer: So just Yeah, anybody out there has been affected, you personally, your family, your company, we’re certainly thinking of you and, you know, hopefully figure some stuff out and we can get rebuilt quickly out there. So, you know, back in the CES, yeah, there just wasn’t much at all, And I think with Jensen, like, you know, a lot of the stuff you just went through, Mike, it’s, it’s pretty technical, geeky stuff, like the average business person’s kind of like, what, like, what did any of that mean?

[00:57:33] Paul Roetzer: Jensen talks to developers and he talks to people who buy billion dollar data centers. So like when Jensen’s doing talks, he’s, he’s, his audiences are people who are going to buy the next hundred thousand GPUs. he is the guy and his company is the company. That everyone building the AI depends on, and so why it matters to, to anyone listening, [00:58:00] if you don’t follow NVIDIA or Jensen closely, trust me, everyone who builds AI does.

[00:58:06] Paul Roetzer: And so anything he says matters to those people, anything he introduces matters to those people. May seem abstract to us this moment, but two years from now, you’ll look back and say, Oh, okay. So their data set that trains like physical real world models, like that actually enabled this whole crazy frontier we’re now entering.

[00:58:26] Paul Roetzer: That’s how this all goes. Jensen made a bet on GPUs powering AI two decades ago, and he was right. And, so anytime he’s. Sort of sharing his visions for the future, you gotta pay attention to what he has to say. 

[00:58:41] AI Startup Anthropic Raising Funds Valuing It at $60 Billion

[00:58:41] Mike Kaput: Our next topic is that AI startup Anthropic is poised for a new, massive funding round that would make it one of the most valuable private companies in the us.

[00:58:52] Mike Kaput: So the company has reportedly in advance talks to raise $2 billion in a deal that would value it at $60 billion. This [00:59:00] is more than triple. It’s previous valuation of 18 billion last year. This funding round is led by Lightspeed Venture Partners and would make Anthropic the fifth most valuable US startup behind only SpaceX, OpenAI, Stripe, and Databricks.

[00:59:18] Mike Kaput: What makes this really interesting is Anthropic’s revenue figures. The company is now generating 875 million about in annualized revenue primarily from business customers of Claude. Now, that’s impressive, no doubt, but it is also a lot less than OpenAI, which projected 3. 7 billion in revenue for 2024. So, Paul, this seems like a pretty big funding round, but can Anthropic keep up with the enormous amounts of revenue and capital that OpenAI has, Google already has at their disposal?

[00:59:55] Paul Roetzer: Yeah, I feel like we’ve been talking about this funding around for like three months. I don’t, it’s just like, this hasn’t happened yet, like, officially. Yeah, they’re [01:00:00] 

[01:00:00] Mike Kaput: trying to get it across the finish line. Jeez, 

[01:00:02] Paul Roetzer: oh man. Um. I don’t know. They’ve been oddly quiet lately. You know, we’ve heard that they had issues with their training run on Opus, their biggest model that, you know, didn’t work right and they had to go back and fix some stuff.

[01:00:14] Paul Roetzer: they just haven’t been, I mean, we’ve been surfacing them as much on the podcast lately. I would expect that will change. you know, I think that they’re probably going to have some big stuff coming out here soon. I don’t know. I feel like at some point. They’re going to have to pick, I say, I use the word niche lightly here.

[01:00:35] Paul Roetzer: Niche might be something very large. I don’t know that they’re going to be able to, like, truly compete with OpenAI. but I don’t know. I’m not, I will admit I am not the biggest Anthropic user. I have an account, I’ll test it from time to time, but I don’t really use Claude that often. I know people love it.

[01:00:56] Paul Roetzer: Um. I just don’t know how it’s differentiated, honestly, [01:01:00] like I think it’s more the personality behind it. And supposedly it was their like AI safety alignment. But as we’ve talked about the podcast before, that was not actually why they created Anthropic. Like they, they started messaging around being more like AI safety centric.

[01:01:13] Paul Roetzer: And I think they maybe do some more research than most there, but they created it for capitalistic purposes. Like they saw an opportunity to leave open AI, their founders. Build something at the stage we were at in frontier model development, and that’s what they did. So, I don’t know. It’d be interesting.

[01:01:28] Paul Roetzer: I still don’t, it would not shock me at all if Anthropic got acquired. I think that they’re, they’re ripe for acquisition. And not just an acqui hire like some of these AI companies that have basically just ran out of money and didn’t have revenue model. Anthropic’s a real company with real revenue and a ton of talent, and I think they could get acquired for a massive valuation.

[01:01:50] Paul Roetzer: unlike like an inflection AI where they just basically had to like, You know, hand over the company and go over to Microsoft. 

[01:01:57] Mike Kaput: Yeah, and a note there, obviously they would be [01:02:00] an interesting acquisition target for any of the major players, but they have a very close, very, richly funded relationship with Amazon.

[01:02:08] Paul Roetzer: Yeah. And Google’s got some money in there. Everybody’s got money in there. But yes, Amazon is their, their big guy, the big supporter. 

[01:02:16] Trump Announces $20B Foreign Investment in New US Data Centers

[01:02:16] Mike Kaput: Alright, our next topic is that a major foreign investment in U. S. data infrastructure has just been announced. So, President elect Donald Trump revealed a 20 billion commitment from Dubai based developer Hussein Sejwani and his company Damac Properties.

[01:02:34] Mike Kaput: This investment will fund new data centers across eight states in its first phase, including Texas, Arizona, Oklahoma, Louisiana, Ohio, Illinois, Michigan, and Indiana. According to Trump, this investment could potentially double beyond the initial 20 billion commitment. Sajwani is an Emirati billionaire, longtime Trump associate.

[01:02:54] Mike Kaput: He indicated that November’s election results influenced this decision, saying his [01:03:00] company had been waiting for four years to increase our investment in the U. S. to very large amounts of money. This follows a pattern of foreign business leaders pledging major U. S. investments following Trump’s victory.

[01:03:13] Mike Kaput: One big one was that in December, SoftBank CEO Masayoshi Son announced plans for a 100 billion investment aimed at creating 100, 000 jobs during Trump’s term. So, Paul, this kind of ties back to one of our main topics. Sam said in his interview with Bloomberg, one of the most helpful things the Trump administration could do for AI in 2025 is US built infrastructure and lots of it.

[01:03:38] Mike Kaput: It sounds like this is along those lines. Like, how does this fit into what we should expect? from the Trump administration on AI. 

[01:03:47] Paul Roetzer: It’s all about infrastructure moving forward. We’ve been talking about this a lot on the show. We’re going to talk about it a lot more as part of our road to AGI, series that’s coming up, chips, data centers, energy, like that’s, and then there’s this [01:04:00] whole issue we don’t really talk much about is the labor to produce all of these things.

[01:04:03] Paul Roetzer: We don’t have enough electricians is a major issue. we had Microsoft episode or two ago. We talked about them committing 80 billion this year for this kind of stuff for infrastructure buildout. This is, it is the story of the U. S. economy over the next decade, is how fast can we build out the infrastructure to enable the superintelligence that these AI people envision building.

[01:04:30] Paul Roetzer: And, like, you’re But if you’re ordering these things now, like you’re, you’re looking out three to five years, like you’re trying to get in line to buy enough chips, to buy enough data centers, to build enough energy supply to do these things. Like they’re not planning for 2025 data centers. That’s all probably been acquired and bought.

[01:04:48] Paul Roetzer: You got the land. We’re now building for like 27 to 30 when they think AGI will be here and we’re on the path to super intelligence. That’s what we’re talking about now is like, how do we position [01:05:00] ourselves? To own that globally. 

[01:05:03] Mike Kaput: That’s a decently high confidence bet too, given how intense these projects are.

[01:05:07] Mike Kaput: It’s not just like pumping a bunch of money into a stock that you, that’s liquid. Like this is so much in advance. You have to be somebody, yeah. Somebody feels like they know what they’re doing. 

[01:05:17] Paul Roetzer: Yep. Yeah, it’s, and then you’re making some bets on, you know, is Sam right? Is nuclear fusion going to be a thing?

[01:05:22] Paul Roetzer: And where do you make the bets on, on fusion? and then all this is, you know, under the issues of security, like cybersecurity and the different risks related to this. And it’s just such a massive area of interest. And that’s why I said, like, we’re going to have a whole separate series of podcasts that really Dives into these because we need to go much deeper on these topics and bring in outside experts to talk about them And that’s the vision for the Road to AGI podcast series that will, you know, be launching soon.

[01:05:52] Grok/xAI Updates

[01:05:52] Mike Kaput: Next up a few quick announcements from Grok slash X sla/X/XAI thisirst, [01:06:00] X announced a major overhaul of its premium subscription service. There are three tiers now, Basic, Premi and Premium Plus. Basic starts at 3 a month monthly. Premium is 8 monthly. Premium Plus starts at 22 a month. Each tier comes with a bunch more features, Premium Plus offers almost entirely no ads in its experience.

[01:06:23] Mike Kaput: And importantly, Grok, which is X’s AI chatbot, is available to Premium and Premium Plus subscribers. All these changes took effect for new people joining the platform in December 2024. Existing subscribers will transition to the new pricing structure in their first billing cycle after January 20th, 2025.

[01:06:44] Mike Kaput: Second, XAI just launched a Grok iPhone app in the U. S. Grok as a tool is now free for all users, not just X premium subscribers, and this app can now pull real time information, answer questions, and generate images. While [01:07:00] XAI is working on a dedicated Grok. com website, there’s no word yet on an Android app.

[01:07:06] Mike Kaput: Last but not least, a notable Tesla watcher online is named Sawyer Merritt. He routinely breaks Tesla news on X. He posted this past week that Grok is launching soon in Tesla vehicles. He posted a link to a live stream where Musk mentioned, quote, Grok in Teslas is coming soon, so you’ll be able to talk to your Tesla and ask for anything.

[01:07:28] Mike Kaput: So Paul, I’m especially interested in your thoughts on Grok inside Tesla. Like, that seems to kind of validate what you’ve talked about a bunch of times on past episodes, that AI is really what links all these companies together. 

[01:07:41] Paul Roetzer: Yeah, so the Grok team is working really hard to get people to switch from ChatGPT to Grok.

[01:07:46] Paul Roetzer: Like if you follow any of their team on XAI team on Twitter, that’s all they’re tweeting is like, what do we need to do to get you to switch from ChatGPT? So like they’re, Elon is now not only suing OpenAI, he’s like going full force right at their user base or trying to. yeah, so the Grok [01:08:00] and Tesla things, I did talk about that in the fall.

[01:08:02] Paul Roetzer: I was saying like, I realized that that was like the distribution channels out in the Optimus robots is kind of where they’re envisioning going with this. So, for anybody who hasn’t been in a Tesla or used their current voice system, it sucks, it’s like the Siri of cars, basically, like, you can ask it to open the glove box, you can ask it, apparently, to change the heat, I didn’t even know you could do that.

[01:08:22] Paul Roetzer: You can talk to it and ask it to like, you know, navigate to X kind of thing. No pun intended. Navigate to this location. And then I saw somebody tweet like two weeks ago that there’s like 40 other prompts you can apparently use. I had no idea. So I’ve only ever asked it for like three things. You can’t close the glove box though, which drives me crazy.

[01:08:39] Paul Roetzer: I can do a light show with my car, but I can’t close my glove box. anyway, so. The thing I’m anxious to see, so I can, I can envision very easily, just like I talked to my advanced voicemail in ChatGPT through my car. So I’m driving, I just opened that up and I’m talking through Bluetooth basically to, to ChatGPT.

[01:08:58] Paul Roetzer: I could see very simply how they’re just going to make [01:09:00] it. So like you just hit the Grok button and now you can talk to Grok the same way I would talk to ChatGPT. The interesting thing becomes if Grok is integrated into the car systems. So if I can actually, when I’m going to point A. Say, Hey, Grok, like actually turn here because this is, I want to go through the valley and it’ll turn and like, take me to that.

[01:09:18] Paul Roetzer: You do, you cannot do that right now. You cannot interact with it or say, Hey, Grok, I see a cop sitting up ahead. You’re speeding, slow down. Like, that’s what I’m trying to, to understand. Like, are they going to actually allow you to interact with the car and have the car do things? Because if you envision this robo taxi world they’re seeing where there’s no steering wheel and no pedals, How am I going to tell the car what to do if it’s doing something wrong?

[01:09:41] Paul Roetzer: This is almost essential that Grok becomes a key component of the full self driving, that I can actually talk to Grok and tell it what’s happening, or tell it what to do if I don’t have a steering wheel. So, I’ll be fascinated to see how quickly they push it in, but I would imagine phase one is going to be, I just have a chatbot in the car that I can talk to, not [01:10:00] a system integration.

[01:10:02] AI Researcher François Chollet Co-Founding Nonprofit to Build AGI Benchmarks

[01:10:02] Mike Kaput: A couple final topics here as we wrap up. So, one topic that we’ve been tracking is that Francois Chollet, who is a prominent AI researcher, former Google engineer, is taking his work on AI benchmarking to the next level. He is co founding a new non profit called the Ark Prize Foundation. This organization aims to develop better ways to test whether AI systems have human level intelligence.

[01:10:29] Mike Kaput: This foundation will be led by former Salesforce Engineering Director Greg Comrad, and it builds on Suleyman’s previous work, which we talked about a lot last week and a little this week, on the ARC AGI test. This is a test he created in 2019 as a bunch of puzzle like problems that require AI to adapt to new situations they haven’t encountered in their training.

[01:10:52] Mike Kaput: This may sound familiar because we’ve talked a couple times about OpenAI’s Go3 model performing better on this test than humans. So it [01:11:00] effectively, like, passed the test. It’s the first time an AI system has done that. In other words, better tests are now needed since AI is advancing so rapidly. Paul, if you went back in time and told us, like, midway through 2022, that we would need to invent new AGI tests because a model outperformed one of the top ones, honestly, like, I would have expected it at some point, but I would have thought you were crazy with this timeline.

[01:11:28] Paul Roetzer: Yeah, I mean, it was inevitable. Like, it’s just, the whole thing, and again, I learned this a long time ago. Like, when, when Google, DeepMind won at AlphaGo, like, when they created AlphaGo and won at the Game of Go, they That was considered impossible in, you know, 2016, I think that happened. it was, it was considered impossible.

[01:11:47] Paul Roetzer: And Yann LeCun was on the record like a week before it happened saying it was going to be at least a decade. Yann LeCun, Meta, who currently is saying we’re not going to get to AGI any time soon. So Yann’s been wrong before. and so the [01:12:00] DeepMind team did the thing that they didn’t think was going to be possible.

[01:12:02] Paul Roetzer: So this is what always happens. Like benchmarks are established, AI research labs build teams to, to achieve that benchmark. And then we do it. And then like, oh, that wasn’t AGI, like onto the next one. And so it’s this constant thing. And so what I would continually reinforce for people is. Do not get caught up in definitions of AGI, whether or not it’s been achieved or not, what the next benchmark is, like, we pay attention to stuff because it matters and the labs are following it, but at the end of the day, the only thing that matters to you is how much of your job can AI do right now, and how much is it going to be able to do 12 months from now.

[01:12:37] Paul Roetzer: If you’re a leader in a company, you have to ask those same questions of your team. That is all that matters, because whether it’s AGI or not. If you take a writer or an editor or an accountant or a lawyer or whatever it is, a consultant, and you look at their job, and AI can assist, like, 50 percent of the time in 50 percent of the tasks, that matters right [01:13:00] now.

[01:13:00] Paul Roetzer: That is a significant thing. Go back to what I started at the beginning, like, even if you just achieve 10 percent efficiency gains. So the only evaluation that matters to you is how much of your job, the tasks that make up your job, can AI assist with. And then we have like the human to machine scale I created years ago looks at like, how automated is it?

[01:13:20] Paul Roetzer: Is it level one where it’s still mostly the human or is it level three where it’s mostly the machine? Like, this is a task where the machine’s actually doing like 80 percent of what I used to do for this task. That is all that matters. Go to, go to the jobs GPT, go to smarterx. ai, go to jobs GPT, put your title in.

[01:13:38] Paul Roetzer: It will do this for you. Like, you don’t even have to spend a bunch of time thinking about this. Just go in and assess it. That’s the only evaluation that matters to you. 

[01:13:46] Why Businesses Are Skipping Open-Source Models

[01:13:46] Mike Kaput: Our last topic this week. Despite the availability of free open source AI models, Businesses apparently are increasingly choosing to pay premium prices for proprietary solutions from companies [01:14:00] like OpenAI and Anthropic.

[01:14:02] Mike Kaput: This comes from some new reporting from The Information. So both OpenAI and Anthropic saw their revenue grow by more than 500 percent last year, even as free alternatives from Meta, Mistral. ai, and others became widely available. Now, this was not what many industry experts actually expected. Companies like Databricks and Snowflake had bet heavily that their enterprise customers would prefer open source models.

[01:14:27] Mike Kaput: Which, theoretically, offer more flexibility for customization and better security controls. So, what is driving this unexpected shift? I mean, in a word, it’s simplicity. Businesses have made it clear that they want AI solutions that work right out of the box, even if it means paying more or accepting some limitations in security features.

[01:14:48] Mike Kaput: Naveen Rao, who leads Databricks generative AI business, put it this way, saying customizing these models is quote, a little bit too hard for most companies. It requires a lot of [01:15:00] data engineering and cleaning to achieve good results. So both Databricks and Snowflakes actually have largely abandoned their efforts to generative AI models for customers.

[01:15:11] Mike Kaput: They’re instead turning to techniques like retrieval augmented generation. RAG to improve model performance without having to modify the underlying AI models themselves. So, Paul, like, based on what we were talking about, honestly, even like, I don’t know, like six months ago, this feels a bit of a 180. When we were seeing companies, you know, touting the benefits of open source for the enterprise, like, how does this compare to your experience?

[01:15:39] Mike Kaput: Speaking to, working with, consulting with enterprises. 

[01:15:42] Paul Roetzer: Yeah, I was fascinated by this, honestly. Like, I’m, I’m sure Zuckerberg and Meta would have a counterpoint to this, and I haven’t gone and, like, read up and seen if anybody has, you know, staked their counterpoints to it. but I mean, Meta’s betting the future on being like the Linux of AI models.

[01:15:56] Paul Roetzer: They think everybody’s gonna build on top of these things. [01:16:00] Honestly, like, my feeling was, I was uneducated in this because I didn’t see it. Like, if you go back to last summer into the fall, I would have, I would have bet everything on this being true. That people are not going to actually build on top of all the open source models.

[01:16:13] Paul Roetzer: And I have friends who, like, live in this world of data and technology who would, fight me on that issue. And so I was like, ah, maybe I’ll just, maybe it’s not my area of expertise. Like, I don’t, I don’t know, but I mean, having met with a lot of these enterprises and knowing it’s not going to be the IT department necessarily driving adoption, it’s going to be marketing or sales or service.

[01:16:31] Paul Roetzer: Like, no, we’re not waiting six months for you to spend 5 million with some consulting firm. To build a model, we’re gonna go get chat GPT right now and we’re gonna start doing this, right? And then like six months from now, you’re gonna take this away from us. Like we’re realizing massive gains, like no, we’re not using the model.

[01:16:46] Paul Roetzer: You just wasted all that money on. So I’m seeing the reality of this isn’t necessarily gonna be an IT driven decision all the time. It’s gonna be departments taking the initiative themselves to go get these models that don’t require it to be involved [01:17:00] and spin ’em up and start getting value in three days.

[01:17:03] Paul Roetzer: Versus three months or three years. So it actually seemed kind of obvious to me that people were going to lean on the proprietary models and not like go into the open source world. But again, I just assumed I was wrong. maybe not, I don’t know. So I will be really intrigued to watch this play out. I do not pretend like I have some, you know, unique insight here.

[01:17:23] Paul Roetzer: I think it’s just, I assume more business leaders are going to make these decisions, not IT leaders. And I’ve talked to enough business leaders that they want that simplicity thing. They just want to go and they want to get value. And by the time you start proving value of one of these models, like, why would you switch?

[01:17:40] Paul Roetzer: I don’t know. 

[01:17:41] Mike Kaput: Yeah, same as you. I can’t claim to be an open source expert by any means. It’s not my area of competency. But just based on seeing how much your average enterprise employee struggles to use out of the box tools, even just things like prompting or like, wait, AI is different than traditional software.

[01:17:58] Mike Kaput: Like, wait, how do I apply [01:18:00] it? And work with it to achieve my goals. I cannot imagine a custom built thing on top of an open source model is going to be somehow easier or better to use in a lot of those cases. 

[01:18:12] Paul Roetzer: Yeah. I don’t know. This is definitely one of those ones, like, when we’re out doing our talks and running workshops with enterprise stuff, I’m definitely going to have this conversation with people and just try and get a, like, qualitatively, like, where are we at, what are people thinking and saying?

[01:18:24] Paul Roetzer: because I’m, I’m very intrigued to see how this plays out. 

[01:18:31] Mike Kaput: All right, Paul, that is it for this week. Just a couple quick reminders. If you have not checked out our newsletter, go to marketingainstitute. com forward slash newsletter. Good luck. We round up all the news this week, including topics we did not get to in this episode.

[01:18:46] Mike Kaput: And if you have not left us a review, we’d really appreciate it. We use the reviews to get much better and improve the podcast. So if your podcast platform of choice allows you to leave a review, we would very, very much like to see you do that if you have not already. [01:19:00] Paul, thanks so much for breaking everything down this week.

[01:19:03] Paul Roetzer: I feel like we’ve been on this for an hour and 20 minutes. Like I’m, I’m like anxious to check Twitter and see like what has already happened and how much NVIDIA stock has fallen in the last hour and a half. All right. Thanks, Mike. Thanks everyone for being back with us. We will be back with our regularly scheduled episode next week.

[01:19:21] Paul Roetzer: Thanks for listening to The AI Show. Visit MarketingAIInstitute. com to continue your AI learning journey and join more than 60, 000 professionals and business leaders who have subscribed to the weekly newsletter, downloaded the AI blueprints, attended virtual and in person events, taken our online AI courses, and engaged in the Slack community.

[01:19:44] Paul Roetzer: Until next time, stay curious and explore AI.