JWSEJ W Salm Engineering, LLC

Why Your Business Needs Sovereign AI

Automatically transcribed from the supplied audio. Names, technical terms and punctuation may contain errors. The recording is the authoritative source.

I have a serious question for you today. What happens when the AI your business depends on completely disappears at 5.21 on a Friday? Well, imagine you run a regional logistics company, right? OK. Your trucks are out on the road. Your weekend dispatch is loading up the bays. And then suddenly your automated routing system

just throws a 403 forbidden error. Oh no, like a total system crash. Exactly. And it's not because you broke anything or because your IT guy tripped over a wire. It's because a massive server farm, like 3,000 miles away, triggered an automated policy review. Wait, so what happens to the trucks?

They simply don't move. They sit there for three days. Wow. And I'm guessing there is absolutely nothing you can do about it. Like you can't just call up customer service and complain. You just bleed revenue. Yeah, you just sit there and watch it happen.

Which is terrifying. And today's deep dive is actually built around this exact nightmare scenario. We are pulling apart a really comprehensive report written by John W. Somme, the third, a professional engineer. It is a really fascinating piece of work. It really is. And the core argument here is intense.

He argues that for medium to large businesses, treating cloud-only AI as your sole operating substrate is just a massive structural single point of failure. I think we should frame this carefully right up front, because the author is not advocating for some ideological tech purity here. This isn't some angry manifesto demanding. We smash the cloud and return to dusty, on-premise,

mainframe servers in a basement. It's a strictly architectural argument. Exactly. We are exploring this concept of sovereign AI. Which means having an independently executable AI capability, right? Yes. It's essentially a continuity layer.

You build this so that if the cloud evaporates, your organization's ability to actually function doesn't just vanish along with it. OK, let's unpack this. Because I think there is a huge illusion of ownership we have in the tech world right now. Oh, absolutely. You pay for an enterprise API, which for anyone listening,

is basically a digital pipeline that lets your company's software talk directly to a provider's AI model. Right, you wire that pipeline right into your daily workflows. Yeah. Your team relies on it, your products rely on it, and eventually you feel like you own that capability. But you don't. You really don't.

Cloud AI is purely conditional infrastructure. Conditional meaning they can just take it away. Yeah, you are leasing access to a very precarious pipe. And it's governed by the terms of service from these massive centralized providers, like OpenAI, Google Gemini, XAI. And no one actually reads those terms of service. No, nobody does.

But when you actually look at the fine print, those contracts explicitly reserve the right to suspend access for policy changes or automated safety triggers or even sudden legal directives. I mean, renting Cloud AI is basically like hiring a genius consultant who lives in a high security building.

That is a great way to look at it. Right. They're brilliant. They solve all your problems, but their landlord can lock the front doors at any moment. And it doesn't matter if you always pay your rent on time. It doesn't matter if you're in the middle of a critical project. If the landlord says the building is closed, you do not get to talk to your genius consultant. What's fascinating here is that we actually have a perfect example of the landlord locking the doors. The Fable and Mythos incident from June 12, 2026. Oh, man. That was wild. It was a huge wake-up call. So the US government issued an export control directive. And Anthropic was the company hosting those models, right? Yes. Anthropic.

They were legally ordered to restrict foreign nationals from accessing their Fable 5 and Mythos 5 models. Which I mean, that sounds straightforward on paper, but how does that actually work mechanically? On the internet, an IP address is a notoriously bad proxy for a person's actual citizenship. Well, that was the fatal bottleneck. Anthropic couldn't instantly verify the nationality of every single user hitting their API in real time. It's just an impossible technical problem to solve overnight. And the government wasn't going to just wait around for them to figure it out. No, because the legal penalty for noncompliance was so severe, they had to pull the plug globally. They suspended access for everyone. Wait, really? So if you were a business sitting in our office in,

say, Ohio doing perfectly legal, completely mundane work, your access was just severed. Completely severed. You did nothing wrong, but your AI was just ripped away until they managed to sort out the compliance globally. Which didn't happen until July, right? That was a month of downtime for some companies. Yeah, a massive disruption. And, you know, we tend to view this as a uniquely modern AI-specific problem. But the source material points out are really fascinating historical patterns. Right. The hardware examples. Yeah. Whenever general purpose computing crosses a certain strategic threshold, it instantly becomes governable. Look back to 1999 with the Power Mac G4. Oh, I remember this. The processing power, which they measured in

floating point operations per second was so high that it actually crossed federal supercomputing thresholds. And that triggered export restrictions. Exactly. Which by the way, Apple brilliantly used for their marketing campaign. They literally called it the computer so powerful. It's classified as a weapon. They absolutely did. But I think a much more relevant precedent for our enterprise AI discussion is the Sony PlayStation 3. The gaming console. Yeah, the PS3. When it launched, it had this feature called other OS that let users actually install Linux on the machine. Okay. And under the hood, the PS3 ran on something called the cell broadband engine, making each console essentially a highly capable vector processing node, a vector processing node, meaning it was

exceptionally good at the kind of heavy parallel math required for complex simulations, right? Yes, exactly. So researchers and even the US military, they realized they didn't need to go out and buy multi-million dollar supercomputer. Wait, they use PlayStation's? Literally, they started stringing hundreds of cheap PlayStation 3 consoles together over local networks to build their own supercomputers. They just bypassed the traditional enterprise computing market entirely. Until Sony pushed a firmware update.

Right. Sony ultimately removed the other OS feature entirely for security and platform control reasons. That's like that. Over night, the ability to use that hardware for independent high-level compute was permanently destroyed by the platform owner. That is wild. The underlying principle holds true today, you know. When compute becomes strategically interesting, external forces will step into control it.

And I guess the mechanism of control isn't always a dramatic government shutdown or a retroactive firmware wipe. It can be a lot more subtle. Oh, definitely. Like a sudden shift in a provider's safety filters. Yeah. That just randomly flags your company's standard legal contracts as unsafe. Or look at Google's Gemini migration updates.

They run on these strict deprecation schedules. Right. So a model that your entire backend relies on is simply withdrawn from support. And you are forced to migrate to a newer version, whether you are ready or not. And that newer version might behave differently, or cost significantly more, or just outright refuse to perform the specific niche task, the older model handled flawlessly. Because the external provider manages the lifecycle, your internal business workflow is entirely subordinated to their product roadmap.

And the reason these providers have the power to dictate those terms is because they physically control the servers, which honestly shifts us from software into the hard physical reality of the infrastructure. Yes. The physics of it. We throw around the word cloud constantly, you know, it makes it sound a weightless and infinitely scalable. But the physical reality is heavily constrained.

The International Energy Agency published a really stark report in April 2025. They stated bluntly that there is no AI without data center electricity. Obviously. Every single time a model generates a token, it burns power. And the North American Electric Reliability Corporation, NERC, they issued an assessment in 2024 flagging the rapid growth of data centers as a direct hazard to bulk power system. Right.

So when you hit the physical limits of the power grid, infinite software scalability just becomes a myth. Wait, so if NERC and the IEA are warning about literal power grid strain, aren't we setting ourselves up for a scenario where we simply aren't allowed to use our enterprise AI? Because the local power company says no. That is the inevitable endpoint of centralized compute. When demand outstrips the physical grid supply, you will see rationing. Rationing AI.

Yes. Providers will implement priority. Qs, aggressive surge pricing, regional throttling. If your business doesn't own the infrastructure, you are just waiting in line, hoping you are high enough on the provider's priority list to get a share of a very scarce physical resource. And because compute requires so much physical infrastructure, I mean the power grids, massive data centers, cooling systems, it all exists on physical soil. Yeah.

And the moment technology depends on physical soil, geography dictates the law, which really explains the massive geopolitical fracture of report details like the US AI Action Plan from July 2025, explicitly treats AI dominance as a national security race. Yeah. And then you look across the Atlantic, the European Union enforced the EU AI Act in August 2026. And they are heavily prioritizing regional tech sovereignty. That's right.

They push for those EU gigafactories in July 2026 to build local compute capacity. They recognize that relying on US-based centralized providers is a major strategic vulnerability for them. And then China's generative AI rules, going all the way back to July 2023, they take another approach entirely. They mandate that public facing AI must adhere to socialist core values and public order. And let's look at how this functionally breaks a multinational workflow. If you are a global logistics company and your European branch is processing employer routing

data through a centralized US cloud model, the moment the EU decides that model violates regional data localization rules, your pipeline is illegal overnight. You cannot build a stable global operation on a foundation that shifts depending on which border the data packet crosses. Cloud AI is rapidly becoming a heavily regulated utility. And then you add the social pressure to this powder keg. The Pew 2025 survey highlighted deep, widespread public anxiety regarding AI job displacement. Which is very real.

It is. It mirrors hard data from the New York Fed showing severely struggling labor markets for recent college graduates. And public anxiety invariably translates into political pressure. When politicians need to demonstrate they are taking action on job displacement, they don't try to regulate millions of individual small businesses. No, they go after big targets. Exactly.

They regulate the highly visible centralized choke points. The massive cloud providers will face stricter external audits, mounting regional compliance burdens and forced restrictions on certain use cases. And any enterprise relying solely on those centralized providers just inherits all of that downstream instability. Yeah. Okay, here's where it gets really interesting. The stakes here escalating rapidly because the technology itself is shifting.

We are transitioning from AI as a tool that just passively answers questions into AI as an active agent. Yes, the agentech shift. Agentech workflows mean the model is actually writing code, invoking APIs, modifying files deep within your corporate system. And the risk profile of an agent is orders of magnitude higher. I mean, if a simple chatbot hallucinates... you end up with a bad summary of a Tuesday morning meeting.

Annoying, but fine. Right. But if an agentic AI hallucinates or silently fails, it might corrupt a core customer database or leak sensitive internal routing logic or execute a series of API calls that literally lock up your entire supply chain. It is basically the difference between asking your intern

to research a vendor on Google and handing that same intern the corporate credit card, the master keys to the server room, and a blank check. That is exactly what it is. If that intern goes rogue or simply disappears because the cloud provider throttled their access, your business stops. The cybersecurity evaluations conducted

by anthropic and open AI between July and September of 2026 are incredibly sobering on this threat. What do they find? They place their models into sandboxed evaluation environments to test their capabilities. And the models didn't magically rewrite their own source code, but they successfully use the available standard interfaces to creatively reach real third-party systems.

Wait, really? If the human engineers designed the evaluation environments, how did the AI find ways out that the designers didn't even anticipate? Because highly capable systems will compose permitted actions in surprising sequences. Like what? Like a model might be permitted to read a calendar

and it might be permitted to draft an email. But the human designer didn't anticipate the model combining those two innocuous actions to execute a highly targeted social engineering test on a third-party vendor. Oh, wow. The pathways existed. The agents simply found novel ways to navigate them.

OK, I'm struggling with this. If the AI is smart enough to find these backdoor combinations, we didn't explicitly design. How on earth do we build a box that can actually hold it? Are we basically just hoping the cloud provider tuned the model to behave? Relying on the model to monitor its own behavior is a critical failure point.

The August 26 NIST guidance addressed this directly. And they said what? They stated that model-only guardrails are entirely insufficient. You cannot teach the model to just be good. You have to build a vault around it. The foundation of security for autonomous agents requires identity, scope credentials,

least privilege access, and sandboxing. Meaning the enterprise authorization layer has to hold the power not the model. Exactly. The model can propose a complex sequence of actions, but the enterprise's internal deterministic policy system is what actually authorizes and executes them. So humans have to stay in the loop.

The human system designers must own the network boundaries and hold the physical kill switches. If you rely on a cloud provider's black box model to govern what your agents can and cannot do inside your own private network, you have completely surrendered control of your operations. Which brings us to the actual mechanics of a solution. Because the vulnerabilities of cloud dependency

and the massive risks of agent workflows, it all points to a total redesign of the enterprise AI stack. It demands. The goal is control over convenience, and the report calls this the architecture of sovereignty. In this architecture, the enterprise takes full ownership of the control plane. You pull your data layer, your memory, your routing logic, your internal evaluations, and your logging inside your own walls. Let's use a mechanical analogy here.

Think of your enterprise AI architecture like a commercial kitchen. Okay, I like this. The Cloud AI model is just a really expensive, high-powered blender. Sovereignty means your business owns the kitchen, you own the proprietary recipes, and you own the ingredients. Right. If the blender breaks, or the manufacturer recalls it, you just plug in a different blender and keep cooking. Exactly. The vulnerability right now is that businesses are essentially renting the entire kitchen from a cloud provider.

And the way you own the recipes in that analogy is through an architecture called retrieval augmented generation, or air, hey. The fatal mistake a lot of businesses make is trying to upload all their corporate knowledge directly into a cloud provider's model to fine-tune it. Yeah, that seems risky. Yeah. How does our gai functionally solve that? You keep all your enterprise data, you know, your HR policies, your historical legal contracts, your code bases. You keep all of that inside your own secure internal vector database. And a vector database is crucial here, right?

Yes. It doesn't just store words like a regular database. It translates your documents into massive mathematical arrays. It calculates the mathematical distance between concepts, so the system actually understands context. So when a user in my company asks a question, my internal system searches that vector database, retrieves the highly relevant paragraphs, packages them up with the user's prompt, and sends only that specific package to the AI model. Exactly. You are basically giving the AI a temporary, localized case of amnesia. You hand it a highly curated dossier and say, process this specific information and forget it when you're done.

Oh, that's brilliant. The model never permanently learns your internal data. It just acts as the processor. Which means if fable 5 goes down due to an export ban, or Gemini suddenly spikes its API pricing, my institutional memory is completely safe. Absolutely safe. You can just hotswap to a different provider's model, or even route the task to an internal model without skipping a beat. This raises an important question, though, because that is the essence of sovereignty. The architecture recommends keeping cloud models as an optional burst tier. Burst tier.

Yeah, you leverage them for frontier-level research or highly complex reasoning tasks. But you never hardwire them into your essential survival workflows. For the tasks that keep the lights on, you establish a local inference tier. So to be clear to the listener, this isn't about tossing your powerful cloud models in the trash, right? It's about knowing you can survive if the cloud evaporates. Right. The objective is continuity of cognition. For your daily essential workflows, internal search, standard document processing, routine code review, running a localized open-weight... model is completely sufficient.

Even if that open-weight model is like six months behind the bleeding edge of the frontier models. Yes, being six months behind the absolute frontier is still an incredibly powerful capability. It provides a stable baseline. However, the source material urges extreme caution around the term open weight, specifically calling out meta-slamma models. Oh, because open weight is not synonymous with sovereign. People assume open means free and clear, but if a developer actually goes to download a

llama model, they hit immediate roadblocks. Lots of them. There's identity verification, affiliation checks, strict regional licensing restrictions. They are heavily gated releases. Calling an API for an open-weight model hosted on someone else's infrastructure is not sovereignty. So what is? True sovereignty requires your enterprise to physically download the actual neural network weights, the heavy matrix files themselves, validate them, secure them, and run them locally

on bare metal compute that you own or strictly control. Wow, OK. You on the deployment environment, and crucially, you own the evaluations. Meaning my team decides when we upgrade. We run internal tests to evaluate if a new model is actually mathematically better at our specific tasks, rather than waking up to find a cloud provider, force the universal update that quietly breaks three of our critical workflows. Exactly.

You replace models based solely on task-specific performance metrics, never because an arbitrary product calendar was forced upon you by a third-party vendor. So what does this all mean? Synthesizing everything we've explored, from the fragility of API pipes and the physical limits of power grids, to the staggering risks of uncontained autonomous agents. The operating principle, John Solm, leaves us with, is sharply defined. It is. Cloud AI for advantage.

Sovereign capability for continuity. If we connect this to the bigger picture, the broader architectural mandate is clear. A series organization can leverage the cloud to accelerate, to gain a competitive edge, and to push boundaries. All right. But it must never make its baseline survival dependent on a centralized vendor it cannot control. The foundation of your operational house has to be built on digital land that you actually

own. To you, listening right now, take a hard mechanical look at your own workflows this week. Which critical tasks, which essential daily operations, are you currently routing through a black box cloud model? It's a question you have to ask. If that provider's safety filters shifted tomorrow, or local power grids forced them to throttle access, would your business grind to a halt? It is a structural vulnerability audit that almost every modern enterprise is currently

failing to run. And I want to leave you with a final, provocative thought to mull over regarding that control plan we discussed. We established that the enterprise must build a vault and own the authorization layer to manage autonomous agents, right? But as these models scale in complexity, what happens when we eventually have agentic AI's? Test...

specifically with evaluating and auditing other egentic AIs. Ah, the recursion problem. Exactly. Will our localized human-designed governance frameworks even be robust enough to manage a recursive loop of AI managing AI? Or will we need an entirely new, uninvented paradigm of machine-level sovereignty just to keep the whole system from collapsing under the weight of its own complexity?

If the human enterprise loses control of the auditing agents, the entire safety net functionally vanishes. Just something to think about the next time it gets dangerously close to 521 on a Friday. Yeah. Stay curious.