Claude Fable 5 is BANNED. What to do?

I had my entire weekend planned out. I was going to lock in and use the most powerful AI model on the planet Fable 5 to build this crazy idea I've been sitting on. Then Friday at 5.21 p.m The U.S. government sent anthropic a letter and by Friday night the model was gone. Disabled for everyone No warning, no appeal and I sat there thinking about how fragile this whole thing actually is. We've all been building our businesses, our workflows, our entire creative process on top of models that live on someone else's servers Controlled by someone else's terms. One government letter away from disappearing. So this weekend I'm not building with any frontier models. Not none. And this is the episode I needed to make. By the end of this episode You're going to understand what local models are. Why they suddenly matter more than they did a week ago. Exactly which ones to use. What hardware you need and a few startup ideas that only exist because intelligence now runs on your desk for free I think it's opened up a bunch of money-making opportunities that I'm going to share by the end of this episode. Let's get into it. So let me paint the picture of what actually happened because the lesson is bigger than just this one model ban. So frontier models are incredible. You know, I'll be the first to say that. Nobody's arguing that. But they all share the same weakness. You don't own them. You rent access. And rented access could be revoked at any time by a government, by a policy change, by a pricing change. Like they could just make it so expensive that it's, you know, you can't access it. By the company deciding your use case, violating a term, you didn't read. We just watched this happen in real time. The single most powerful model on earth is gone overnight. And I want to just be clear that I'm not anti-cloud. I use these cloud models every day. And the cloud models are going to be the strongest. You know, they're going to be better than local models. Just in terms of like you're getting the best possible stuff. They're the smartest tool available. But what it's taught me is that you do need to own a part of your stack. You need a layer that nobody can take away from you. And the way I think about it is like electricity. Most of the time you're happy being on the grid, right? It's cheaper. It's easier. Someone else maintains it. But the people who are truly resilient have a generator on in the garage. You know, a hurricane comes and lights go out. Well, they got this generator that that continues going and they can actually use their stuff. Local models are basically that generator for you. And I know what a lot of people are going to say in the comments are going to be like, well, local models aren't good at all. And it's just not that true anymore. I think the switch probably happened about six months ago. Two years ago, running a model on your laptop was literally garbage. Maybe a year ago too. But today, a model that runs on a gaming GPU or a decent Mac is good enough for about, I would say, 80% of what most people use, things like ChatGbT or Cloud4. The gap between free and local and expensive cloud, close faster than I think a lot of people expected, including myself. So let's actually talk about what a local model is. And I want to make it dead simple. You know how I am on this channel and this podcast. I'd like to just dumb it down for for myself and for you because I don't want to scare people off. A local model is an AI model that runs entirely on your own computer. You don't need internet. You don't need an API key. And you don't need per token cost. No company is watching what you do. You just download the model file once. And from that point on, it's yours. It runs on your machine the same way a video game or a photo editor might run on your machine. And that's really it. That's the whole concept. We don't need to overcomplicate it. Basically, the intelligence lives on your hardware instead of someone else's. And you get three main things that you don't get with cloud models. The first thing you get is privacy. Your data never leaves your machine. And this isn't nice for you just personally. It's an entire unlock for selling to a bunch of different industries that you might want to sell to like health care or legal or finance industries that legally cannot send their data to a third party API. And there's actually a ton of those industries. We're going to talk about more of that when we get into the startup ideas. So let's put a hold on that. The second main point is you get zero marginal cost. So after you've got the hardware and of course you do need to spend money on hardware and hardware is getting more and more expensive. But after you've got the hardware, every query is free. It's unlimited and you can run a model 24 hours a day for a month and your bill is just going to be the electricity that does really change the math on an entire category of products and it opens up a lot. The third thing is nobody can turn it off. The model on your drive works whether or not the company that made it even exists. Whether a government likes it or not doesn't matter. Whether or not your internet is up. It works on an airplane. It works in a bunker. It just works. So yes, you get a lot, you know, you get some main benefits, but with everything in life, there's pros and there's cons. So let's talk about what the trade-offs are because I don't really want to sell you a fantasy. I'm not here to sell you a fancy. I'm here to tell you what are the pros, what are the cons and how to and what I what I think is interesting about it. The trade-off is that local models are generally not as smart as the absolute frontier models. The biggest open models can match the cloud, but they need serious, serious hardware and there's, you know, you'll see people on X and they are doing insane things with local and a lot of the times is there they're spending five, 10, 15, $20,000 on machines. The ones that run on a normal laptop are a notch below the best cloud models. But the way I'm starting to think about it and reframing it is you don't need frontier intelligence for most tasks. You need good enough intelligence that's private, free and always on. And then you got to match the right model to the right job and that's becoming a whole new skill set and we're going to get get to that. So how do we get good at local models, which is something that I'm spending my weekend trying to figure out and sharing everything in real time. This is really the meat of this episode. If you really want to get good at this and not just not along and watching YouTube videos and podcasts, here's the order I'd learn it in. The first is start with runtime. Everyone gets his backwards. They go hunting for the perfect model before they can even run one. That's the wrong order. The first thing you download is the runtime, the program that actually runs models on your machines. There's two main names to know, Olamma and LM studio. Olamma is usually the favorite of a lot of my developer friends because it runs from the command line. It's relatively simple because it's one command and it runs the model. But LM studio is the one I'd start non-technical people on because it has a real interface. It's got a model browser. You click and it runs and there's no terminal and those things are scary. This is sort of the part that a lot of people overcomplicate it. Just download one of these first, whichever one seems to resonate with you more and you have a model running in 10, 15, 20 minutes. The second thing is you're going to want to match the model to your hardware. A model size is measured in billions of parameters. You'll see numbers like 4 billion, 12 billion, 27 billion, 70 billion, bigger basically means smarter, but bigger also means more memory to run. The single most useful thing to understand in this entire episode is the rough mapping of model size to hardware. A 4 billion model runs on basically anything, an 8 gigabyte laptop, even a lot of phones. A 12 billion model is the sweet spot for a machine with 16 gigabytes of RAM. This is where most people should live. A 27 to 35 billion model needs a really good Mac with 30 gigabytes or more or a dedicated GPU. This is where it starts feeling genuinely capable in my experience. A 7 billion and up model needs serious hardware. A max out max studio or a dedicated box like an Nvidia DGX sparks spark with a 128 gigabyte unified memory. The DGX spark is interesting and I've talked about it on this podcast before because it's purposely built for exactly this 128 gigabyte memory decides to stay on 24 seven runs Linux and it's really becoming the default for AI box on your desk for people who are, you know, serious, I'm not affiliated with Nvidia just what I'm noticing in the industry. You run your model on it. You leave it running and connect it. You connect to it from from your phone. So your desk becomes this almost mini least of way I see it as a mini data center. The third third thing to know is the third main thing to know is knowing which model for which job. There's obviously a bunch of models and I can't I don't have enough time to cover all of them, but I'll give you the four main ones that you know you need to know about. Quinn three and the new 3.6 series the best all around choice I think for most people it's Ali Baba's open model family it's quite strong at coding strong at multilingual it's clean commercial license. They've got a 27 billion and a 35 billion versions and they it feels like a punches above its weight. It outperforms previous generation models four times their size if you only learn one this is probably the one to learn. But that's that's one of them the other one is deep seek you've probably heard of deep seek. This is quite good at hard thinking and coding problems but heads up the reasoning models take 10 to 30 seconds to think before they answer before they answer and that's normal if you install deep seek and you're like why is it taking so long that's just usually what I've seen takes about 10 to 30 seconds. The third is Gemma and this is Google's open model and if I was Google right now I would be you know launching a new version of Gemma right now and just taking advantage of this moment. This one runs remarkably small there's actually a version that fits in 16 gigabytes of RAM and that one that's one that can fit on your phone. It's beautiful clean writing the fact that Google gives this away for free is actually crazy and I I wouldn't be surprised if Google double down on this in the future then there's llama by meta. It's it's really become very important in the whole open ecosystem it's got a huge community a ton of fine tunes it's got a lot of tutorials that you can go and check out it runs almost anywhere so when it out there's probably a llama for your situation. The fourth main point that you should learn around local models is what's called quantization this no one really talks about and it's a really important trick with respect to local models and quantization is this concept of shrinking a model so it runs on weaker hardware with barely any loss in quality. The analogy I think of for this is a raw model is like a uncompressed photo quantization is like saving a high quality JPEG it's a lot smaller and your eye really can tell the difference when you're downloading models you'll see labels like Q4 or Q5 quantization is like that's the compression level. That's the quantization compression level and Q4 roughly has the memory a model needs with pretty minimal quality loss and this is how a model that supposedly needs a server ends up running smoothly on your laptop. So understanding this concept is really key and it's key because it's the thing that makes your hardware suddenly do twice as much. The fifth main point is you're going to want to connect to your agent so running a model and chatting with it is cool but the real unlock is pointing an agent at your local model so you can use something like Hermes to do that I've covered Hermes I think last week I did an episode on Hermes desktop app you can go check that out. Hermes is the most used agent in the world right now I would say it's definitely gaining the most amount of hype and buzz and it's actually built specifically to run locally and never stop. You point a Hermes profile at your local model and now you have an agent that runs free runs offline remembers everything writes its own skills and you can message it over you know you're messaging app of choice like telegram or whatever while the heavy work runs on the box of your desk so super cool again I have that episode that I did. Last week that I'll include in the description if people want to watch it and learn more about agent profiles and pointing it to local models so that's those are the key points I would say around what do I need to know about local models. That helps you get you know up and running but you know what are you know how do we take it to the next next level how do we separate the pros from the tourist. One is the context window is your your real constraint locally so cloud models and you a giant context window for free that's the way to think about it local models make you pay for it in memory so the bigger the context the more ram it eats so keep your session. You're going to get your sessions tight super type and don't dump your entire life into one thread or your machine is going to choke and you're going to be like local models aren't very good. You're going to want to give your local model tools so a small local model with web search file access the ability to run code beats a giant model with none the capability gap closes fast when you are up the right tools so think about it as the model is the engine and the tools are the wheels now common thing that happens with local models is sometimes it forgets your tools I don't know if other people have noticed this. So I'm still trying to I you know I'm learning in real time you know how to how to get the most of it how it how it doesn't forget but just know that that is something that is a quirk that you know as a recording this June 2026 that happens sometimes. Remember that privacy is the killer feature here so everything is running offline your data is not leaving the machine and just you know I'll talk about that actually more with the startup ideas and how how you can leverage that. The last thing I'll say about you know just. Concepts that separate the pros from the tourists. It's actually super helpful to run a small local model versus a frontier cloud models side by side for a week because that actually helps you build the instinct I think it's the fastest way to build the instinct actually and you'll be shocked with how often the free local model is good enough so you're going to see yourself. So stop reaching for the expensive option for things a 12 billion you know handles fine and that instinct knowing what to run where is the skill that I you know we're trying to learn here this this whole table five moment of being banned and stuff like that that is just it's just a wake up call for us to learn how to do local local models and that's probably why you're here listening to me talk about it today. So I wanted to give you this is the start I want to give you some startup ideas I mean after all this is the startup ideas podcast I'm here not only to clarify how you you know how you learn how to use AI and be practical but I also am here for helping you get your creative juices flowing around startup ideas that only exist. But you know for a certain reason and there's some startup ideas that only exist now because local models exist and because a lot of people I mean this is mainstream news a lot of people are seeing like hey these cloud models could get banned so there's going to be a huge amount of demand my opinion for local models over the next few years. So one startup idea I wanted to give you is on device AI for regulated industries so this is a big one we kind of talked about it earlier but health care legal finance they have money they have problems AI can solve but they legally cannot send their data to a cloud API. So a product where the model runs entirely on the customers device the data never leaves the building that opens a market that the cloud based competitors can't enter right now so that privacy can train your your moat and you just start selling to these types of people. The second startup idea is you you basically you sell it as the data your data never leaves version of existing AI tools so you know go. You know pick any popular cloud AI product note takers meeting summaries document analyzers and then you just build local versions of those products it's the same product but the pitch is basically nothing you give us touches the internet and you slap that on to the main value proposition of the landing page. You do it for lawyers you do for doctors therapists and anyone handling sensitive documents that is the sentence that might help close the deal. Third startup idea the air gap agent for sensitive operations so some businesses can't be online at all for security reasons defense contractors certain financial operations anyone paranoid about leaks. So you do an agent set up that runs fully offline on local hardware and they're going to have you know willingness to pay so it's not just the startup idea number one is just regular regular industries. These startup ideas number three is really around leakages and sensitive operations so you might have not such a sensitive industry but they have a sensitive operation that's that niche. The fourth idea I have for you is offline AI for places with no internet so ships planes rural clinics field operations disaster zones you know useful a useful agents that work with zero internet is a product the entire cloud industry simply just can't serve. And then the last idea I'll give you is resilience as a service so after this weekend every serious company is going to be asking what happens to our AI workflows if our provider gets cut off and you just sell the answer so it's basically a fallback layer that kicks in. When cloud models disappears so you're selling insurance against exactly what happened with the fable five banning you know overall this has been I'm still like processing the news and stuff like that but I keep coming back to is this this weekend. For me was supposed to be about building with the most powerful model on the planet but instead it became about something more durable the lesson isn't that cloud is bad and locals good I don't want that that's not the case. The lesson is don't build your entire life on something that can disappear with a single letter on a part of your stack have the generator in the garage local models are the insurance and this is the weekend I finally bought the policy. And you know when you play with these local models you're going to learn that yes they're not perfect yes they're not you know the most powerful model on the planet but for 60% 70% 80% of routine tasks they're actually quite good and there's a huge range of those use cases so. Over the next few days i encourage you to play with these you know don't just watch this or listen to this and and nod download olama or lm studio poll quen 3 run it point Hermes at it pick a real task and force yourself to do an entirely local and that's really how this all all the stuff clicks. And once you actually play with and you get your hands dirty you'll understand a little more of what i'm saying and so that next time something gets banned or something gets priced out of you know oblivion you can still run your business you can still ship your ideas you can still. Do things and you know in the best case scenario is you have cloud models doing xyz and local models doing a vice ABC. If this was interesting to you you learn a thing or two. Do me if do yourself a favor actually I was going to say do me a favor but do a like a comment and subscribe. That just means more of this stuff is going to appear in your feed and also tells me I should you know continue doing this and sharing what i'm learning in real time. I hope I hope you build something cool I hope you learn to think or two i'm rooting for you now go build something today that nobody could turn off and i'll see you in the next one take care and have a creative day.