An opinion piece / rant about AI, open source, a dim outlook on the future, and how you can brighten it. AI is simultaneously worse and better than you think, and complaining about water is what the billionaires want you to do.
Well, I’d like to say I am not an expert, in anything, by any means. This is simply a way of putting my thoughts in a more structured form, as this has been coming up a lot recently. This isn’t even original thought, everything I am saying has been thought of by others before me, I just have never seen this argument all in a single document, though maybe I just haven’t looked hard enough or in the right places.
I would also like to say this was written 7/24/2026. Things are moving so fast this may end up completely incorrect in a year. I will update this if that occurs, but obviously by this text being here it hasn’t been updated since then.
I do not yet make any claims about any of these being plausible things that could occur, I am simply defining some terms so that you can understand what I’m talking about.
For the purposes of this post, the word AI will almost always refer to LLMs or their hypothetical descendant technologies (world models, neurosymbolic AI, whatever the industry goes with). Not direct “AI” media generation, as that’s rather unrelated.
AI Alignment: The problem that an AI should follow what you tell it to, but also shouldn’t do bad things if you tell it to. An AI that does these things is “aligned” but it’s “aligned” to whoever defined what good and bad was, which might not be a very good definition depending on who did that (see: Grok).
Weights: The big black box of numbers that makes up an AI model. Think of it like the file it’s stored in.
AGI - Artificial General Intelligence: An AI (or AI powered system) that can do any “economically valuable” work a human could do given access to the same tools. Just simply do, not necessarily more effective, faster or cheaper.
TED AI - Top Expert Dominating AI: An AI (or AI powered system) that can do any “economically valuable” work at or above the level of top human experts of the field in most fields. Not necessarily faster or cheaper than said human expert, but it would be hard not to be. Still within human understanding.
ASI - Artificial Super Intelligence: An AI (or AI powered system) that is more intelligent than the best humans by a large amount (how large the large amount is varies by who you ask, let’s just say 2x, whatever that means). Could be within human understanding, or could not be, or could depend on when you peek at it, nobody really knows what it’ll look like!
RSI - Recursive Self Improvement: The idea that if an AI could become better at AI research and development than humans, it would be able to improve itself recursively. How far this can go is very debatable (and read the rest of this blog and you’ll see it doesn’t really matter).
Machine God: A specific prediction of what an ASI would look like. That an ASI would inherently be able to do RSI and that it would lead to an ASI far beyond human understanding, and that the machine god would be able to develop technology indistinguishable from magic. ANY slight misalignment could potentially lead to those values being “locked in” as humans would stand no chance to shut it down if it resisted shutdown.
Singularity: The moment in time in which RSI starts occurring leading to an extreme advancement in technology. This is generally believed to be an extremely high tension and risky moment, with high risk of existential harms or human extinction.
Artificial Analysis Intelligence Index: A weighted average score of a bunch of benchmarks. This can only be used to compare different AI models to each other, not to humans. The score is non linear weighted average based on a changing set of benchmarks and isn’t super useful for comparing old models to new models like I use it to do. I do this knowing it’s a poor idea because there is no better alternative, and it is still leagues better than saying “this is several times better than that” with literally zero evidence. Measuring intelligence is HARD and mostly qualitative, even with computers.
Most of the people in the AI space, especially those up top, generally believe in a few things about AI:
Now, you’re probably not gonna believe me that they really think those things, since “The Billionaires are spending billions just to end the world and are blatantly saying it out loud!” is a crazy person take. So, here’s what the CEOs say:
“I think that AI will probably, most likely, sort of lead to the end of the world. But in the meantime, there will be great companies created with serious machine learning.” - Sam Altman, CEO of OpenAI in a 2015 interview. (https://futureoflife.org/ai/sam-altman-investing-in-ai-safety-research/)
“I am concerned that LLMs are approaching (or may already have reached) the knowledge needed to create and release [biological weapons] end-to-end, and that their potential for destruction is very high. Some biological agents could cause millions of deaths if a determined effort was made to release them for maximum spread.” - Dario Amodei, CEO of Anthropic in an essay on his own website in January 2026. (https://darioamodei.com/essay/the-adolescence-of-technology)
Elon Musk signed the Pause Giant AI Experiments open letter, which called for a 6 month pause on AI development while regulation restricting its development was passed. (This could have just been an attempt at regulatory capture, more on that later.) (https://futureoflife.org/open-letter/pause-giant-ai-experiments/) (There’s probably like a billion tweets I could use as evidence here too, whatever…)
This isn’t super definitive evidence or anything, but hopefully it’s enough for you to look into it a bit more yourself. The reason I brought this up was because I want to contrast it with their actions. So:
I think a brief bit of history is required to understand what I’m saying, so here’s a timeline, no need to memorize it since the important parts will be referenced again later, but you should still read it.
If you aren’t in the loop, you are probably thinking something along the lines of: “Death?? Escaping?? Unsolved math problems?? Accelerating growth?? WHAT!?”
The truth is, if the last time you used AI was tinkering with ChatGPT during Covid, AI has improved by several orders of magnitude in every single metric. Which leads me to the first point that backs up the bold title, AI is intelligent now, actually. *(and burying your head in the sand about it isn’t helpful)
AI can autonomously use external tools, navigate the internet on its own, write non-trivial code, solve complex problems, and affect the real world. Not only can it do all of that, it’s nearing expert level at cybersecurity and math. To do this, AI has a trick up its sleeve, it can extremely quickly process and draw conclusions from thousands of pages of data at a superhuman level. Sure, it may do subhuman at needle in the haystack problems, especially if you count the humble “CTRL+F”. However, if you count finding 50 needles and linking them all together to solve a problem, it’s superhuman. (At least at reasonable time scales, maybe a human studying the same 1000 pages for months could figure it out, especially if there’s a goal in mind.)
AI already has a death count, and I’m not even counting “AI as a tool” harms. LLMs have already encouraged several suicides and murders due to irresponsible deployment and training for engagement.
AI is currently capable of being used as a tool for mass surveillance, the aforementioned ability to draw information from data gives LLMs the ability to be superhuman private investigators, while being cheaper and quicker than a human as well. (https://www.palantir.com/)
Denying these truths (e.g. burying your head in the sand) just lets everyone get away with it. The idea “AI will never do anything good because it’s worthless and unintelligent” is mutually exclusive to the idea that AI can kill people, perform surveillance, and do other great harms. Saying the former will convince people the latter is false.
(This also implies AI is powerful enough to do good, yes, more on that later.)
Moore’s law is the idea that the number of transistors possible in a given area doubles roughly every two years, and it’s mostly held up over the decades. The number of transistors in a circuit is roughly equal to its capability, so a 2x transistor density means you can either make a circuit the same size with 2x the capability, or a circuit with the same capability for half the size. Funny thing about how computers work is that the electricity used is very roughly equal to the area of the circuit, not the total number of transistors. This means we can get the same amount of compute for half the electricity used, so roughly half the cost. Oh, and if the performance stays the same, doing the same amount of compute faster still means less electricity was used.
If let’s say, we wanted to run a given AI model on upgrading hardware, the SAME AI model gets ~2x faster and ~2x cheaper in 2 years (or just a lot cheaper, like running on the edge, or on mobile). This backs up my second point: Even if AI development were to stagnate right now, its harms would still become exponentially worse over time *(and its benefits would be exponentially better)
Short answer: Power and money, obviously, but “scamming investors” is only a fraction of the equation, and is the least important factor.
These are things already currently happening, not speculation. Though there will be speculation on what may happen with the future of these things.
Imagine a world where every security camera is being watched 24/7, a world where no crime, no action goes unnoticed. A world where something being noticed is immediately added to a record instantly able to be looked up by any other AI. Your face, your gait, your voice, everything you have ever done online, your opinions, what you own, what you wear, instantly able to be looked up at any time. Never before has someone committed a crime, then been caught because they were recorded buying the hoodie worn during the crime in a Target 3 years ago, that will change soon. And remember, the word crime here means “whatever the government and people running this system considers a crime” not “morally bad action”. Better not be on their bad side, and expect those on their good side to mysteriously have gaps in their data!
This is a hot take, but AI can currently take some jobs, is taking jobs in IT and software engineering, and many more fields are soon to follow. Again, if your most recent experience is with ChatGPT during Covid, go chat with some open source Chinese frontier LLM or something and ask it the hardest questions you can come up with. If it can solve problems that were attempted by humans for decades unsuccessfully, you’d have a hard time coming up with something it can’t answer that isn’t just ultra obscure knowledge not on the internet. Remember what I said about Moore’s law? These top of the line frontier models aren’t going to take jobs because they’re too expensive, but when they get 10x cheaper, that will change. Not to mention during that time the models themselves will have gotten better. It’s only going to be a few years until what’s top of the line now is bottom of the barrel.
Frontier LLMs are currently capable of autonomously attacking targets, discovering zero-day vulnerabilities, and using them in complex exploit chains. It is not necessarily superhuman yet, but what it is capable of went from the realm of “determined nation state group of attackers with millions of dollars in funding (APTs)” to “whoever has access to these models”. This is a massive, very dangerous shift, putting a LOT of power into the hands of a few billionaires who control these things. Maybe don’t publicly threaten Sam Altman if you don’t want a rootkit on your computer.
This will be short because this is only just in its very beginnings, so I don’t have anything to say about its real impact. This is likely out of selfish reasoning, but there is no doubt these advancements will make it to the public (though potentially with a large price tag). Medical screening is obviously the first surface to attack, an LLM could potentially read someone’s entire medical history and flag problems before a human could, though there’s obvious massive privacy implications if this is done with a cloud AI. If done responsibly and with local, open models, this could be a massive net positive.
This is both accessibility to the disabled and accessibility to the unskilled. It opens up advanced computer usage to those who don’t know how, and to those who are unable to use a keyboard and mouse. On one hand they are doing this because more people buying tech = more revenue for them, but on the other it also empowers average people. Those creating open source models also have this goal in mind.
This one doesn’t need much explanation and also has very little supporting evidence. We all know there’s mass LLM powered bot traffic across the internet, but who’s running them and who they’re benefitting is very fuzzy and there’s not many trustworthy numbers. There’s no significant evidence to suggest that the AI CEOs either perform or support this, but they are definitely capable of it if they wanted to. Just know it’s only going to get worse.
Now, that’s a non exhaustive list of things that AI is currently being used for, but that’s not even close to the end goal of these people. I would like to cover their near term future goals, e.g. the next 5 years.
As I have said before that I would contrast these billionaire’s behaviors with their actions, I am now here to make good on that promise. They’re all in a race, and they all believe the finish line is a coin flip between them having unlimited power and the world ending, and they rightly believe that if they don’t join the race, someone else will in their place. This is a wild statement that needs elaboration, and elaboration I shall do.
“If it were possible to effectively slow the development of this technology to give ourselves more time to deal with its immense implications, we think that would likely be a good thing. But if a slowdown simply lets the least cautious actors catch up technologically, it could leave everyone less safe. Without a global coordination mechanism, companies and governments will have to make difficult decisions about safety while under competitive and geopolitical pressures.” -Anthropic
Their plan is pretty damn simple, and out in the open. They intend to use AI for political control, just look at how Dario Amodei warns about the dangers of china in his regulatory capture statement:
“Export controls serve a vital purpose: keeping democratic nations at the forefront of AI development. To be clear, they’re not a way to duck the competition between the US and China. In the end, AI companies in the US and other democracies must have better models than those in China if we want to prevail. But we shouldn’t hand the Chinese Communist Party technological advantages when we don’t have to.” -Dario Amodei
That reads like someone who isn’t genuinely interested in defending humanity, but instead is pushing a political agenda!
Step 1: Create AGI, take (some) jobs.
Step 2: Regulatory capture.
Step 3: Take the rest of the jobs, get involved in government.
Step 4: Play the invisible hand
I would like to remind you, WE ARE ALREADY ON THIS PATH!! I predict that this can all be done in 10 years, the bullish may predict 5. Just a reminder we went from GPT 3 being restricted for “being able to write plausible sounding scam emails” to GPT 5.6 solving unsolved math problems in 4 years. We really simply do not have enough data to plot how quickly this will happen, but the truth of the matter is the rate of improvement is getting faster by the month, and if you are not prepared it will not only catch you off guard, you will only notice what has happened when it is too late.
Now we’re entering some speculative woo woo shit, and you may believe the “machine god” is 100% impossible. However, my point stands regardless, and I think you should open your mind a little.
https://openai.com/index/planning-for-agi-and-beyond/ https://www.anthropic.com/institute/recursive-self-improvement
Both OpenAI and Anthropic have the official stated goal of creating ASI, Anthropic even wants to do so using RSI. While they officially stay away from “machine god” like speech, individuals haven’t. “I think the good case is just so unbelievably good that you sound like a really crazy person to start talking about it. And the bad case — and I think this is important to say — is like lights out for all of us.” -Sam Altman, 2023
My point isn’t to argue that this is “100% definitely the real situation that’s at hand”, or that as Sam Altman puts it is exactly how it is, that’d be insane. However, people are giving billions to the guy under the impression what he’s promising is true! We’re letting billionaires flip this coin and nobody’s saying anything! The biggest counter argument to this in public consciousness is “AI is terrible that’ll never happen” or “But but water and IP law” when what should really be said is “Why the fuck are we letting billionaires gamble everyone’s lives?” Complaining about non-existent issues lets them do this regulatory capture and this surveillance which is a potential point of no return for not just a shitty surveillance state dystopian future, but human extinction.
On the question of whether any of this is real and what will happen after it. Nobody knows, and anybody giving you a confident yes or no answer is pushing something. If there’s any universal constant or limit to intelligence, we haven’t hit it yet, and nobody has any idea where it would be. It may not exist, we may hit it in a week, we don’t know. If we hit compute limits, we can always increase in density instead of scaling upwards. And we can of course always build more computers, even if that takes time.
This is more of a note than an argument, I have a target audience here and this is pretty critical to getting my next, final point across to them in particular. Datacenters are harmless, electrical infrastructure is not. Water usage is almost entirely inconsequential even if you take the largest numbers, which associate water usage of electricity generation with water usage of the datacenters themselves. Water pollution is just not a thing, and all claims of it are unsubstantiated, the one reported case was a broken pipe unrelated to the datacenter. (And the person lived right next to a fiber optic manufacturing plant.) Air and noise pollution do have substantiated claims, but those are associated with natural gas turbines built on site next to datacenters that couldn’t get capacity from the local power grid. The lesson there shouldn’t be that AI harms the environment, but that billionaires and lack of government regulation do. The datacenters themselves do not release pollutants and are not audible from the outside.
Datacenters outside the US just don’t have these problems for the most part.
Again, just a short note. I am not making a “pause AI” argument here. I am making a “don’t let american billionaires get away with their plan to control all world governments” argument here. If the singularity were to be a real thing, I think we should do it, under less evil leadership.
Well, I’m going to share a little bit of a doomer opinion here. There’s realistically only 3 things that could alter this trajectory.
I am not going to say you MUST use AI, after all I’m not here to sell you anything (and if anything the message you should have got from this should be the opposite of whatever you have to think to pay monthly for Claude max or whatever). But what I will say, is that you’re going to be left behind. If you are okay with and able to be left behind, that’s your choice, but I believe I have given fair warning. There is no real way to keep up with AI without using it, Intelligence is qualitative and the numbers will never show you the true state of things.
AI can morally be used (and really should be used) where it is best at. Currently that is software development, cybersecurity, math, certain data processing tasks, potentially language learning, etc. But, as they get more capable, they will be getting better at things, and these horizons will broaden. I am going to paraphrase Hank Green here, because he said something I really like on the topic; You should build yourself as a person, if you are using these tools to avoid learning something (or as he puts it, putting tools in the junk drawer) you are avoiding building yourself, and that’s where you’re really missing out on. As an analogy I hate to use, as people misuse it all the time, think of compilers. They almost entirely replaced writing assembly except for some super, super niche cases. But that doesn’t mean you shouldn’t learn assembly, it’s fun, it’s a great experience, and the knowledge you gain will drastically increase your knowledge of computers and software engineering as a whole. If there’s one thing LLMs have proved to the world (outside of the field of math, at least :p) it’s that intelligence isn’t entirely separate from knowledge, it comes from it. Learn, do things, and become a better version of yourself. (I say that partially hypocritically.)
Where other people are using AI, here’s what you should consider: If they’re using it to put out slop, you can just write it off and ignore it. However, if they are making something genuinely beneficial to the world, and they’re putting effort in, the only real issue there is if they’re giving power to these billionaires. Maybe step in and ask them to consider using open weight models, especially preview ones. They’d be helping train open weight models, they’d be getting the model for far cheaper, and if they’re using free tiers only, they’re getting a several times better experience. (DeepSeek v4 preview is available in free tier as of the time of writing this, for example, it has an Artificial Analysis score of 44 vs ChatGPT’s free tier’s 29 (Assuming the free tier is GPT 5.5 instant, it’s unspecified) Qwen 3.8 Max Preview’s is likely in the 50s)
“…AI is a tool, just like other tools we use. And it’s clearly a useful one. It may not have been that “clearly” even just a year ago, but it’s no longer in question today…” -Linus Torvalds
Running open source models locally is possible and practical, this isn’t a guide on how to do it, and I don’t have much interest in writing one as there’s already good guides out there. Search “llama.cpp unsloth Qwen 3.6 35b local” and you’ll find results. I was going to show the beautiful “Stop asking what model to run. There are literally only two.” Reddit post, but that appears to have been deleted, sad. Instead you have to view my masterpiece.png
Here’s some websites you can use open weight models (in the cloud) for free on
https://huggingface.co/chat/ (personally never used it, but the free tier offered me Kimi k2.6 by default and it was super fast so /shrug)
https://openrouter.ai often offers preview models, these are not all necessarily open though, watch out.
(Maybe if you’re struggling with the local models, you can ask one of these for help :p)
tl;dr Moral crusading “anti-AI butlerian jihad” over fictional issues instead of promoting true alternatives is giving billionaires the cover they need to try to control everyone, and they’re putting all of our lives at risk. Frontier labs are not your friend.
And that is what I meant by the bold title, I hope you can see what I’m seeing. We’re in for a rough ride no matter which way this goes.