Login
You're viewing the techdon.dev public feed.
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:49 PM

    Let's start with the oversupply and what that means for everybody involved. Whether it's traditional players like Google or new entries like CoreWeave every single company in the tech sector has been buying an increasing amount of hardware at increasingly steep prices. GPUs, memory, servers, power supplies, and the prices went up and up and up. Now when a company does that, it looks neutral on their balance sheet, because the money they spend is compensated by now having an asset of the same value. Then over the following years they write down that value in what is called depreciation, this is visible as an expense on their balance. 2/

    💬 2🔄 20⭐ 164

Replies

  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:50 PM

    If Nvidia GPUs are in significant oversupply as was reported then it means the prices will come down, as there's nobody willing to buy that stuff anymore. And this poses an immediate and very tangible problem for those who bought them: they have to write down the loss of value for the stuff they already own. That's hundreds of billions of dollars of value evaporating, because that value only existed if these things were really scarce, which they aren't. Oops. 3/

    💬 5🔄 63⭐ 221
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:50 PM

    Which brings to another very thorny topic: mark-to-market accounting. Let's say you buy something worth 1 billion $, say DRAM, that's 1 billion $ of assets on your balance. But let's say that the next year the price of that stuff goes up by 100%, what are you going to do? The prudent choice is to leave that asset at the value you paid it for, in case it comes down later. And then there's the choice of changing the value of that asset to account for the increase in price, that's mark-to-market accounting. Enron became famous for this, I guess you can see why. 4/

    💬 3🔄 23⭐ 174
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:51 PM

    I don't know if hyperscalers did it, but given everybody involved in the AI bubble has been reckless and dishonest my guess is that it's highly probable they did. It's also considered a generally accepted accounting practice (GAAP) these days. Anyway, if they did it it means that when the prices of this mountain of hardware come down the companies owning it will have to do gigantic write downs on their balance sheets, booking huge losses, much larger than if they hadn't. 5/

    💬 6🔄 23⭐ 172
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:51 PM

    But wait, it's worse than this because none of these companies had the money needed to buy this hardware. They either used venture capitals or made loans. Hundreds of billions of loans. And what does a company use as the collateral for a loan? Its own assets, right? Like GPUs. And memory. And the datacenters they're in. Which all of a sudden are losing value. And what do you call a loan whose collateral is insufficient to cover it? An underwater loan. And what does it cause? A margin call: the debtor must either deposit cash or provide a different collateral to compensate. I guess you already know where this is going. 6/

    💬 3🔄 49⭐ 213
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:52 PM

    Every single company in the tech space has negative cash flow. That is they're spending more money than they're making. A lot of it. So how they'll answer the margin call? If this is starting to sound a lot like the subprime mortgage crisis it's because it very much is, but with datacenters instead of houses. 7/

    💬 8🔄 103⭐ 267
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:52 PM

    This is where we have to thank Ed Zitron for his excellent reporting on the finances of these companies and his remarkable work in connecting the dots whenever some CEO talked bullshit to investors while the rest of the press was looking the other way. This is also why the Gamers Nexus investigations about GPU smuggling were so important: the demand could not slow down, by all means necessary, so a little illegal smuggling on the side is OK, say a few tens of billions of it. 8/

    💬 3🔄 72⭐ 350
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:52 PM

    And this is when we start talking about the tech itself and why it is unsustainable. Every single company in this space is losing money, every AI startup, every AI division in an existing company, everybody. They're losing money because the costs of running an LLM - inference - are large, and it's unclear if anybody has been profitable there. But even if they are nobody has been able to cover the escalating costs of training LLMs, which is of course a prerequisite to running them. 9/

    💬 3🔄 45⭐ 187
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:53 PM

    Training LLMs requires a gigantic amount of hardware, brute force calculations, storage, memory and power. Enormous amounts of data whose scraping is not being paid by the companies involved, it's a cost they've spread over the entire internet. As models get larger training gets more expensive. But even as companies sink more money on training LLMs have already reached a plateau in term of functionality and in some cases are degrading in a process called model collapse. 10/

    💬 3🔄 27⭐ 173
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:53 PM

    Let's talk statistics for a minute to understand model collapse. Say you have a bunch of measurements of something and you want to build a mathematical function that will tell you what values appear in the measurements and how often they appear, this is what is called a distribution. A distribution can be used to reproduce the material it was created from, but the output will not be the same because something was lost in the process of making it. The less frequent samples, the stuff that lives at the fringes of your data set, the details. 11/

    💬 1🔄 16⭐ 141
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:54 PM

    Now let's say you use your distribution to generate a new bunch of data: it will look a lot like the inputs you used to make it, but it won't be the same. And if you try to make a new distribution out of that data it will be distorted. You'll lose more information and for every iteration the outputs will look different, they will be more uniform, they'll contain less details, like when you recompress a JPEG file over and over and over. 12/

    💬 4🔄 16⭐ 138
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:54 PM

    And this is exactly what happens when you train an LLM on its outputs, because an LLM is at its core a distribution of human language. It's also the reason why LLM vendors started putting invisible watermarks in LLM outputs. They need to filter out the slop they make from their training set. But even then some slop will make its way in, and even the slop that gets filtered out is still an additional cost: you scraped it, you processed it to check for your watermark, and then you threw it away. 13/

    💬 5🔄 27⭐ 160
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:54 PM

    As the internet gets sloppified the chances of keeping slop out diminish, and the training costs increase. And don't forget that all this training has been done without consent, attribution or compensation of the people making the training materials. This space will be regulated eventually, and when it is that will also make the training costs increase further. 14/

    💬 4🔄 33⭐ 182
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:55 PM

    Which leads us to the hardware itself: this is the point where people will tell you that right now things are looking bad, but the prices will come down because the hardware will improve, and so you'll be able to make powerful local models and whatnot. But here's the thing: hardware improvements are over, in fact they've been for a while. Moore's Law, Dennard scaling, every single factor which lead to faster and cheaper hardware has ceased, years ago. 15/

    💬 5🔄 26⭐ 176
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:55 PM

    There's no magic hardware improvement around the corner, quite the contrary. Every new silicon node comes with smaller and smaller increases in density and performance over the previous one, but at significant increase in costs. A fabrication facility to produce state-of-the-art hardware takes months to go from a silicon wafer to a working chip, using machines that cost billions. 16/

    💬 3🔄 23⭐ 150
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:55 PM

    In other words the only way for a modern high-performance silicon process to be profitable is to produce a large amount of chips that will be sold at high price. See how we're coming back to the artificial scarcity where this all started? To keep the semiconductor market going we need more demand and AI represented the largest demand of silicon ever, but none of that demand was real. So when the prices crash the demand evaporates and the foundries will be left with a lot of idling capacity. 17/

    💬 3🔄 33⭐ 162
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:55 PM

    This will cause a huge amount of capital that was poured into the tech sector to shift elsewhere and this is a good thing. Climate change is weighing down on us and on our future as a species, all the resources we have should be concentrated in fighting it, not chasing a technological fad inflated by a bunch of scammers and mega-rich buffoons having mid-life crises on commercial social media. 18/

    💬 7🔄 102⭐ 303
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 3:56 PM

    I'll wrap this up with an appeal to the people who have been using LLMs extensively in their work, often becoming dependent on them: this is the time to come off this train before it's too late, though it might already be. Nobody is making any money with these things, but they made plenty of debts, so you'll be left holding the bag for the entire tech sector since you're the only ones paying for them. Over and out. 19/

    💬 29🔄 169⭐ 420
  • Nov 14, 2026, 5:40 PM

    @gabrielesvelto Thank you so much for this explaining the financial aspect in a way I actually understand. I read Ed Zitron but really struggle to follow all the jargon. Much appreciated!

    💬 1🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 15, 2026, 1:25 PM

    @stephen it is still possible to work in the sector without using LLMs, but more importantly if you end up using them it's important to have a plan B for when they won't be available anymore, because that day is right behind the corner

    💬 0🔄 0⭐ 0
  • Nov 14, 2026, 6:15 PM

    @gabrielesvelto thanks for this thread, I follow this stuff a fair amount but the potential catastrophe of mark to market wasn't something I had considered

    💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • Nov 14, 2026, 6:53 PM

    @gabrielesvelto Spot on, Gabriel. Exactly what I've been thinking re: the economics of this whole thing, but you've said it more concisely than I've been able to.
    Any chance of having the whole thread put into a blog post or something similar to make referencing it easier? Either way, thanks again.

    💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • 💬 1🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • Nov 14, 2026, 9:46 PM

    @gabrielesvelto I do disagree with your point in post 19 — I think it is possible to make money with probabilistic pattern modelling or statistical sequence prediction in a variety of technical and other fields, perhaps not at the scale and pricing or with the specific products that the famous names are offering today. The invention is out of the bag, it will continue to be refined and improved.

    💬 1🔄 0⭐ 0
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 9:48 PM

    @andyd machine learning can be profitable and will be again in many use-cases, but large language models specifically are not going to be part of it IMHO

    💬 4🔄 0⭐ 0
  • Nov 15, 2026, 12:45 AM

    @gabrielesvelto
    They have a small number of use cases where the technology might be profitable. Mostly things where coming up with plausible and checkable results (e.g. protein folding, antibiotics) based on specific "vocabularies". General natural language models? Inherently uneconomic, I agree.

    💬 0🔄 0⭐ 0
  • Nov 15, 2026, 12:51 AM

    @gabrielesvelto @andyd Your point recapitulates Grady Booch's direct rebuttal of Connor Leahy and Dario Amodei on the value of their LLM driven tulipmania. Booch was careful to point out established ML systems, pre-DL/DANN/LLM, do have value and continue to do so.

    💬 0🔄 0⭐ 0
  • Nov 15, 2026, 8:36 AM

    @gabrielesvelto Necessity is the mother of invention and all that. The small language model and domain specific model are likely to be interesting, accidental, superior technologies. At least for things I’d like to use them for!

    💬 0🔄 0⭐ 0
  • Nov 16, 2026, 1:39 AM

    @gabrielesvelto @andyd I'm curious about this take. I've heard from multiple cases, both online and people I work with, that off-the-shelf LLMs and even lower end ones perform very well on prediction or classification tasks and often better than a custom ML model trained by a data scientist with access to all the potential data the company owns. I don't doubt there are cases where training a custom model isn't advantageous. But an LLM doing well ootb will often be the more viable option, especially for small volume or quickly iterated environments. A small to mid model that exists today won't disappear.
    Am I missing something?

    💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • Nov 14, 2026, 10:16 PM

    This is why it’s so important to retain authorship over the things you produce. If you’re using LLM’s to vibecode or otherwise replace the actual work of understanding what you’re putting your name on. You’re reliant on a system that’s precarious at best.

    I do wonder what the fallout of this will be in terms of existing / trained models. I’m sure these companies will want to milk them for as much value as they can. With slower progress, what will the cost of providing existing models be?

    💬 0🔄 0⭐ 0
  • Nov 14, 2026, 11:04 PM

    @gabrielesvelto
    I, for one, would bet my bippy that the tech bros, hedge funders, data center entrepreneurs, and Ai evangelists are now spending as much time working on ways to unload their debt onto the people who WEREN'T responsible for the Ai bubble as they used to spend creating the Ai bubble. Look out Mr and Mrs taxpayer, the "smartest people in the room" are coming for your wallets and nest eggs.
    #Ai #FinancialBubble #DataCenters

    💬 0🔄 0⭐ 0
  • Nov 14, 2026, 11:52 PM

    @gabrielesvelto Can one add a fake watermark to prevent ones own content being used for training? Even if this is difficult in the general case, it seems to me that one only has to break the technique used once, for some crappy model no one cares about. They have to ignore all known watermarks, not just their own in-house one, right?

    💬 0🔄 0⭐ 0
  • Nov 15, 2026, 12:38 AM

    @gabrielesvelto Capitalism is all about trading long term gains for short term profits. This is just the latest round. Developers are trading their current tech knowledge and craft for short term "get stuff done". They will be left "holding the bag" when AI companies charge the actual price for subscriptions and they are now priced out of the services and don't have any programming knowledge left to do their job.

    💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • Nov 15, 2026, 3:59 AM

    @gabrielesvelto I run Deepseek v4.1 Flash off two Strix Halo boxes. Unless the world economy crashes and I can't afford to pay for electricity (at which point I have bigger issues to worry about), I'll be completely fine.

    💬 0🔄 0⭐ 1
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 15, 2026, 3:17 PM

    @budududuroiu on the short-term yes, but what happens when the model becomes outdated and there's no one left to train it? Local models are sustainable when it comes to running them but just as unsustainable when it comes to training

    💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • Nov 15, 2026, 8:32 AM

    @gabrielesvelto People won't stop using it, the rely on it far too much. Developers who code manually are pretty much gone. It's like if you told people to stop using cars and planes to bring down carbon emissions, it's not going to happen, they'd rather watch the world burn. Also local inference has come a long way and there is probably a lot of architectural improvement do be done so models run with less resources. My take: AI coding is here to stay

    💬 1🔄 0⭐ 0
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 15, 2026, 8:53 AM

    @jaj I've never used AI for coding and I never owned a car so it's possible. For the rest we'll have to wait and see, but the odds are completely stacked against LLM use in the future, which is also why the industry spends so many resources telling everybody it's here to stay. Do you remember Apple and Google having to tell everybody that smartphones were here to stay? Me neither.

    💬 4🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • Nov 15, 2026, 12:52 PM

    @gabrielesvelto @jaj 💯 sowing FUD.

    I was never told I needed to get on board with compilers because my assembly skills would make me obsolete overnight. I used a compiler when it was *obviously* better than shuffling registers. And even then, for a long while the compiler made mistakes that made looking at the register-shuffling it did necessary.

    Which is exactly where we’re at with “AI”. It can’t be trusted. The exponential improvement has not materialised. And anyone with a high-school level of statistics knowledge can tell you that using an averaging machine on its own output will never produce something better than before.

    💬 0🔄 0⭐ 0
  • Nov 15, 2026, 12:57 PM

    @gabrielesvelto Of course it's possible. You are talking about economics. Economics is not about what is possible but what is commonly done

    💬 0🔄 0⭐ 0
  • Nov 17, 2026, 7:32 AM

    @gabrielesvelto @jaj

    I agree, esp as the UK government wants to REDUCE screen time for kids and get them back to reading, writing and critical thinking, research skills etc. Hopefully as part of that, there will be proper debates as to HOW AI can be useful (more for the Machine learning analysis side of things), debates on copyright / copyleft etc.

    Maybe, just maybe the whole AI system will collapse along with the 7 big tech companies who will go down with them.

    💬 0🔄 0⭐ 0
  • Nov 15, 2026, 10:32 AM

    @gabrielesvelto

    This is really just the beginning of the situation. The first domino.

    The entire US economy is being held up by AI right now. When AI crashes, so will everything.

    And given the reliance of the global economy on the US dollar, this will have a worldwide impact.

    We all know that AI is going to crash spectacularly. What is harder to predict is how various states & institutions will attempt to limit the scale of the chain reaction from there.

    💬 0🔄 0⭐ 0
  • Nov 15, 2026, 11:31 AM

    @gabrielesvelto I would only quibble on one thing. The foundries will not be left idle. It will be filled and fab prices might drop a shade to do it. The fab cannot afford to be idle and customers have plenty of ways to fill it once the price is right

    💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • Nov 15, 2026, 5:01 PM

    @gabrielesvelto that's a really interesting thread. Can you share the source that claims the GPU oversupply? Really curious.

    💬 1🔄 0⭐ 0
  • 💬 2🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0