Login
You're viewing the functional.cafe public feed.

Replies

  • 💬 1🔄 0⭐ 0
  • Nov 6, 2026, 9:19 AM

    @leonid `But from a global allocation perspective, actually, it’s quite terrible to have everybody have a bunch of the world’s limited supply of DRAM sitting in their own computer. And, being used 5% of the time. You want maximum utilization in the cloud if you’re trying to deal with this very supply constrained environment.`

    💬 2🔄 0⭐ 0
  • Nov 6, 2026, 9:21 AM

    @leonid Moved into a different context, this is basically the same argument as: If you're trying to save fuel, public transport is a lot more efficient than individual cars.

    💬 0🔄 0⭐ 0
  • 💬 1🔄 0⭐ 0
  • Nov 6, 2026, 9:25 AM

    @leonid I know. I'm not saying Altman is a good guy. He deserves all the scrutiny. So does "AI" in general. Still, this statement should not be as shocking/produce such a big backlash. It's one of the most harmless things he's said.

    💬 1🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • Nov 6, 2026, 9:22 AM

    @preya it was not limited before. The AI industry created the constrained environment. And now the RAM in my PC is the problem?

    💬 1🔄 0⭐ 0
  • Nov 6, 2026, 9:24 AM

    @leonid Any physical good is limited. Always. We just didn't feel it before AI came along. All he is saying: We have a limited amount of RAM. If we want to use it efficiently, putting it into a data center is better than in individual PCs. It's a stupid and very obvious statement. But it's true.

    💬 2🔄 0⭐ 0
  • Nov 6, 2026, 9:27 AM

    @preya hmm... it's not as simple as putting it in a data centre and being done with it. Data centres will also constantly be upgraded and new ones built. Using limited resources won't stop just because we eliminate PCs.

    💬 0🔄 0⭐ 0
  • Nov 6, 2026, 9:34 AM

    @preya @leonid s/We just didn't feel it before AI came along./OpenAI participated to an exponential increase of demand in such a way that RAM has now become a scarce commodity./

    💬 2🔄 0⭐ 0
  • Nov 6, 2026, 9:37 AM

    @preya @leonid I don't find the data center argument compelling, as putting all our personal machines in data centers would:

    - centralize (political) power even more
    - radically simplify surveillance
    - require renting computers instead of owning them (so renting GPUs, which are scarce too; say farewell to PC gaming)
    - require constant internet connection so large improvements in infra (bandwidth) + de facto excluding many people from getting computers
    - increase clean water consumption

    💬 1🔄 0⭐ 0
  • Nov 6, 2026, 9:40 AM

    @bnjbvr @leonid I totally agree. Still, from an efficiency standpoint the statement is true. Of course, we can use resources more efficiently if they're centralized. This is true for energy generation, transport, computing, food, whatever.

    💬 1🔄 0⭐ 0
  • Nov 6, 2026, 10:03 AM

    @preya @leonid Apart from the fact that efficiency is a tradeoff with power decentralization: i think even in terms of clean water consumption, it's not clear data centers would be better than individual machines, since individual machines are most often NOT watercooled at all

    💬 1🔄 0⭐ 0
  • Nov 6, 2026, 10:08 AM

    @bnjbvr @leonid If we define "energy" as the specific resource we're comparing, watercooling is MUCH more efficient than air cooling. So again, a data center would win in terms of efficiency. But yeah, using potable water to remove that energy is obviously a shit idea and shouldn't be allowed.

    💬 0🔄 0⭐ 0
  • Nov 6, 2026, 9:39 AM

    @preya @leonid This is where i find his statement utterly hypocritical: ohnoes, i've made RAM a scarce commodity, and now i'm complaining that other people are using it!

    (insert bike-stick-bicycle meme here)

    💬 1🔄 0⭐ 0
  • Nov 6, 2026, 9:42 AM

    @bnjbvr @leonid Absolutely. This is the part that's scandalous. But all the media/meme coverage mostly doesn't cover this aspect.

    💬 0🔄 0⭐ 0
  • Nov 6, 2026, 9:48 AM

    @preya being "technically correct" is, contrary to popular memes, not the best kind of correct.

    I think it is also technically incorrect, but for that I make a couple of assumptions about the usefulness of large AI datacenters you are probably not sharing. Otherwise you would have not felt compelled to make that statement.

    💬 1🔄 0⭐ 0
  • Nov 6, 2026, 9:54 AM

    @halfbyte If you're trying to say "We don't need large AI datacenters at all": I (mostly) agree.

    I felt compelled to make that statement, because I feel it's important to understand that in 90% of areas in live, centralization will always be more efficient (in terms of resource usage) than decentralization. That does not mean, we should prefer centralization. We should just be honest about it.

    💬 1🔄 0⭐ 0
  • Nov 6, 2026, 10:56 AM

    @preya Yeah, that statement in itself might be true, but in the case of LLM's (and specifically, in the case of OpenAI who are responsible for a large chunk of the RAM crisis) you're leaving out so much important context that the statement, while, again, technically true, is just a hot garbage take. And it starts with uttering the sentence "We should just be honest about it" in the context of something Sam Altman said.

    💬 0🔄 0⭐ 0