Login
You're viewing the functional.cafe public feed.
  • Gabriele Sveltogabrielesvelto@mas.to
    Nov 14, 2026, 9:48 PM

    @andyd machine learning can be profitable and will be again in many use-cases, but large language models specifically are not going to be part of it IMHO

    💬 5🔄 2⭐ 23

Replies

  • Nov 15, 2026, 12:45 AM

    @gabrielesvelto
    They have a small number of use cases where the technology might be profitable. Mostly things where coming up with plausible and checkable results (e.g. protein folding, antibiotics) based on specific "vocabularies". General natural language models? Inherently uneconomic, I agree.

    💬 1🔄 0⭐ 3
  • David Megginsondavid_megginson@mstdn.ca
    Nov 15, 2026, 2:22 AM

    @a_cubed It's hard to see how companies could gain a competitive advantage from being genAI users, though, since everyone else has access to exactly the same models.

    Even if genAI lived up to its promises (a big "if"), it would be essentially a utility, like electricity or internet, but the shares of AI providers aren't priced like utility companies.

    @gabrielesvelto

    💬 2🔄 1⭐ 1
  • 💬 0🔄 0⭐ 0
  • Nov 15, 2026, 8:07 PM

    @david_megginson @a_cubed @gabrielesvelto Transformer models can do really quite well when the underlying ground truth is smoothly differentiable. This is the case in quite a few scientific domains (because science looks for this).

    But human thought turns out to not be a projection on a smooth differentiable hypersurface. It's got elements that are more complex. (It's also necessarily dynamic, but that's a different problem.)

    💬 0🔄 0⭐ 0
  • Nov 15, 2026, 12:51 AM

    @gabrielesvelto @andyd Your point recapitulates Grady Booch's direct rebuttal of Connor Leahy and Dario Amodei on the value of their LLM driven tulipmania. Booch was careful to point out established ML systems, pre-DL/DANN/LLM, do have value and continue to do so.

    💬 1🔄 0⭐ 7
  • Nov 15, 2026, 1:25 AM

    @bms @gabrielesvelto @andyd yep (non-LLM, non-GPT/NN) ML is useful for spam identification, for example, but it relies on much simpler and less sexy techniques like SQL data mining, regexp pattern matching and Bayesian inference graphs like with Graham/Viaweb's "if email subject or body has Viagara, 99% chance is spam" rule. none of Nvidia's hardware needed for that. Google itself relies on unpaid crowdsourced data labelling by its own userbase to "train" its Bayesian inference classifiers still, AFAIK

    💬 1🔄 2⭐ 1
  • 💬 0🔄 0⭐ 3
  • Nov 15, 2026, 1:42 AM

    @gabrielesvelto @andyd I think there will still be some cases where LLMs get used even after "subsidies" are gone. Anyone who is already finding value from open-weight models on their own computers are going to keep doing it, and anyone who is willing to throw a *lot* of money at their problems will be fine with expensive LLM services.

    💬 1🔄 0⭐ 3
  • Nov 15, 2026, 7:24 AM

    @varx

    Open-weight models are trained by the big commercial ones (Claude etc). If the bubble pops, it'll take open-weight models down with it.

    Of course, you'll be able to keep using your open-weight models after that, but you won't be getting any more updates.

    @gabrielesvelto @andyd

    💬 1🔄 0⭐ 3
  • 💬 1🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • Nov 15, 2026, 8:36 AM

    @gabrielesvelto Necessity is the mother of invention and all that. The small language model and domain specific model are likely to be interesting, accidental, superior technologies. At least for things I’d like to use them for!

    💬 0🔄 0⭐ 3
  • Nov 16, 2026, 1:39 AM

    @gabrielesvelto @andyd I'm curious about this take. I've heard from multiple cases, both online and people I work with, that off-the-shelf LLMs and even lower end ones perform very well on prediction or classification tasks and often better than a custom ML model trained by a data scientist with access to all the potential data the company owns. I don't doubt there are cases where training a custom model isn't advantageous. But an LLM doing well ootb will often be the more viable option, especially for small volume or quickly iterated environments. A small to mid model that exists today won't disappear.
    Am I missing something?

    💬 1🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0