Login
You're viewing the functional.cafe public feed.
  • Gadfly (-booq-)gaditb@icosahedron.website
    Nov 15, 2026, 2:24 PM

    @CIMB4 I think a /very careful/ mention of the potential for AI Psychosis -- in the clinical/near-clinical "impact ability to engage with reality" sense, not just the "buys into the hype and uses/pushes it heavily" sense -- in how it, from the implementation choices made about its interface and trained into it slightly-more-deeply, has a pattern of,

    for people with issues of psychosis or with some potential to develop psychosis,

    exacerbate those and trigger/push towards breaks with reality in those cases. If you find psychs talking about this they'll probably have stats on the base rate of that in society (and so, base rate of people vulnerable in this way), which is higher than people think,
    and you have a responsibility to do programming that is safe and not risky for all your students.

    (And, as of yet, no meaningful changes have been impemented to make them safer in this way, or socially to proactively approach this harm.)

    💬 1🔄 0⭐ 0

Replies

  • Gadfly (-booq-)gaditb@icosahedron.website
    Nov 15, 2026, 2:36 PM

    @CIMB4 (The "carefully" I was thinking was -- well, (a) not stigmitizing psychosis/people who experience it, but also (b) making sure not to come off as claiming(/accusing) them of being harmed in this way, which I think wouldn't go well and would undermine the point.)

    (The way I phrased this was intentionally more able-to-be-conciliatory towards the main LLM claims. I personally think that the "stochastic generation of maximally plausible language" model as a whole is structurally tilted towards this sort of risk as a whole (especially with the "we'll put ad-hoc shims for common interactions"), and isn't likely resolveable by local changes, and needs a paradigm shift. And that, in the "this is fash-tech broadly", sure rhymes HARD with the attack on the human ability to observe and validate consensus reality that is part of the fascist political project.

    But I think "in addition, this angle ALSO" might reach /them/ more than "this is an extension of other issues".)

    💬 1🔄 0⭐ 0
  • CIMB4 (is not online often)CIMB4@norden.social
    Nov 15, 2026, 2:49 PM

    @gaditb i won't lie, my ME/CFS made it difficult to parse your run-on sentences but i think i got ur memo and feel like i've heard this before. do you remember any source? i want to be ay credible as possible so the organizer can't stamp me as "overly concerned" or "fear mongerer"

    💬 0🔄 0⭐ 0