Login
You're viewing the functional.cafe public feed.
  • Nov 1, 2026, 11:59 PM

    As a general guideline I avoid Hacker News, but someone linked me comments from people who worked at Orkes, maker of ParticleDB, in the thread about the devastating Jepsen review of their software (jepsen.io/analyses/particledb- if you haven’t seen it).

    So I clicked and read the comments, then skimmed the rest of the thread, and I recognized a name. A well-known person, who posted that he simply couldn’t believe that the Orkes folks could have been using LLMs properly and still wound up in such a situation.

    But this is the thing: modern “agentic” LLM workflows explicitly encourage you to remove all human review from the loop, and rely on orchestrating a bunch of LLM agents to generate and adversarially review and fix up code. In fact, sooner or later you’re likely *forced* to do this, because the whole selling point of LLMs for coding is they can generate so much code, so quickly, that no human could hope to keep up.

    And apparently the Orkes folks were in fact using adversarial LLM review, and judging by the magnitude of the issues Jepsen found from even basic testing, it seems likely there was minimal or no human review in the loop.

    It’s not surprising to me that they wound up with misplaced confidence in the quality and reliability of their software by going down this road. They’re not the first team this has happened to. They likely will not be the last.

    What surprises me is the refusal on the part of everyone seeing it to learn anything from this. The insistence that the basic workflow *must* be sound (since all the big names are using it), so it must have been that someone at Orkes was holding it wrong.

    Anyway. I’m in the middle of writing another installment to my “Boring Python” series of articles, this time focused on testing, so this is on my mind a lot, and it’s just staggering that so many people are willingly disconnecting themselves from any way of knowing whether their software actually works and then being surprised when that software turns out not to work well, or at all.

    💬 8🔄 70⭐ 121

Replies

  • Nov 2, 2026, 12:32 AM

    @ubernostrum the most charitable interpretation of these defenses ("they must have been doing it wrong") is that agentic development is a very rare skill. That it's not an evolution like higher-level programming languages where it's harder to make mistakes, but is rather something only suitable for niche applications where high volume output makes finding these few actually good Agentic engineers worth it. That, or this workflow isn't viable yet but will be in the future.

    💬 0🔄 0⭐ 3
  • 💬 0🔄 0⭐ 0
  • Nov 2, 2026, 12:46 AM

    @ubernostrum I find it very interesting that the industry is Theranos now, and by interesting, I mean, probably not a good idea if one is interested in civilisation not grinding to a halt.

    💬 0🔄 0⭐ 7
  • Nov 2, 2026, 1:58 AM

    @ubernostrum Disbelief often goes hand-in-hand with the underlying assumption that the subject is magical, i.e. no longer even trying to understand practical limitations or simpler explanations.

    I see the comment thread that you’re referring to and am (and have been) similarly disappointed in said individual for such magic beliefs

    💬 0🔄 0⭐ 1
  • 💬 0🔄 0⭐ 0
  • 💬 0🔄 1⭐ 5
  • 💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 1