Login
You're viewing the discuss.systems public feed.

Replies

  • Martin Taibrmartin_t@mastodon.social
    Oct 17, 2026, 9:36 PM

    @argv_minus_one @HeckinChonker @leontheloner @prefec2 @nixCraft
    I hate to sound like the hypers but 1) you used shit models - any model with small or mini in name is gonna be shit. 2) you used them as chat, not in a loop with deterministic tools (as "agents")

    Truth be told, I don't use them in loops, I also only use chat but I can already see how sometimes it takes 5 or more prompts to get the right output. It's frustrating for a human but in a loop where it can run tests, it'll only 1/n

    💬 2🔄 0⭐ 0
  • Martin Taibrmartin_t@mastodon.social
    Oct 17, 2026, 9:39 PM

    @argv_minus_one @HeckinChonker @leontheloner @prefec2 @nixCraft
    the final solution.

    The trick is they're monkeys on typewriters with a somewhat good heuristic. If they only produce correct results 1 out of 10 tried but they can try things 100x faster than a human, they're a net economic win. It also explains why they're really good at stuff where they can mechanically verify the output but then completely go off the rails in ways no human would.

    Out of curiosity, can you try better models?2/n

    💬 1🔄 0⭐ 0
  • Martin Taibrmartin_t@mastodon.social
    Oct 17, 2026, 9:42 PM

    @argv_minus_one @HeckinChonker @leontheloner @prefec2 @nixCraft
    Anthropic lets me use Sonnet 5 with a free account. Try setting the effort level to medium or high, see what happens.

    "Open""AI" doesn't let me select a model in their interface but when prompted, it generated that it is GPT-6 which sounds like BS to me but worth trying your prompt there as well.

    (I'd do it myself but I can't verify whether the answer is correct or not and I find it rude to submit other people's work to LLMs)

    💬 0🔄 0⭐ 0
  • argv[-1]argv_minus_one@mastodon.sdf.org
    Oct 17, 2026, 9:51 PM

    @martin_t

    You definitely sound like the hypers.

    Obviously I'm not going to fund Anthropic, so no.

    Nor am I insane enough to give a bot permission to execute arbitrary code on my computer. They can verify their work on their own damn computers.

    I don't need a bot to throw s**t at the wall to see what sticks. If I needed that, I'd hire a teenager. I need code that's carefully designed, with all the consequences and edge cases carefully handled.

    @HeckinChonker @leontheloner @prefec2 @nixCraft

    💬 2🔄 0⭐ 0
  • Martin Taibrmartin_t@mastodon.social
    Oct 17, 2026, 9:57 PM

    @argv_minus_one @HeckinChonker @leontheloner @prefec2 @nixCraft
    That's why I said to try free models. Even the free ones I proposed will have more stolen work in them than the small/mini you used. You're likely not even giving them any data they don't already have since you posted the prompts publicly.

    I am on your side, I literally have a half-written blog post titled Artificial Intelligence and my Penis. I feel exactly like you. But sticking your head in the sand doesn't solve anything.

    💬 1🔄 0⭐ 0
  • argv[-1]argv_minus_one@mastodon.sdf.org
    Oct 17, 2026, 10:12 PM

    @martin_t

    I mean, you yourself described it as a monkey with a typewriter that only produces correct results once out of every ten attempts, and attempts to solve its failures by brute force instead of logic and learning. I have no need for that.

    Anyway, feel free to feed it my prompts yourself, if you're curious as to what it will do. They are, as you say, public knowledge now. But I am not curious.

    @HeckinChonker @leontheloner @prefec2 @nixCraft

    💬 0🔄 0⭐ 0
  • Martin Taibrmartin_t@mastodon.social
    Oct 17, 2026, 10:10 PM

    @argv_minus_one @HeckinChonker @leontheloner @prefec2 @nixCraft
    BTW, I absolutely hate when people who've been hyping LLMs for 3 years keep saying "try the latest model". They're like a broken clock. Except a broken clock is right twice a day, then goes back to being wrong. LLMs still produce a lot of shit but keep getting less bad. I bet latest free models can gen a sudoku solver 99 times out of 100. Bigger tasks soon. And once those assholes stop being wrong, they'll stop being wrong forever.

    💬 1🔄 0⭐ 0
  • argv[-1]argv_minus_one@mastodon.sdf.org
    Oct 17, 2026, 10:27 PM

    @martin_t

    Mm. In that case, maybe my family can use this future LLM to replace me, and I can finally check out of this godforsaken hopeless hellscape.

    But so far, I'm not seeing any evidence of what you're saying. My coworker continues to email me a firehose of asinine slop from full-size Claude that no intelligent human expert would ever write.

    @HeckinChonker @leontheloner @prefec2 @nixCraft

    💬 1🔄 0⭐ 0
  • 💬 1🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • 💬 0🔄 0⭐ 0
  • argv[-1]argv_minus_one@mastodon.sdf.org
    Oct 19, 2026, 3:53 PM

    @martin_t

    The guy I was talking to in that thread turned his agent on the problem. It epically failed too. mastodon.sdf.org/@argv_minus_o

    Bots aren't just expensive and proprietary and full of ethical issues. They also don't work as advertised. They're great at generating generic marketing copy and whatnot, but as soon as the bulls**t stops and the actual engineering starts, they fall apart.

    @HeckinChonker @leontheloner @prefec2 @nixCraft

    💬 0🔄 0⭐ 0
  • Heckin' ChonkerHeckinChonker@mastodon.social
    Oct 17, 2026, 11:49 PM

    @argv_minus_one @martin_t @leontheloner @prefec2 @nixCraft I've only used copilot and claude, as part of my companies subscription. Copilot was garbage. Clade has been much better. Its typically only wrong when its missing some domain knowledge that was not in its context, and its trivial to resolve those cases.

    I understand not wanting to use them for ethical and moral reasons. I'm only using them at work myself because it very much feels like the alternative is losing my source of income.

    💬 0🔄 0⭐ 0