Some people use AI / LLMs to completely vibe code something whereas some use it simply as a tool to augment their own capabilities.

Regardless of the use case, running models locally can be confusing with all the technical requirements, token jargon, and metrics.

In this article, we dive into what it takes to actually running various models locally and what those context windows actually mean in terms of capability and requirements. **Note**, lots of jargon inside, but we tried to explain to the best of our minimal understanding of the tech, our understanding of WTF the numbers meant.

Also included in the article, a simple bash script to run your own performance tests on your own hardware!

We looked at a few models, including DeepSeek, Qwen, Codestral, and Gemma.

https://bitsnbytes.dev/posts/2026-10/comparison-and-tuning-local-ai.html

#AI #LocalAI #Benchmark #Testing

@jamesthomson and probably half the people who were alive when each happened are alive now

@jsnell @imyke I remember installing Soundjam MP on a PowerMac 9600 200/MP and a 9600 350 at the Apple reseller I worked at to see which could rip mp3s faster, so this last episode was right up my alley

@stroughtonsmith I'm willing to wait on the Duo until at least the next revision to see what hardware issues there are and to wait for more software support.

@jsnell @imyke I'm just hoping you give equal treatment to the development of the 1.8" drive form factor then the changeover from to the IBM micro drive size and discussion of the evolution of the Compact Flash drive format with the iPod Mini, finishing with the Mini's discontinuation by the pure flash storage iPod Nano

@rustyshelf I got a cheap 3rd party wireless CarPlay display unit for my 2014 car and that gives me a pretty great setup that could be replicated in any car with a place to mount such a unit

@stroughtonsmith I think this is likely because the device was initially meant to ship 1.5 years ago. I wonder if they've been sitting in a warehouse. The A18 processor makes that scenario plausible

@stroughtonsmith I think the sweet spot for most people is the non-pro phone. Unless they need the telephoto camera, I don't see a compelling reason to go with the pro these days. Perhaps that's one reason they've delayed the non-pro 18 to Spring compared to the 17 shipping at the same time as the 17 pro

@lexfri @caseyliss @Firewire the R2 is definitely less efficient than the Model 3, but it's not necessarily important enough to change your buying decision. This video shows a Model Y performance with 82 kWh pack goes (adjusting for speedometer being off) 310 miles on a charge while the Rivian R2 performance with 87.9 kWh pack goes (again Speedo adjusted) 253 miles. Model 3 is even more efficient than Model Y https://youtu.be/9Ar417CfeuA?is=l5nd75bgnaHgAKtF

@siracusa my wife bought a 2026 Toyota C-HR and it is missing the physical fan speed control, the temp control is pseudo physical: it's a knob that changes a software setting, and has no glove box at all, but the arm rest storage can be hinged open from either the drive or passenger seat and there's a storage area under the phone chargers and gear selector in the center console area, but still annoying. Otherwise it eschews EV weirdness. Bonus missing feature: no rear wiper, maybe something to add to your list

@stroughtonsmith @verge not so absurd when the DGX Spark is listed for $6950 at Microcenter and isn't actually available to order. The Amazon listings have the DGX Spark at $9000 with the "from Amazon" listing at $9888.87

@stroughtonsmith @Gamespot I'm really glad they didn't ship with only HD models as they were initially planning. One of the big wins from the feedback they got from Savix and the others they invited for the early look at Blizzard HQ. I agree with you and think they were hoping to leverage existing HD models from retail content for the Forever expanded content, but I think that would get even more backlash from the community. If they better understood what made the original artwork so great, I'd have more trust in their judgement, but they haven't proved that yet.

@programmablecat @tvaziri this would really start to push upper management from loving the open office layout to feelings of regret

@tvaziri the Fat Nano version of the iPhone Air?

@stroughtonsmith isn't the issue that the low gloss of the top layer will wear out, so will need periodic replacement? My understanding is they minimize the visibility of the crease by having less specular reflection which diminish shape of the warping around the crease

@ics Recent coverage: https://www.cnn.com/2026/09/28/us/cornell-university-sexual-assault-lawsuit-hnk

New Valheim Lore video dropped; a bit long, but IMO worth the watch.

https://www.youtube.com/watch?v=GVIgDikx_Og

#Valheim #Gaming #Lore #Video

@stephenrobles possible downsides: you might become more susceptible to a more charismatic business partner taking advantage of you, and you may develop an attraction to Kathy Griffin

@stephenrobles Wearing a Woz shirt should definitely make you better at practical jokes and designing floppy disk drives

@stroughtonsmith might be interesting to see how different the percentage is for active iPhone app developers buying a Duo