Visuals are interfaces. The way LLMs and we interact with the computer/world is different, so interfaces are almost the only exception, I'd say.
However, I've heard of some research suggests that images could help them perform better.
Visuals are interfaces. The way LLMs and we interact with the computer/world is different, so interfaces are almost the only exception, I'd say.
However, I've heard of some research suggests that images could help them perform better.
1. I'm unfamiliar with any devtool that isn't an interface to some otherwise opaque part of the system or an additional abstraction layer. Maybe devtools are broader than that it's not my exact area.
2. LLMs don't interact with the world. They predict next tokens stochastically. Harnesses interact with the world in predefined ways based on token output. LLMs have no world model and no internal ideas. We need to be epistemologically precise about real technology.