How much would you pay to trust an algorithm that hallucinates you into a crash?

“In the crash footage, there’s a shadow across the road from a “Watch for Trucks” sign. My theory? Tesla’s neural net saw that shadow and panicked.

Instead of recognizing it as just a dark spot on the pavement, the system may have hallucinated an obstacle and took evasive action—by jerking left, directly off the road.

Insane? Yes. But this is how Tesla’s so-called “neural network” sees the world. It doesn’t use LIDAR. It doesn’t use radar. It relies on vision only, and so it can misinterpret 2-dimensional images that are processed through machine learning that’s notoriously difficult to debug or explain after the fact.”

https://fuelarc.com/tech/tesla-full-self-driving-veers-off-road-hits-tree-and-flips-car-for-no-obvious-reason-no-serious-injuries-but-scary/