Post #3978854
2026-07-20 11:44 UTC
Replies (1)
-
@Noneeeed@hachyderm.io 2026-07-20 11:55
@neil@mastodon.neilzone.co.uk It's like the issue in car driver assistance systems like Tesla's "autopilot" where the system does the driving most of the time but the driver is expected to be able to monitor it, keep situational awareness and then step in when something it can't handle comes up. Even just cruise control can cause confusion with the handoff with many "unexplained accelerations" being caused by drivers hitting the accelerator not the break while in cruise, then getting confused when the car speeds up. It's a ridiculous expectation. I used to work in safety critical systems and this has been a problem for decades. Many air crashes have been the result of a problem between the auto-pilots and the squishy meatbag pilots. e.g. the 737 max ones a few years ago.