Post #2189077
2026-04-02 23:23 UTC
@jacob@social.jacobian.org Responding to the thread as a whole, I think code readability will matter just as much as cockpit black boxes matter.
The universe is against us even with bug-free hardware and software. Even the perfect self-driving car will kill some people. The perfect AI doctor will lose some patients. The perfect automated factory will assemble some lemons.
We will need to be able to learn why and how it happened. Step by step. So, logs and readable code. Otherwise trusting automation is impossible
Replies (1)
-
@pythonbynight@hachyderm.io 2026-04-02 23:30
@ambv@mastodon.social @jacob@social.jacobian.org Definitely... I was going to say something about accountability, but this is pretty much my thought too. Especially as it's incredibly unlikely that anyone would one-shot a perfect implementation, even more so for something that is extremely critical. If we can't understand "why" something went wrong, how do we account for it? Was it negligence? Can someone be held accountable? Is the prompting wrong or is the code wrong? I can see why that's a dream scenario for a corporation, though.