Post #1722076

@trentshell @jkb @jneen Even if LLMs, as they get better, create fewer bugs than humans, we’re still bottlenecked by verification and understanding. When writing code, understanding develops naturally, but with LLMs it must be done explicitly. The problem is that their default usage mode doesn’t really encourage this (which is fine for prototyping but not for production). (One can argue that “dark factories” are the way forward, but I’m not sure how well an organization that doesn’t have knowledge about its systems will fare. It will be constrained by whatever the LLM capabilities of summarizing and modifying the system are at any given point in time, beholden to whoever produced the model. And for sure the organization won’t be able to innovate, as LLM aren’t good at extrapolating outside their training data.)