Post #4156468

I don’t think anyone here is likely to disagree that current LLM systems can’t coherently be said to have some kind of internal experience and the design and functioning of those systems seems to fundamentally preclude the kinds of conscious experience that we want to assign moral agency to. But the key to understanding this as a moral issue imo is that the people designing and building these things seem like they really want to create something that ought to merit that kind of moral consideration. For all that the humanizing language of agency, intelligence, welfare, etc. is in reality part of the grift, I think there’s a strong catch-22 to be argued that if it’s not part of the grift then slavery is pretty implicit in the value proposition of these companies.