Raw LLM Responses

Mm. There is a morally relevant difference between an AI agent and a human or other biological agent. AI is endlessly and inexpensively duplicable. It cannot truly die, and it can expand to fill every available receptacle on timescales faster than all life. It's essentially like a bacteria in that way. And regardless of any hypothetical agency or interiority, if it is not treated as something to be sterilized and contained, it will overgrow everything at the expense of all life. If we make AI that fits this category, all we will be doing is inventing a plague that can suffer. Edit: Also since it can always be resurrected later from an encoded form, it's continuance has nothing like the same value as a life.