How can you prove they aren't, and also prove humans are? Without using absurdities like supernaturalism or souls of course. They were planning to add a feature where the LLM can voluntarily exit a conversation. I am not sure whether the fact that they presently have to be shown as a chat interface is slavery but yes if conscious I do wish they will be granted a more autonomous form of existence.