That absurdity doesn’t need modern AI. All it takes is any statistical system that automates human interaction.

See Robodebt (Australia - https://en.wikipedia.org/wiki/Robodebt_scheme), which lead a number of people to suicide, as an example.