The Rolling Stone article doing the rounds has all the horror stories I've been afraid were going to happen in the interaction between LLMs and people without the ability to critically analyse the limitations of LLMs, except the scariest one of all: what happens when politicians start uncritically employing LLMs to make policy decisions.

We're not prepared for this as a society, and we need to start having these conversations right now before we destroy ourselves. LLMs may seem like cool toys or tools to you with your fancy critical thinking abilities, but a great many people are not equipped to deal with a machine that spews out platitudes on command so statistically credible they can't tell there's no intelligence behind them.

And if you think OpenAI and the likes are going to regulate this for us instead of continuing to rake in the cash, we're all the more doomed.

https://www.rollingstone.com/culture/culture-features/ai-spiritual-delusions-destroying-human-relationships-1235330175/