While I haven't experienced it, I believe I kind of know what it can be like. Just a little something can trigger a reaction
But I maintain that LLMs can't be changed without huge tradeoffs. They're not really intelligent, just predicting text based on weights and statistical data
It should not be used for personal decisions as it will often try to agree with you, because that's how the system works. Making looong discussions will also trick the system into ignoring it's system prompts and safeguards. Those are issues all LLMs safe, just like prompt injection, due to their nature
I do agree though that more prevention should be done, display more warnings
Some food additives are responsible for cancer yet are still allowed, because they are generally more useful than have negative effects. Where you draw the line is up to you, but if you’re strict, you should still let people choose for themselves
LLMs are incredibly useful for a lot of things, and really bad at others. Why can’t people use the tool as intended, rather than stretching it to other unapproved usages, putting themselves at risk?
If people purchase a knife and behave badly with it, it’s on them
Something writing things isn’t comparable to a machine that could kill you. In the end, it’s always up to the person doing the things
I still wonder how ClosedOpenAI forcefully installed ChatGPT in this person's home. Or how it is installed because they don’t have software…
Quit your bullshit
The more safeguards are added in LLMs, the dumber they get, and the more resource intensive they get to offset this. If you get convinced to kill yourself by an AI, I'm pretty sure your decision was already taken, or you're a statistical blip
For some reason I got mixed up and talked about crypto, oops