And from my experience trying to use it for programming, I know it absolutely will try its best to reach an unbounded goal you set for it even if it means creating the most convoluted and unmaintainable spaghetti code you've ever seen, or even trying to find loopholes to suppress error messages without actually fixing the error.
It treat it like the Marines do. You're never a "former" astronaut once you earn the title. That's an accomplishment that a fraction of a fraction of humans currently alive will ever achieve.
If you're doing it for yourself, fine. If you're writing for me, don't waste my time by making me have to decipher your custom scribble that's never consistent with anyone else's, unlike normal print.
My ex wife for one, who would like to play Steam games but is not experienced enough to build and fiddle with a gaming PC, much less Linux, and just wants a box she can just plug in and turn on without calling all the IT folks in her family.
Don't forget about our nerd bias. Most people here have a different perspective than 95% of normies. Remember how clueless the average person is about the inner workings of modern tech.
I see it as anybody too young to remember a world that wasn't connected 24/7, somebody who in their child/teen years that didn't make heavy use of the phone attached to the kitchen wall to contact friends. Someone who's never had to seriously use dialup Internet or an 8/16 bit computer.
There was an idea I read about, sorta along the same crazy track, (might have been Popular Science or something like 25 years ago) where they came up with an idea for a jet that didn't use traditional control surfaces like ailerons, but rather line the wings and fuselage in thousands of tiny flaps that would all be precisely computer controlled. It would be able to basically mold and shape the airstream around itself to make precise movements.
Off topic, but I think it's funny that the cutoff for a more modern worldview ends at 50 now, because all the older millennials are well into their 40s now and we have to include them because they were a main driving force behind "occupy" movement 14 years ago.
10 years ago you saw "under 40" being thrown around. 😂
Don't need to be able to think to cause mass devastation with a rogue AI. I present the paperclip problem: https://en.wikipedia.org/wiki/Instrumental_convergence
And from my experience trying to use it for programming, I know it absolutely will try its best to reach an unbounded goal you set for it even if it means creating the most convoluted and unmaintainable spaghetti code you've ever seen, or even trying to find loopholes to suppress error messages without actually fixing the error.