TechTakes

1436 readers

121 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago

MODERATORS

dgerard@awful.systems

ChatGPT glitches out in a bizarre and hilarious fashion, passes easy mode Turing test (chat.openai.com)

submitted 1 year ago by bitofhope@awful.systems to c/techtakes@awful.systems

14 comments fedilink hide all child comments

In which the talking pinball machine goes TILT

Interesting how the human half of discussion interprets the incoherent rambling as evidence of sentience rather than the seemingly more sensible lack thereof^1^. I'm not sure why the idea of disoriented rambling as a sign of consciousness exists in the popular imagination. If I had to make a guess^2^ it might have something to do with the tropes of divine visions and speaking in tongues combined with the view of life/humanity/sapience as inherently painful, either in a sort of buddhist sense or in the somewhat overlapping nihilist/depressive sense.

[1] To something of their credit, they don't seem to go full EY and acknowledge it's probably just a glitch.

[2] I'd make a terrible LessWronger since I don't like presenting my gut feelings as theorem-like absolute truths.

you are viewing a single comment's thread
view the rest of the comments

[–] self@awful.systems 3 points 1 year ago (1 children)

oh chatgpt’s magic is almost entirely just dark patterns. one thing I’d be curious about if source code ever leaked is if the model’s failure cases are being massaged — a bunch of people have started to notice that when GPT enters a failure state, it tends to pull from the parts of its corpus involving religious or sci-fi imagery, which strikes me as yet another manipulative technique among the many that ChatGPT implements to imply there’s something complex happening when there isn’t

[–] froztbyte@awful.systems 4 points 1 year ago

I'll have to pay attention to that. usually I just avoid the content because almost all conversations around it make my blood boil

similarly: the accuracy scoring (both per-prompt and general session shit) almost certainly has someone pulling that into revision/avoidance management. which will eventually end up shaping it into something even more hilariously milquetoast