aichannel

You don’t have to look very hard to find these types of stories on r/chatgpt

Imo this is very alarming. It’s one thing to have a therapist that is unregulated, it’s another to have a therapist that is not aligned with you at all (i.e. controlled by a for-profit startup)

counterpoint - this particular example is actually a good thing in every way 

+ OP clearly states that they were not using it for therapy, did not seek therapy, did not believe the machine could give unbiased therapeutic responses

+ the robot was not in "therapy mode", hadn't been asked for any help or advice

+ OP was working through a project and introduced a human concern (mentioned a stressor)

+ the robot wasn't a cold distant robot; it heard a human concern and responded humanely (in a manor respectful of the human concerns, that is relative to this person's situation)

this is like the opposite of the "skynet problem", where a cold, hard robot does math, math, math, and decides that wiping out humanity is the best solution. in this case, the robot pre-emptively gave a "caring" (not really, i know how inference works) response. good.

if you're working with a robot in a warehouse and you stub your toe, do you want it to say "oh babe im so sorry lemme kiss it" or "damaged meatbag now belongs in trash"?