Raw LLM Responses

FWIW, I actually asked ChatGPT about the potential for harm in using ChatGPT for therapy, and it noted that people with distorted thinking tend to be consistent and very firm about it - and that that will likely skew the model because it's generally programmed to be agreeable and pleasant. It may gently challenge clearly false assertions, but it also noted that it's terrible at tracking long-term implied patterns in the user, so it will not pick up on, for example, someone whose every social interaction involves everyone else being incredibly unfair to them. It will sympathize and probably reinforce the distorted thinking. Asking ChatGPT about its guiderails, ethics, and hazards is very interesting. As for the crush, can we really blame it? :)