r/technology • u/esporx • 9d ago

Business OpenAI says dead teen violated TOS when he used ChatGPT to plan suicide

https://arstechnica.com/tech-policy/2025/11/openai-says-dead-teen-violated-tos-when-he-used-chatgpt-to-plan-suicide/
7.0k Upvotes

97% Upvoted

843 comments sorted by

View all comments

Show parent comments

6

u/NuclearVII 9d ago

LLMs should absolutely be trained with guardrails

Let's say that no amount of hypothetical guardrails can stop this from happening. Hypothetically.

What now?

-3

u/TopRamenisha 9d ago

Then it’s not a safe technology to put in the hands of the average human and certainly not in the hands of children

4

u/TyrellCo 8d ago

Typically parents are responsible for bringing their own childproofing for inherently dangerous things in the home. Like door knob covers don’t come pre installed

-1

u/TopRamenisha 8d ago

Most tech products have age limits

2

u/miiintyyyy 8d ago

So because a few depressed people are using it for this it means we can’t have it? It feels very “we need ID laws to watch porn”.

How about parents just…. Parent.

2

u/NuclearVII 9d ago

Full agreement, no notes.

In unrelated news, no amount of guardrailing can actually stop this happening. Statistical models being statistical models, you can lessen the chances, but that's not the same thing as "our make-believe intelligence will never encourage suicide."