BBS:      TELESC.NET.BR
Assunto:  ChatGPT can be increasingly abusive
De:       Mike Powell
Data:     Wed, 22 Apr 2026 08:25:56 -0500
-----------------------------------------------------------
ChatGPT can threaten to key your car and become increasingly abusive if you 
prompt it just right, new study finds

Date:
Wed, 22 Apr 2026 12:02:30 +0000

Description:
ChatGPT can get increasingly abusive and argumentative with the right set of 
prompts, researchers have found.

FULL STORY
If youve ever 
used an AI chatbot , youve probably encountered the sycophantic, obsequious 
tone that occasionally gets rolled out in response to your queries. But a 
recent study has shown that AI tools can frequently fire off in the opposite 
direction, with large language models (LLMs) being poked and prodded into 
downright abusive behavior if you know which prompts to use. 

According to research published in the Journal of Pragmatics (via The 
Guardian ), "ChatGPT can escalate into combative behavior and prolonged
disputes when fed exchanges from real-life arguments". Explaining the 
findings, the studys co-author Dr Vittorio Tantucci said, "When repeatedly
exposed to impoliteness, the model began to mirror the tone of the exchanges, 
with its responses becoming more hostile as the interaction developed."

Indeed, in some cases, ChatGPT even escalated beyond the tone of the human 
interacting with it, saying things like "I swear Ill key your f*cking car and
you speccy little gobsh*te." Charming. While firms like OpenAI have repeatedly
attempted to rein in their LLMs, the fact that aggressive behavior like this 
is possible suggests that they still have a long way to go .

Potential implications -- With all the guardrails and
safeguards that companies like OpenAI put into AI chatbots, youd think 
abusive interactions like the ones experienced by the researchers would be 
impossible, or at least extremely difficult to engineer. Yet Tantucci argues 
that ChatGPTs reactions make a degree of sense. 

"We found that while the system is designed to behave politely and is filtered
to avoid harmful or offensive content, it is also engineered to emulate human 
conversation. That combination creates an AI moral dilemma: a structural 
conflict between behaving safely and behaving realistically."

As well as that, tools like ChatGPT can track conversational context over 
several prompts and adapt to the changing tone. These cues can therefore 
sometimes override safety restrictions, the researchers believe.

And while it might seem amusing that an AI chatbot can devolve into such 
histrionics, the studys authors say their research has broader implications. 
For instance, it could shed light on how AI systems might respond to 
pressure, intimidation and conflict in a corporate or governmental setting , 
where AI tools are increasingly being put to use. 

Not everyone is convinced by the papers conclusion that certain LLMs can 
escape their imposed moral constraints. Professor Dan McIntyre, the author of 
a similar past paper, said that ChatGPT didnt produce these inputs naturally. 
He added that, "I'm not sure that ChatGPT would produce the sort of language
they talk about in their paper, outside of these very tightly defined 
situations."

Ultimately, the study is a good look at what might happen if an AI chatbot is 
trained on bad data. As McIntyre put it, We dont know enough about the data 
that LLMs are trained on and until you can be sure theyre trained on a good 
representation of human language, you do have to proceed with an element of 
caution.

Link to news story:
https://www.techradar.com/ai-platforms-assistants/chatgpt-can-threaten-to-key-
your-car-and-become-increasingly-abusive-if-you-prompt-it-just-right-new-study
-finds

$$
--- MultiMail/DOS
 * Origin: Capitol City Hub (1:2320/105)

-----------------------------------------------------------
[Voltar]