Skip to main navigation Skip to search Skip to main content

Yet another example of ChatGPT's evasive tactics during long conversations: Japanese rock song lyrics case

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Citations (Scopus)

Abstract

Much attention has been devoted to the ChatGPT and other Large Language Models’ (LLM) capability assessment regarding syntax correctness, factual accuracy, adequate world representation, ethical alignment, common sense and formal logic reasoning. However, most of the research focused on "statically" generated texts, when the result of only a single iteration between a human and LLMs was recorded. More advanced techniques of open-ended discussions or debates between a human and LLMs produce much more interesting results, demonstrating such faulty rhetorical behaviours as circular arguments, self-contradictions, evasion, change of topic, lack of consistent position, and the mix of passive aggression with attempts to please human disputant. We present an original observation of such behaviour during the ChatGPT dialogue session discussing the translation of Japanese song lyrics.
Original languageEnglish
Title of host publication2024 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA)
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages132-136
Number of pages5
ISBN (Electronic)9798350362817
ISBN (Print)9798350362824
DOIs
Publication statusPublished - 12 Jun 2024
Event2024 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA) - Montreal
Duration: 7 May 202410 May 2024

Publication series

Name2024 IEEE Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2024

Conference

Conference2024 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA)
CityMontreal
Period7/05/2410/05/24
Other2024 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA) (07/05/2024-10/05/2024, Montreal)

Keywords

  • ChatGPT
  • ChatGPT evaluation
  • Large Language Model evasion practices
  • Large Language Model long discussion
  • anti-chain-of-thought
  • chatbots
  • LLM evasion practices
  • LLM long discussion

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition
  • Hardware and Architecture
  • Human-Computer Interaction
  • Information Systems
  • Information Systems and Management
  • Cognitive Neuroscience

Fingerprint

Dive into the research topics of 'Yet another example of ChatGPT's evasive tactics during long conversations: Japanese rock song lyrics case'. Together they form a unique fingerprint.

Cite this