Skip to search boxSkip to navigationSkip to main content

Yet another example of ChatGPT's evasive tactics during long conversations: Japanese rock song lyrics case

Research Output: Chapter in Book/Report/Conference proceeding Conference contribution Peer-review

Abstract

Much attention has been devoted to the ChatGPT and other Large Language Models’ (LLM) capability assessment regarding syntax correctness, factual accuracy, adequate world representation, ethical alignment, common sense and formal logic reasoning. However, most of the research focused on "statically" generated texts, when the result of only a single iteration between a human and LLMs was recorded. More advanced techniques of open-ended discussions or debates between a human and LLMs produce much more interesting results, demonstrating such faulty rhetorical behaviours as circular arguments, self-contradictions, evasion, change of topic, lack of consistent position, and the mix of passive aggression with attempts to please human disputant. We present an original observation of such behaviour during the ChatGPT dialogue session discussing the translation of Japanese song lyrics.

Publication Information

Output type

Research Output: Chapter in Book/Report/Conference proceeding Conference contribution Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 132-136 (5 pages)

Publication milestones

  • Published - 12/06/2024

Publication status

Published - 12/06/2024

Publisher

Institute of Electrical and Electronics Engineers Inc., United States

Publication series

  • Publication series name: 2024 IEEE Conference on Cognitive and Computational Aspects of Situation Management, CogSIMA 2024

ISBN (Print)

9798350362824

ISBN (Electronic)

9798350362817

External Publication IDs

  • handle.net: 10547/626343
  • Scopus: 85196754992

Host publication title

2024 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA)

Access to documents

Publication metrics

Metrics