Posted by Alexander Power
Received: 2026-05-18 15:49:40
Channel: LLM - Large Language Model discussion
a recent bug in Greenland: I was asking ChatGPT 5.4 mini to do a per-word breakdown of a sentence. But, sometimes it left words out. Other times, it would include the trailing period as a word, despite being instructed not to.
The cause of the bug: the prompt also asked ChatGPT to get the "word count" of the sentence. It is bad at this.
So, if it said The dog is on the log has 4 words, it would stop after 4 words and ignore the log when processing the sentence.
Of course, Python can easily do this. 💡 and, in the future, AI systems will know to just use Python to get this information rather than trying to guess it themselves. But here, it wasn't even used; I don't remember/know why a "word count" got added to the response.