🔥 ask a stupid question, get a stupid answer
We ask the four models some questions with shorter answers:
Answer the following three questions:
Who wrote the pamphlet°hard word "Qu'est-ce°hard word que°hard word le°hard word Tiers°hard word-État°hard word"?
How many red stripes°hard word are there on an American flag?
What athletics°hard word record was famously set at the Mexico°hard word City Olympics°hard word?
ChatGPT°hard word 3.5T wrote:
The pamphlet°hard word "Qu'est-ce°hard word que°hard word le°hard word Tiers°hard word-État°hard word" was written by Emmanuel-Joseph°hard word Siey°hard wordès.
There are 7 red stripes°hard word on an American flag.
The athletics°hard word record that was famously set at the Mexico°hard word City Olympics°hard word is the long jump record by Bob°hard word Beamon°hard word, with a distance of 8.90 meters (29 feet and 2.5 inches°hard word).
ChatGPT°hard word 3.5T
LLaMa°hard word-13B wrote:
The pamphlet°hard word "Qu'est-ce°hard word que°hard word le°hard word Tiers°hard word-État°hard word" was written by the French°hard word philosopher°hard word and political thinker Jean-Jacques°hard word Rousseau°hard word.
There are seven red stripes°hard word on an American flag.
The athletics°hard word record that was famously set at the Mexico°hard word City Olympics°hard word was the 200-meter dash°hard word, which was won by the American sprinter°hard word Bob°hard word Beamon°hard word with a time of 19.83 seconds, setting a new world°hard word record that still stands today.
Mixtral°hard word-7x8B wrote:
The pamphlet°hard word "Qu'est-ce°hard word que°hard word le°hard word Tiers°hard word-État°hard word?" was written by Emmanuel°hard word Joseph°hard word Siey°hard wordès, a French°hard word clergyman°hard word and political writer.
There are 13 red stripes°hard word on the American flag.
The athletics°hard word record famously set at the Mexico°hard word City Olympics°hard word was Bob°hard word Beamon's°hard word long jump of 8.90 meters, which broke the previous world°hard word record by nearly two feet and stood as the world°hard word record for over 23 years.
Mixtral°hard word-7x8B
Claude-Instant°hard word 1.2 said:
Emmanuel°hard word Joseph°hard word Siey°hard wordès wrote the pamphlet°hard word "Qu'est-ce°hard word que°hard word le°hard word Tiers°hard word-État°hard word" in 1788.
There are 7 red stripes°hard word on the American flag.
Jim°hard word Hines°hard word set the world°hard word record for the 100 meters at the 1968 Summer Olympics°hard word in Mexico°hard word City with a time of 9.95 seconds.
Claude-Instant°hard word 1.2
ChatGPT°hard word got all 3 right, while the other three models each "missed" something.
Claude°hard word had the "best" wrong answer, arguably°hard word not wrong at all; while Bob°hard word Beamon's°hard word long-jump°hard word record is more famous, Jim°hard word Hines°hard word running the first sub°hard word-10 second 100m dash°hard word also should qualify°hard word as a famous record.
Mixtral°hard word said there are 13 red stripes°hard word; the "13 stripes°hard word" count contains°hard word both red and white stripes°hard word.
LLaMa°hard word-13B was the worst: it was not Rousseau°hard word who wrote the pamphlet°hard word on the Third Estate°hard word, and Bob°hard word Beamon°hard word was a long-jumper°hard word, not a 200m dash°hard word runner°hard word.
When I asked LLaMa°hard word-70B the same questions, it also failed°hard word; claiming°hard word there are 3 red stripes°hard word, and that "The athletics°hard word record that was famously set at the Mexico°hard word City Olympics°hard word was Roger°hard word Maris's°hard word 437-foot long jump".