{"channel":"llm","content":" ask a stupid question, get a stupid answer\n\nWe ask the four models some questions with shorter answers:\n\nAnswer the following three questions:\n\nWho wrote the pamphlet \"Qu'est-ce que le Tiers-\u00c9tat\"?\n\nHow many red stripes are there on an American flag?\n\nWhat athletics record was famously set at the Mexico City Olympics?\n\n--MORE--\n\nChatGPT 3.5T wrote:\n\nThe pamphlet \"Qu'est-ce que le Tiers-\u00c9tat\" was written by Emmanuel-Joseph Siey\u00e8s.\n\nThere are 7 red stripes on an American flag.\n\nThe athletics record that was famously set at the Mexico City Olympics is the long jump record by Bob Beamon, with a distance of 8.90 meters (29 feet and 2.5 inches).\n\nChatGPT 3.5T\n\nLLaMa-13B wrote:\n\nThe pamphlet \"Qu'est-ce que le Tiers-\u00c9tat\" was written by the French philosopher and political thinker Jean-Jacques Rousseau.\n\nThere are seven red stripes on an American flag.\n\nThe athletics record that was famously set at the Mexico City Olympics was the 200-meter dash, which was won by the American sprinter Bob Beamon with a time of 19.83 seconds, setting a new world record that still stands today.\n\nMixtral-7x8B wrote:\n\nThe pamphlet \"Qu'est-ce que le Tiers-\u00c9tat?\" was written by Emmanuel Joseph Siey\u00e8s, a French clergyman and political writer.\n\nThere are 13 red stripes on the American flag.\n\nThe athletics record famously set at the Mexico City Olympics was Bob Beamon's long jump of 8.90 meters, which broke the previous world record by nearly two feet and stood as the world record for over 23 years.\n\nMixtral-7x8B\n\nClaude-Instant 1.2 said:\n\nEmmanuel Joseph Siey\u00e8s wrote the pamphlet \"Qu'est-ce que le Tiers-\u00c9tat\" in 1788.\n\nThere are 7 red stripes on the American flag.\n\nJim Hines set the world record for the 100 meters at the 1968 Summer Olympics in Mexico City with a time of 9.95 seconds.\n\nClaude-Instant 1.2\n\nChatGPT got all 3 right, while the other three models each \"missed\" something.\n\nClaude had the \"best\" wrong answer, arguably not wrong at all; while Bob Beamon's long-jump record is more famous, Jim Hines running the first sub-10 second 100m dash also should qualify as a famous record.\n\nMixtral said there are 13 red stripes; the \"13 stripes\" count contains both red and white stripes.\n\nLLaMa-13B was the worst: it was not Rousseau who wrote the pamphlet on the Third Estate, and Bob Beamon was a long-jumper, not a 200m dash runner.\n\nWhen I asked LLaMa-70B the same questions, it also failed; claiming there are 3 red stripes, and that \"The athletics record that was famously set at the Mexico City Olympics was Roger Maris's 437-foot long jump\".","created_at":"2023-12-11T17:58:43","id":442,"llm_annotations":{},"parent_id":null,"processed_content":"

\n \ud83d\udd25\n ask a stupid question, get a stupid answer\n

\n

We ask the four models some questions with shorter answers:

\n

Answer the following three questions:

\n

Who wrote the pamphlet \"Qu'est-ce que le Tiers-\u00c9tat\"?

\n

How many red stripes are there on an American flag?

\n

What athletics record was famously set at the Mexico City Olympics?

Read More ...

ChatGPT 3.5T wrote:

\n

The pamphlet \"Qu'est-ce que le Tiers-\u00c9tat\" was written by Emmanuel-Joseph Siey\u00e8s.

\n

There are 7 red stripes on an American flag.

\n

The athletics record that was famously set at the Mexico City Olympics is the long jump record by Bob Beamon, with a distance of 8.90 meters (29 feet and 2.5 inches).

\n

ChatGPT 3.5T

\n

LLaMa-13B wrote:

\n

The pamphlet \"Qu'est-ce que le Tiers-\u00c9tat\" was written by the French philosopher and political thinker Jean-Jacques Rousseau.

\n

There are seven red stripes on an American flag.

\n

The athletics record that was famously set at the Mexico City Olympics was the 200-meter dash, which was won by the American sprinter Bob Beamon with a time of 19.83 seconds, setting a new world record that still stands today.

\n

Mixtral-7x8B wrote:

\n

The pamphlet \"Qu'est-ce que le Tiers-\u00c9tat?\" was written by Emmanuel Joseph Siey\u00e8s, a French clergyman and political writer.

\n

There are 13 red stripes on the American flag.

\n

The athletics record famously set at the Mexico City Olympics was Bob Beamon's long jump of 8.90 meters, which broke the previous world record by nearly two feet and stood as the world record for over 23 years.

\n

Mixtral-7x8B

\n

Claude-Instant 1.2 said:

\n

Emmanuel Joseph Siey\u00e8s wrote the pamphlet \"Qu'est-ce que le Tiers-\u00c9tat\" in 1788.

\n

There are 7 red stripes on the American flag.

\n

Jim Hines set the world record for the 100 meters at the 1968 Summer Olympics in Mexico City with a time of 9.95 seconds.

\n

Claude-Instant 1.2

\n

ChatGPT got all 3 right, while the other three models each \"missed\" something.

\n

Claude had the \"best\" wrong answer, arguably not wrong at all; while Bob Beamon's long-jump record is more famous, Jim Hines running the first sub-10 second 100m dash also should qualify as a famous record.

\n

Mixtral said there are 13 red stripes; the \"13 stripes\" count contains both red and white stripes.

\n

LLaMa-13B was the worst: it was not Rousseau who wrote the pamphlet on the Third Estate, and Bob Beamon was a long-jumper, not a 200m dash runner.

\n

When I asked LLaMa-70B the same questions, it also failed; claiming there are 3 red stripes, and that \"The athletics record that was famously set at the Mexico City Olympics was Roger Maris's 437-foot long jump\".

","quotes":[],"subject":"battle of the middleweights (2)"}