{"channel":"tech","content":"The Harvard Sentences ( https://www.cs.columbia.edu/~hgs/audio/harvard.html ) contains about 1880 distinct words, across the 720 sentences. ( My script split the word \"don't\" into << don >> and << t >>.)\r\n\r\nIt is statistically implausible just how often the word \"the\" is used; 746 times. The next most common words are less common ( << a >> at 212, << of >> at 132, << to >> at 123).\r\n\r\n----\r\n\r\nWhile these are useful sample sentences for certain purposes ( such as the \"what is the verb in this sentence\" test for 1B size LLMs), it is too small and idiosyncratic to stand up a useful word-bank.","created_at":"2025-02-20T20:01:34.992393","id":248,"llm_annotations":{},"parent_id":null,"processed_content":"

The Harvard Sentences \n \u2699\ufe0f\n ( https://www.cs.columbia.edu/~hgs/audio/harvard.html )\n contains about 1880 distinct words, across the 720 sentences. \n \ud83d\udca1\n ( My script split the word \"don't\" into don and t.)\n \r

\n

It is statistically implausible just how often the word \"the\" is used; 746 times. The next most common words are less common \n \u2699\ufe0f\n ( a at 212, of at 132, to at 123)\n .\r

While these are useful sample sentences for certain purposes \n \ud83d\udca1\n ( such as the \"what is the verb in this sentence\" test for 1B size LLMs)\n , it is too small and idiosyncratic to stand up a useful word-bank.

","quotes":[],"subject":"wordlists"}