Hangman by Text: The Letters to Guess First, According to the Data

Updated: Nov 2
Hangman is a guessing game, but it is not a game of luck. Every blank is a question with a known best answer, and the answer comes from counting letters. This post covers what the counts say, where ETAOIN SHRDLU misleads you, why a three-letter word is more dangerous than a nine-letter one, and which letter opens each of the seven categories the text version uses.
How the game is played by text
In Games Textapp, Hangman starts when you ask for it. It picks a word from a category and tells you the category and the number of letters. You have six lives. Each turn you guess a letter, or the whole word if you think you have it, and the reply shows the word with blanks for every letter you have not found, the letters you got wrong, and how many lives remain. A wrong letter costs a life, and so does a wrong whole-word guess, so save those for when the blanks leave one real possibility. Games Textapp is an AI.
The classic answer: ETAOIN SHRDLU
Printers knew the order of English letters before statisticians did; Linotype keyboards were laid out by frequency, which is where ETAOIN SHRDLU comes from. The counts hold up. Cornell's cryptography unit publishes a frequency table built from a 40,000-word sample: E at 12.02 percent, T at 9.10, A at 8.12, O at 7.68, I at 7.31, N at 6.95, S at 6.28, R at 6.02.
Peter Norvig checked the same question at a scale no printer could, counting 3.56 trillion letters in the Google Books Ngram corpus. E leads at 12.49 percent, then T at 9.28, A at 8.04, O at 7.64, I at 7.57, N at 7.23, S at 6.51 and R at 6.28. His order is ETAOIN SRHLDCU, with R, L and C each moving up a place. So if you know nothing about the word, guess e first.
Why the blanks change the answer
The catch is that those tables count running text, and running text is mostly short words. Norvig found that by mentions the most common word length is three letters, 20.5 percent of everything, and the average word is 4.79 letters long. Short, frequent words like "the" and "to" pump up T and H. A Hangman word is drawn from a list of nouns instead, and a list of distinct words looks different: counted that way, Norvig's average length is 7.60 letters and seven-letter words are the biggest group.
Position matters as well. Norvig's positional counts show that the first letter of an English word is most often T, and that E is about four times less common as a first letter than elsewhere, while it is the most common last letter. Nine blanks mean you are guessing against long nouns, not general English, where vowels and R, L and N do more work and T does less.
We checked that against the actual list. Games Textapp draws its Hangman words from a fixed list of 215 common nouns in seven categories (animal, food, place, thing, sport, job, weather), averaging 6.9 letters. We counted, for each letter, the share of those words that contain it at least once, which is what matters when a guess either hits or costs a life. The order is E (57 percent of words), A (56), R (50), I (43), N and O (40 each), L (38), T (37), C (31), S (26). T falls from second to eighth. S is tenth, because these are singular nouns. And 43 percent of the words contain no E at all, so a miss on the first guess is normal.
The best opening guess by category, from the same count:
Animal: a (61 percent of the words), then r and e.
Food: e (53 percent), then a and o.
Place: a (76 percent), the strongest single opener on the list.
Thing: e (71 percent), then a.
Sport: i, n and g are tied at 59 percent, which is the "ing" in swimming, bowling and skiing.
Job: r (78 percent), ahead of e at 70.
Weather: n and r (50 percent each), then i and o.
Two surprises: in the job category r beats e, and for sports g is a first-round guess, which it is nowhere else.
The hardest words are short and odd
In 2010 Jon McLoone at Wolfram ran about 15 million simulated games against a 90,000-word dictionary to find the best Hangman words to set. His guesser narrowed the dictionary by length and revealed letters and picked by frequency among the words left. Against a random word on a 13-life gallows the setter won about 1 percent of the time. The word that beat the guesser most often, at every life count he tried, was "jazz".
The reason is the combination. A short word gives the guesser few letters to hit, and rare letters like J and Z are never guessed early. McLoone's one-line summary: if you remember a single rule, set three-letter words. So as the guesser, give short words the most care. On the Textapp list the shortest entries are fog, taco, kite, golf, chef and hail, and four words (fog, golf, cloud and octopus) contain none of the top five letters. The weather category holds the short, vowel-light words, which is why n and r, not e, open it.
A brief history
The game is older than the gallows. Its origins are not documented, but the earliest printed description we could verify is in Alice Bertha Gomme's The Traditional Games of England, Scotland, and Ireland, published in London in 1894. Under the name "Birds, Beasts, and Fishes", collected in Barnes, Surrey, she describes a slate game: one child writes the first and last letters of a bird, beast or fish, puts a cross for each missing letter, and names the category. The others guess in turn, and whoever names the word takes a mark for every cross. No gallows, just a category clue, much like the text version. Wikipedia's history of the game) notes that Gomme's variant had no hanged figure; that scoring came later.
Try it by text
Text Hi to (725) 252-4524 and ask for Hangman, or any of the other six games. It works on any phone that can text, with no app and no account. The first 30 messages are free, then one $9.99 a month subscription covers every Textapp. Text STOP at any time to end messages. Message and data rates may apply. More at textapp.co/apps/games.



Comments