The table below gives the results of a poll published by The Literary Digest magazine on 31 October 1936 (Halloween, appropriately enough), shortly before the 1936 presidential election. The candidates were Franklin Delano Roosevelt (the incumbent president, a democrat) and Alfred (Alf) Mossman Landon (the republican challenger, then governor of Kansas). Approximately 10,000,000 questionnaires (in the form of postcards) were mailed to prospective voters, making the Literary Digest poll one of the largest ever conducted. Approximately 2,300,000 were returned. The prospective voters were chosen from the subscription list of the magazine, from automobile registration lists, from phone lists, and from club membership lists.
In the data table, the results are given by state. (There were 48 states in 1936.) For each state, the table gives the number of electoral votes, the number of votes for Landon in the poll, and the number of votes for Roosevelt in the poll.
State | EV | AML | FDR |
---|---|---|---|
AL | 11 | 3060 | 10082 |
AZ | 3 | 2337 | 1975 |
AR | 9 | 2724 | 7608 |
CA | 22 | 89516 | 7608 |
CO | 6 | 15949 | 10025 |
CT | 8 | 28809 | 13413 |
DE | 3 | 2918 | 2048 |
FL | 7 | 6087 | 8620 |
GA | 12 | 3948 | 12915 |
ID | 4 | 3653 | 2611 |
IL | 29 | 123297 | 79035 |
IN | 14 | 42805 | 26663 |
IA | 11 | 31871 | 18614 |
KS | 9 | 35408 | 20254 |
KY | 11 | 13365 | 16592 |
LA | 10 | 3686 | 7902 |
ME | 5 | 3686 | 7902 |
MD | 8 | 17463 | 18341 |
MA | 17 | 87449 | 25965 |
MI | 19 | 51478 | 25686 |
MN | 11 | 30762 | 20733 |
MS | 9 | 848 | 6080 |
MO | 15 | 50022 | 8267 |
MT | 4 | 4490 | 3562 |
NE | 7 | 18280 | 11770 |
NV | 3 | 1003 | 955 |
NH | 16 | 9207 | 2737 |
NJ | 16 | 58677 | 27631 |
NM | 3 | 1625 | 1662 |
NY | 47 | 162260 | 139277 |
NC | 13 | 6113 | 16324 |
ND | 4 | 4250 | 3666 |
OH | 26 | 77896 | 50778 |
OK | 11 | 14442 | 15075 |
OR | 5 | 11747 | 10951 |
PA | 36 | 119086 | 81114 |
RI | 4 | 10401 | 3489 |
SC | 8 | 1247 | 7105 |
SD | 4 | 8483 | 4507 |
TN | 11 | 9883 | 19829 |
TX | 23 | 15341 | 37501 |
UT | 4 | 4067 | 5318 |
VT | 3 | 7241 | 2458 |
VA | 11 | 10223 | 16783 |
WA | 8 | 21370 | 15300 |
WV | 8 | 13660 | 10235 |
WI | 12 | 33796 | 20781 |
WY | 3 | 2526 | 1533 |
Other | 7 | 1586 | 545 |
Total | 550 | 1280041 | 869825 |
Based on the poll, The Literary Digest predicted that Landon would win the 1936 presidential election with 57.1% of the popular vote and an electoral college margin of 370 to 161. In fact, Roosevelt won the election with 60.8% of the popular vote (27,751,841 to 16,679,491) and an electoral college landslide of 523 to 8 (the largest ever in a presidential election). Roosevelt won 46 of 48 states, losing only Maine and Vermont.
The Literary Digest, using similar techniques, had correctly predicted the outcome of the last four presidential elections. But in this case, the magazine was not just wrong, it was spectacularly wrong. In part because of the subsequent loss of prestige and credibility, the magazine died just two years later.
What went wrong? Clearly the sample was skewed towards wealthier voters—those who could afford magazine subscriptions, cars, phones, and club memberships in the depths of the Great Depression. This sort of bias would not matter if wealthier voters behaved in a similar manner to voters as a whole (as was basically the case in the previous four elections). But in 1936, at a time of great tension between economic classes, this was definitely not the case.
Another problem, not easily understood, is self-selection bias. Were the voters who chose to return the questionnaires different, in terms of how they planned to vote, from the voters who did not respond?