- Aren't polls terribly inaccurate and practically worthless? The biggest mistake I think people make is putting too much stock in one or two polls and then judge polling accordingly. I never put too much confidence in one poll and would rather look at what the consensus or average of what the reputable polling companies are reporting. I have found that when anyone finds a poll they really like they have a tendency to believe it, but when they find polls that are reporting the opposite they quickly discard it as being false or biased. Polling companies are critiqued heavily on their accuracy and thus they care about their credibility. Historically, the consensus or average of the polls together give a very good picture of what is going to happen. Let us look back to 2008 and consider the real clear politics final polls and average of what the popular vote would be between Obama and McCain. Notice the average of all the polls came within 0.3 of the final results.
|Final Results||--||--||--||52.9||45.6||Obama +7.3|
|RCP Average||10/29 - 11/3||--||--||52.1||44.5||Obama +7.6|
|Marist||11/3 - 11/3||804 LV||4.0||52||43||Obama +9|
|Battleground (Lake)*||11/2 - 11/3||800 LV||3.5||52||47||Obama +5|
|Battleground (Tarrance)*||11/2 - 11/3||800 LV||3.5||50||48||Obama +2|
|Rasmussen Reports||11/1 - 11/3||3000 LV||2.0||52||46||Obama +6|
|Reuters/C-SPAN/Zogby||11/1 - 11/3||1201 LV||2.9||54||43||Obama +11|
|IBD/TIPP||11/1 - 11/3||981 LV||3.2||52||44||Obama +8|
|FOX News||11/1 - 11/2||971 LV||3.0||50||43||Obama +7|
|NBC News/Wall St. Jrnl||11/1 - 11/2||1011 LV||3.1||51||43||Obama +8|
|Gallup||10/31 - 11/2||2472 LV||2.0||55||44||Obama +11|
|Diageo/Hotline||10/31 - 11/2||887 LV||3.3||50||45||Obama +5|
|CBS News||10/31 - 11/2||714 LV||--||51||42||Obama +9|
|Ipsos/McClatchy||10/30 - 11/2||760 LV||3.6||53||46||Obama +7|
|ABC News/Wash Post||10/30 - 11/2||2470 LV||2.5||53||44||Obama +9|
|CNN/Opinion Research||10/30 - 11/1||714 LV||3.5||53||46||Obama +7|
|Pew Research||10/29 - 11/1||2587 LV||2.0||52||46||Obama +6|
- Is their bias in polls? Remember, polls do not simply call a bunch of random people and say here is what is going to happen. They all have specific methods that they use to determine what percentage of each party to call, gender, race, and geographic locations. I do not believe any credible polling company decides to manipulate their findings to favor a candidate. However, their can be a real bias when determining what methods to use. In other words, they believe one party is going to show up more heavily on election day and they then poll a heavier percentage of people within that party. Some polls take in consideration an "enthusiasm gap" in determining what percentage of each party to call. This is done by asking the ones they call two questions. "How excited or enthused are you to vote for..." and "How likely are you to vote for..." Then they weight their poll accordingly. While I believe in the use of enthusiasm to weight party voting I also believe that this is where the bias comes in as companies can have a tendency to over react to what they are finding. I do weight or adjust polls according to their over all past accuracy when making projections.
- Do you ever throw out polls entirely? Almost never. I just take into account their leanings and weight the findings accordingly. The only time I would ever throw out a poll is when their findings are all over the place in comparison the polling average. In other words their polls are always outliers and their seems to be no rhyme nor rhythm in which way they go.
- What does trend lines mean? Which way the race is trending at the moment. In other words has one candidate been seeing consistent steady gains leading up to that moment. Trend lines are only accurate by comparing the same identical polling companies. This is one of the first things I look at in every poll; How does this poll compare to their last poll? Of course the polls need to be taken within one to two weeks of each other to give a more accurate picture.I do look at trend lines in making my projections and will give up to one percentage point gain if their appears to be a strong momentum for one candidate.
- Do you take into consideration past results? Yes, but mainly this is utilized when their are little polls done in a particular state. After I make adjustments to the polls according to their accuracy and past leaning and average them together I ask myself these questions? "Are these results logical in terms of past results?" and "Are these results consistent with the general state of the race" Most of the time these questions do not make much change in my projections unless their is little polling to go by, because the polling is almost always consistent to these two areas. I would generally only adjust the average adjusted polling average by a maximum of one percentage point.
- How much of your projections are formula and how much is your personal assessment? While I go strictly by my formula, which I do not change in the middle of a race, their are times that conjecture has to be used within the frame work of the formula. I would say that 75% of my projections are based on raw data and 25% are based on conjectures.
- How much time does this take? Since I know my formula basically by memory the projections only takes within 15-30 minutes. However, the analyzing of the polls can also take some time on heavy poll days. My final projections which will include a margin of victory column for the swing states will require more detailed study and take a few hours.
- Are the confidence percentages done by formula? No
- How do you decide whether a state is a toss-up, leaning state, or safe for one candidate? Simply by my confidence level with one additional rule of thumb. I am never more then 65% confident of the outcome of a toss-up and more then 85% confident for a leaning state. But, I never consider a toss-up to have more then a 2 1/2 point margin and a leaning state to have more then a 4 point margin.
- Is your formula a secret? Not really, since it requires an element of personal assessment and would thus be impossible to replicate.