This is, I believe, the first and only analysis of the aggregate Dem bias in polling which makes up the RCP and 538. com Trump Approval ratings. RCP doesn't include many of these not so common polls but their aggregate is also distorted by lumping all polls they carry whether Registered/Likely/All Voters polling. Likely voters polls have a significantly higher level of Trump approval than All Voters polls. There is usually a 1-2 point higher approval for Trump at RCP, currently 43% than 538 which gives a choice of viewing an AV poll aggregate or an RV/LV aggregate, currently 42.4%.
The Dem aggregate bias from the 29 polls which detail their D/R/I split is D+6.20%. Rasmussen uses D+4 as does Selzer. D+4 is, according to exhaustive research as presented by PPD's Richard Baris a realistic baseline given the California/NY/IL popular vote Dem advantage. The 2016 election actual result
was D+2.
THE 20 POLLS ABOVE THE D+4 BASELINE HAVE A D+7.62% AGGREGATE DEM BIAS**
A partisan advantage is not the only method of bias/distortion. Females may be over-represented, rural voters may be under-represented which was the polls failing in 2016, education and income levels may be wrongly calculated and of course turnout modeling as Nguyen rightly states will have an effect. For a comprehensive review of the electorate see the Pew Analysis. That said the over-representation of Dems in 19 of 29 polls is clearly the significant factor in Trump's polling.
A further 11 polls which are included in the RCP/538 aggregates do not provide their demographics, it could well be surmised that all of them are above the D+4 baseline especially the likes of the ABC/Washington Post poll and the true aggregate is over D+7. All these polls, their D biases and methodology,can be found at the RCP/538 websites linked above. 538 arbitrarily "adjusts" Rasmussen down 4 points. It is a matter of conjecture, but if all these polls were D+4 and Likely Voters, Trump's approval would be at least 50%
Nota Bene: The +7.65/6.20 figures were correct when this article was first written as the pollsters change their demographics it will vary but will be circa that figure-higher or lower as time goes on;
AGGREGATE DEM LEAN +6.20% (LV=Likely Voters RV=Registered Voters AV=All Voters)
The Dem aggregate bias from the 29 polls which detail their D/R/I split is D+6.20%. Rasmussen uses D+4 as does Selzer. D+4 is, according to exhaustive research as presented by PPD's Richard Baris a realistic baseline given the California/NY/IL popular vote Dem advantage. The 2016 election actual result
was D+2.
THE 20 POLLS ABOVE THE D+4 BASELINE HAVE A D+7.62% AGGREGATE DEM BIAS**
A partisan advantage is not the only method of bias/distortion. Females may be over-represented, rural voters may be under-represented which was the polls failing in 2016, education and income levels may be wrongly calculated and of course turnout modeling as Nguyen rightly states will have an effect. For a comprehensive review of the electorate see the Pew Analysis. That said the over-representation of Dems in 19 of 29 polls is clearly the significant factor in Trump's polling.
A further 11 polls which are included in the RCP/538 aggregates do not provide their demographics, it could well be surmised that all of them are above the D+4 baseline especially the likes of the ABC/Washington Post poll and the true aggregate is over D+7. All these polls, their D biases and methodology,can be found at the RCP/538 websites linked above. 538 arbitrarily "adjusts" Rasmussen down 4 points. It is a matter of conjecture, but if all these polls were D+4 and Likely Voters, Trump's approval would be at least 50%
Nota Bene: The +7.65/6.20 figures were correct when this article was first written as the pollsters change their demographics it will vary but will be circa that figure-higher or lower as time goes on;
AGGREGATE DEM LEAN +6.20% (LV=Likely Voters RV=Registered Voters AV=All Voters)
MORNING CONSULT D+5
NBC/WSJ/HART RESEARCH RV D+12
NBC/WSJ/HART RESEARCH RV D+12
IPSOS REUTERS D+ 13
**ECONOMIST/YOUGOV D+11 or D+9
AMERICAN RESEARCH GROUP ARG RV D+10
QUINNIPIAC RV D+10
CBS/SSR AV D+9.4
SIENNA/NYTIMES RV D+9
**ECONOMIST/YOUGOV D+11 or D+9
AMERICAN RESEARCH GROUP ARG RV D+10
QUINNIPIAC RV D+10
CBS/SSR AV D+9.4
SIENNA/NYTIMES RV D+9
GLOBAL STRATEGY GROUP/GBAO RV D+8
CLIMATE NEXUS RV D+7.5
KAISER FOUNDATION D+7.5
***CNBC/CHANGE RESEARCH LV D+7
KAISER FOUNDATION D+7.5
***CNBC/CHANGE RESEARCH LV D+7
CNN/SRS RV D+7
EMERSON POLLING LV D+7% (+3.8 in June)
EMERSON POLLING LV D+7% (+3.8 in June)
TARGET SMART/DYNATA RV D+7
MARIST/PBS RV D+7
MARIST/PBS RV D+7
GALLUP
AV D+6.6
OPTIMUS D+6.5
SURVEY MONKEY AV D+6.3
WASHINGTON POST/ABC RV D+6
SURVEY MONKEY AV D+6.3
WASHINGTON POST/ABC RV D+6
FOX NEWS RV D+6
SUFFOLK/USA TODAY RV D+5.8
HARVARD/HARRIS RV D+5
SUFFOLK/USA TODAY RV D+5.8
HARVARD/HARRIS RV D+5
HARRISX/THE HILL RV
D+5
HART RESEARCH RV D+4
HART RESEARCH RV D+4
SELZER/GRINNELL LV D+4
RASMUSSEN REPORTS LV D+4
MONMOUTH RV D+4 ("Unweighted" D+6.2%)
YOUGOV D+4 (Democrat 29% Republican 25% Independent 32%)
YOUGOV D+4 (Democrat 29% Republican 25% Independent 32%)
ROANOKE AV D+2
DEMOCRACY INSTITUTE LV; EVEN
DEMOCRACY INSTITUTE LV; EVEN
ZOGBY POLL LV; EVEN
D/R/I INFORMATION NOT SUPPLIED
(D=DEM/R=GOP/I=IND)
AXIOS/SURVEY MONKEY No DRI
ECHELON INSIGHTS LV NO DRI
YOUGOV "Trump Tweets" No DRI
MSR GROUP RV No DRI
WHITMAN STRATEGIES 500 RV NO DRI
IBD/TIPP RV Poll No DRI
RMG (Scott Rasmussen) RV DRI not supplied
REDFIELD AND WINTON RV NO DRI
METHODOLOGY
*Morning Consult;PID: Dem (no lean) 770 39% PID: Ind (no lean) 554 28% PID: Rep (no lean) 669 34%
"2012 Vote: Barack Obama 578 38% 2012 Vote: Mitt Romney 322 21% 2012 Vote: Other 44 3% 2012 Vote: Didn’t Vote 565 37% N 1508"
The New York Times/Siena College Research Institute June 17-22, 2020 1,337 United States Registered Voters MOE +/- 3.0%
WASHINGTON POST/ABC
Partisan divisions are 30-24-39 percent, Democrats-Republicans-independents
Margin of error RV 4.0%
ROANOKE
DEMOCRACY INSTITUTE (2020) LV
Dem 38% GOP 38% Independents 24%
SURVEY MONKEY
RASMUSSEN REPORTS Likely Voters D+4
KAISER FOUNDATION D+7.5%
*Morning Consult;PID: Dem (no lean) 770 39% PID: Ind (no lean) 554 28% PID: Rep (no lean) 669 34%
"2012 Vote: Barack Obama 578 38% 2012 Vote: Mitt Romney 322 21% 2012 Vote: Other 44 3% 2012 Vote: Didn’t Vote 565 37% N 1508"
The New York Times/Siena College Research Institute June 17-22, 2020 1,337 United States Registered Voters MOE +/- 3.0%
WASHINGTON POST/ABC
Partisan divisions are 30-24-39 percent, Democrats-Republicans-independents
Margin of error RV 4.0%
ROANOKE
DEMOCRACY INSTITUTE (2020) LV
Dem 38% GOP 38% Independents 24%
SURVEY MONKEY
Party ID | ||||
---|---|---|---|---|
Answer | Total | Republican/ lean rep | Independent no lean | Democrat/ lean dem |
Unweighted N | 50,404 | 19,445 | 7,749 | 21957 |
RASMUSSEN REPORTS Likely Voters D+4
KAISER FOUNDATION D+7.5%
SELZER/GRINNELL LV D+4
Strong Republican 16 Republican 10 Lean Republican 7 Totally independent
26 Lean Democrat 10 Democrat 11 Strong Democrat 16 Other 2 (VOL) Refused/
not sure 3
1,009 U.S. adults ages 18 and over March 27-30, 2020 Including 777 likely
voters in the 2020 general election Weighted by sex, age, race, Margin of
error: ±3.1 percentage points based on all and educational attainment Margin of
error: ±3.5 percentage points based on 2020 likely voters
AMERICAN RESEARCH GROUP (ARG) "Mother Jones observed in 2007 that ARG "may not be the bellwether for accurate polling."[5] The New Republic found in 2008 that "ARG is a black sheep of the polling world; I repeatedly heard it singled out for scorn by other pollsters."
AMERICAN RESEARCH GROUP (ARG) "Mother Jones observed in 2007 that ARG "may not be the bellwether for accurate polling."[5] The New Republic found in 2008 that "ARG is a black sheep of the polling world; I repeatedly heard it singled out for scorn by other pollsters."
Sample Size: 1,100 completed interviews among a random sample of all adults age 18 and older living in households in the continental United States (see methodology for details). There were 259 Republicans, 355 Democrats, 377 independents, and 109 non-voters in the sample.
Margin of Error: � 3 percentage points, 95% of the time, on questions where opinion is evenly
HART RESEARCH D+4
1,015 registered voters nationwide
Strong Republican. 19 Leaning Republican 19 Completely independent
20 Leaning Democratic. 19 Strong Democrat 23 Total Republican 38 Total Democrat
42
CLIMATE NEXUS RV D+7.5
Sample Population: 1917 registered voters in the United States. Sample
Selection: Scientific online poll - stratified sample of panel respondents.
Weighting Parameters: The sample was weighted based on the U.S. Census Bureau’s
Voting and Registration Supplement to the Current Population Survey for
registered voters in the United States based on age, gender, race, educational
attainment, census region, and Hispanic ethnicity. This topline provides
weighted percentages, as well as the unweighted N-size for the total sample.
Due to the effects of weighting and rounding, figures may or may not add up to
100%. The standard deviation of the weights was: 0.2242216. The maximum weight
was: 1.9601923. The minimum weight was: 0.3773268. 95% of the weights were
between 0.4793321, 1.4957711. Margin of Error: The 95% credibility interval for
this survey is +/- 2.3%, which includes the square root of the design effect
(DEFT): 1.0248166.
PPP (D) RV D+2
Public Policy Polling surveyed 1,403 national registered voters from
April 23-24, 2020 on behalf of Protect Our Care. The margin of error is +/-
2.6%. 50% of interviews for the survey were conducted by telephone and 50% by
text
Democrat 37% Republican 32% Independent 28% Other 3%
Monthly Harvard-Harris Poll: May 2020 This survey was conducted
online within the United States from May 13-14, 2020 among 1,854 registered
voters by The Harris Poll. The results reflect a nationally representative
sample. Results were weighted for age within gender, region, race/ethnicity,
marital status, household size, income, employment, political party, political
ideology, and education where necessary to align them with their actual
proportions in the population. Propensity score weighting was also used to
adjust for respondents’ propensity to be online.
ABC/WASHINGTON POST RV NO DRI
Washington Post-ABC News poll was conducted by telephone among a random
national sample of 1,001 adults, with 75% reached on cell phones and 25% on
landlines. Results have an error margin of +/- 3.5 percentage points for the
full sample including design effects due to weighting. *=0.5%
ECHELON INSIGHTS LV NO DRI
We surveyed N = 1,000 registered voters in the Likely Electorate online
from May 18 - May 20, 2020 using a voter file-matched sample as part of our
monthly Verified Voter Omnibus tracking survey of the 2020 political
environment. The sample was weighted to known characteristics of the 2020
“Likely Electorate” population, a frame which takes into account demographic
and turnout characteristics of the 2020 electorate.
TARGET SMART/DYNATA RV D+7
Democrat and Ind. Lean Dem 47 - Pure Independent 10 - Republican and
Ind. Lean Republican 40
TargetSmart designed this multi-mode survey and administered it in
partnership with industry-leading data collection vendor Dynata. Six hundred
(556 weighted) respondents were interviewed over the telephone by professional
agents (79% on cell phones, 21% on landlines), and 600 (644 weighted)
respondents were interviewed online, reached via the Dynata online panel.
Telephone interviews were drawn from a random sample of registered voters
across the United States, sampled from the TargetSmart voter file. Online
interviews from the Dynata online panel were also all matched back to the
TargetSmart voter file. In total, the survey reached 1,200 respondents who
indicated they are registered to vote in the United States. The survey was
conducted from May 21- 27, 2020. Quotas were designed to reflect the
demographic and geographic distribution of registered voters in the United
States. The data were weighted by gender, age, modeled race, modeled
partisanship, modeled education, modeled vote propensity, population density
(at the census bloc level), and geography (at the state level) to ensure an
accurate reflection of the population.
MONMOUTH D+4
DEMOGRAPHICS (weighted) Self-Reported 27% Republican 41% Independent 31%
Democrat
The Monmouth University Poll was sponsored and conducted by the Monmouth
University Polling Institute from May 28 to June 1, 2020 with a national random
sample of 807 adults age 18 and older. This includes 279 contacted by a live
interviewer on a landline telephone and 528 contacted by a live interviewer on
a cell phone,
AXIOS/SURVEY MONKEY No D/R/I split provided. All Voters 2016; 23% did
not vote; 16% GOP 51% Ind 19% Dem 6,275 Unweighted respondents. 2020 vote 5,666
Unweighted Trump GOP 93% Ind 35% Dem 2%
YOUGOV No DRI Uses All Voters and Registered Voters
U.S. citizens, aged 18 and over. Sampling method Respondents were
selected from YouGov’s opt-in Internet panel using sample matching. A random
sample (stratified by gender, age, race, education, geographic region, and
voter registration) was selected from the 2016 American Community Study. Voter
registration was imputed from the November 2016 Current Population Survey
Registration and Voting Supplement.
CNN/SRS D+7
A total of 1,259 adults, including an oversample of 250 black,
non-Hispanic adults, were interviewed by telephone nationwide by live
interviewers calling both landline and cell phones. Oversampled black,
non-Hispanic respondents have been weighted to represent their proper share of
the adult population. Interviews were conducted in English and Spanish. Among
the entire sample, 32% described themselves as Democrats, 25% described
themselves as Republicans, and 44% described themselves as independents or
members of another party.The study was conducted for CNN via
telephone by SSRS, an independent research company. Interviews were conducted
from June 2-5, 2020 among a sample of 1,259 respondents, including an
oversample of 250 black, nonHispanic respondents. The landline total
respondents were 448 and there were 811 cell phone respondents. The margin of
sampling error for total respondents is +/- 3.4 at the 95% confidence level.
The design effect is 1.47.
MSR GROUP RV No DRI
Data collected on-line using national panel sampling frame. A random
sample of 1000 adults yielded a final data set of 855 registered voters. Data
were collected on June 7, 2020. Results were weighted to national norms based
on post-stratification by age and gender.
WHITMAN STRATEGIES 500 RV NO DRI “Whitman Insight
Strategies helps Democrats and Independents motivate their Base, “
IBD/TIPP RV Poll No DRI
IBD/TIPP Poll reflects an online survey of 1,233 adults from May 31 to
June 3. The Trump-Biden 2020 presidential election poll reflects a subset of
964 registered voters.
Zogby Poll LV Even 36/36/I 28
Zogby Analytics conducted an online survey of 1007
likely voters in the US.
Using internal and trusted interactive partner
resources, thousands of adults were randomly invited to participate in this
interactive survey. Each invitation is password coded and secure so that one
respondent can only access the survey one time.
Using information based on census data, voter
registration figures, CIA fact books and exit polls, we use complex weighting
techniques to best represent the demographics of the population being surveyed.
Weighted variables may include age, race, gender, region, party, education, and
religion. The party breakdown for this survey is as follows: 36% Democrat, 36%
Republican and 28% Independent/unaffiliated.
EMERSON POLLING RV NO DRI
National Emerson College/Nexstar
Media poll was conducted June 2-3, 2020. The sample consisted of registered
Democratic, Republican, and Independent voters, n=1431, with a Credibility
Interval (CI) similar to a poll’s margin of error (MOE) of +/- 2.5 percentage
points. The data sets were weighted by age, ethnicity, education, and party
based on 2016 election turnout.
MARIST/PBS D+6 RV
This survey of 1,062 adults was conducted June 2nd through June 3rd,
2020 by The Marist Poll sponsored in partnership with NPR and PBS NewsHour.
Adults 18 years of age and older residing in the contiguous United States,
including an oversample of non-white Americans, were contacted on landline or
mobile numbers and interviewed by telephone using live interviewers.
RV 51% Women 49% Men Party Identification Democrat 38% Republican 31% Independent 29% Respondents Dem Men 15% Women 23% GOP Men 16% GOP Women 15%
RV 51% Women 49% Men Party Identification Democrat 38% Republican 31% Independent 29% Respondents Dem Men 15% Women 23% GOP Men 16% GOP Women 15%
OPTIMUS RV D 6.5 “ PARTY REPUBLICAN 28.5 DEMOCRATIC 35 INDEPENDENT/OTHER
36.3”
** ECONOMIST/YOUGOV
I emailed them. It says they get their party affiliation numbers from 2014
533D/390R/577I. 801 female. 699 male. Adds up to 1500. Reports Registered and All Voters.
They put down 1221 was RV but the numbers add up to 1500.
I emailed them. It says they get their party affiliation numbers from 2014
533D/390R/577I. 801 female. 699 male. Adds up to 1500. Reports Registered and All Voters.
They put down 1221 was RV but the numbers add up to 1500.
McLAUGHLIN AND ASSOCIATES D+3 D36 R33 I31 1000 LV
IPSOS/REUTERS D +13
GLOBAL STRATEGY GROUP/GBAO
NAVIGATOR RESEARCH D+8 RV
1,009
When it comes to politics, do you generally think of yourself as a strong Democrat, not very strong Democrat, strong Republican, not very strong Republican, an independent, or some other political party? [IF INDEPENDENT/OTHER] Do you think of yourself as closer to the Democratic Party or the Republican Party? Strong Democrat 30% Weak Democrat 12 Independent / Closer to the Democrats Independent 11 Independent / Closer to the Republicans 5 Weak Republican 13 Strong Republican 22
|
DEMOCRAT (NET) 43%.INDEPENDENT (NET) 22 REPUBLICAN (NET) 36
DEMOCRAT W/ LEANERS (NET) 49% REPUBLICAN W/LEANERS (NET) 41
MORNING CONSULT (POLITICO) RV D+5
Methodology: This poll was conducted between June 12-June 14, 2020
among a national sample of 1987 Registered Voters. The interviews were
conducted online and the data were weighted to approximate a target sample of
Registered Voters based on gender, educational attainment, age, race, race, and
region. Results from the full survey have a margin of error of plus or minus 2
percentage points.
***CNBC/CHANGE RESEARCH D+7
Was D+5% May 2020 switched to D+7% 6/26
Generally speaking, do you think of yourself as a Democrat, a Republican, or an independent? (IF RESPONDENT SAYS "DEMOCRAT" OR "REPUBLICAN," ASK:) Would you call yourself a strong (Democrat/Republican) or not a very strong (Democrat/Republican)? (IF RESPONDENT SAYS "INDEPENDENT," ASK:) Do you think of yourself as closer to the Republican Party, closer to the Democratic Party, or do you think of yourself as strictly independent? Strong Democrat ................................................ 24 [153] Not very strong Democrat ................................... 10 Independent/closer to Democratic Party ............. 10 Strictly independent ............................................ 15 Independent/closer to Republican Party ............. 8 Not very strong Republican ................................ 10 Strong Republican .............................................. 19 Not sure ............................................................ 4 Total Democrat 44 Total Republican 37
RMG (Scott Rasmussen) RV DRI not supplied
The survey of 1,200 Registered Voters was conducted
by Scott Rasmussen using a mixed mode approach from June 11-13, 2020. Field
work for the survey was conducted by RMG Research, Inc. Most respondents were
contacted online or via text while 306 were contacted using automated phone
polling techniques. Certain quotas were applied, and the overall sample was
lightly weighted by geography, gender, age, race, education, and political
party to reasonably reflect the nation’s population of Registered Voters. Other
variables were reviewed to ensure that the final sample is representative of
that population.
Abacus Data RV No DRI
The survey was conducted with 1,500 American adults from June 11 to 13,
2020. A random sample of panelists was invited to complete the survey from a
set of partner panels based on the Lucid exchange platform. These partners are
typically double opt-in survey panels, blended to manage out potential skews in
the data from a single source.
The margin of error for a comparable probability-based random sample of
the same size is +/- 2.5%, 19 times out of 20.
The data were weighted according to census data to ensure that the
sample matched the United States’ population according to age, gender, race,
educational attainment, and region. Totals may not add up to 100 due to
rounding.
NBC/WSJ/HART RESEARCH RV
Latest Poll D+7
Previous Poll D+12
Latest Poll D+7
Previous Poll D+12
Strong Democrat 28 Not very strong Democrat 7 Independent/lean Democrat
10 Strictly Independent 13 Independent/lean Republican 7 Not very strong
Republican 6 Strong Republican 20 Other (VOL) 5 Not sure 4 + Results
shown reflect responses among registered voters
1000 Registered Voters, including 550 respondents with a cell phone only
and Date: May 28-June 2, 2020 11 respondents reached on a cell phone but who
also have a landline.
REDFIELD AND WINTON RV NO DRI
Sampling
Method:
Online
|
Population
Sampled: Adults
(18+) eligible to vote in the United States
|
Sample
size: 1,500
|
Weighting: Data were weighted to the
profile of adults (18+) in the United States. Data were weighted by age,
gender, region, education level, and 2016 Presidential Election Vote. Targets
for each weighting were derived from the official estimates of the United
States Census and the results of the 2016 Presidential Election.
|
D 32.5 R 25.9 I 46.6
Results are based on telephone interviews conducted May 28-June 4, 2020
with a random sample of –1,034— adults, ages 18+, living in all 50 U.S. states
and the District of Columbia. For results based on this sample of national
adults, the margin of sampling error is ±4 percentage points at the 95%
confidence level.
HarrisX/The Hill RV D+5
The Hill-HarrisX poll was conducted online among 1,912 registered
voters between June 8 and 10. It has a margin of error of
plus or minus 2.24 percentage points.
Republican
|
32%
|
||||||||||||||||||||||
Democrat
|
37%
|
||||||||||||||||||||||
Independent
|
29%
|
Meeting Streets Insights RV No DRI This data comes
from a Meeting Street Insights online survey of 1,000 registered voters
________________________________________________________
________________________________________________________
3 comments:
Hey, great post. I would also add that if one digs into the "I" component, it is actually tilted left, at least it is for those polls that also break down 2016 vote (in other words, I have a higher than normal Clinton 2016 vote level, tilting the entire poll to D even if headline D+ number is within reason). Some polls also have elevated numbers of people who didn't vote in 2016, beyond what one would expect from older voters dying and younger people aging into voting eligibility.
That's correct as I pointed out there are a number of factors that can add to a D bias.Look at the PPP methodology for example. It's a Dem biased outfit but hasD+2 report basis but their chart shows Trump Approval landlines 49% "text approval 37%" which arrives at a 43% approval overall which is just silly
Great readingg this
Post a Comment