Unconventional Iowa survey finds majority support marriage equality

About 61 percent of Iowa registered voters, including overwhelming majorities of Democratic and no-party voters, support same-sex marriage rights, according to a new survey conducted by graduate students at Drake University. The same survey indicated that 62.5 percent of Iowa voters oppose a constitutional amendment that would ban same-sex marriage. Those are the highest levels of support for marriage equality I’ve seen in any Iowa polling. I am skeptical that an opinion poll conducted in a more traditional way would find similar numbers.

More results from the online survey and details about its methodology are after the jump.

The Iowa LGBT Marriage Study 2011 was a research project for graduate students in the master’s of public administration program at Drake this year. Summary findings are posted here, and full results including question wording and order are here (pdf). You can download the full report here (pdf). Pages 19 through 22 explain how researchers collected and weighted responses, so that the adjusted results corresponded to the demographics of Iowans who were registered to vote in November 2010 and remained registered to vote in June 2011. The web-based survey was open to the public for 12 days, during which 2,217 people attempted to fill it out. The researchers used 1,780 responses to tabulate results (excluding respondents who did not complete the survey, or don’t live in Iowa, or didn’t live in Iowa when the Supreme Court announced its Varnum v Brien decision in April 2009).

Originally, there was variance between the age group, gender, and political party affiliation distribution for the survey respondents and the standard population. Younger females who aligned with liberal beliefs were the most frequent responders (Table 1). However, the large sample size of this study resulted in a significant number of no-party or independent and conservative responses. After weighting, the distribution of the weighted variables was similar to the standard population.

The weighted population was 47.4 percent male and 52.6 percent female, containing 33 percent self-identified “liberals,” 30.7 percent self-identified “conservatives” and 36.4 percent self-identified “independents.” Pages 23 through 26 of the full report include more demographic information about the survey respondents’ geographic distribution, race, ethnicity, education level, marital status, religion.

Asked “Should same-sex couples be legally allowed to marry in Iowa?”, the weighted results indicated that 61.3 percent said yes, 34 percent said no and 4.7 percent were not sure. Note: this survey did not give respondents the option of supporting some legal recognition (like civil unions), but not full marriage rights, for same-sex couples. Several Iowa polls conducted during the past two years have shown majority support for some legal recognition of same-sex relationships, but less than 50 percent support for full marriage equality.

For reasons I don’t understand, the researchers broke down responses on this question by “political party affiliation.” They found that among what they call “Democrats” in Figure 4 (page 28), 97 percent said same-sex couples should be allowed to marry, while only 1.3 percent said no and 1.7 percent were not sure. Among “independents,” 69.1 percent supported same-sex marriage rights, 22.3 percent said no and 8.6 percent were unsure. Among “Republicans,” just 13.3 percent said same-sex couples should be allowed to marry, 83.3 percent said no and 3.5 percent were unsure.

I would take those results with a big grain of salt. As far as I can tell from reading the questionnaire, this survey did not ask respondents whether they are registered Democrats, Republicans or no-party voters. Instead, researchers adjusted the results so that the proportion of self-identified “liberals” completing the survey corresponded to the proportion of Democrats in Iowa’s registered voter population. Similarly, those who identified themselves as “conservatives” in the survey were considered to be Republicans, and those who said they were “independents” were considered to be no-party voters.

But not all Iowa Democrats would call themselves liberals–far from it. I would expect nearly all self-identified liberals to say yes to marriage equality, but I doubt that 97 percent of registered Iowa Democrats support same-sex marriage rights.

I am puzzled by the Drake researchers’ decision to conflate “liberals” with Democrats, “conservatives” with Republicans and “independents” with no-party voters. They do the same thing reporting results for other questions: about support for a constitutional amendment to ban same-sex marriage, about the impact same-sex marriage has had on the people of Iowa; about how the average Iowan views same-sex marriage.

The Des Moines Register conducted a statewide poll using traditional telephone interviews between June 19 and 22. So far the newspaper has reported only some results for the likely Republican caucus-goer subgroup, but a much larger sample of registered Iowa voters was surveyed. In the past two years, each statewide poll commissioned by the Register has included a few questions about marriage equality, so probably new findings will come out in the next couple of weeks. I will be interested to see how the Register poll’s numbers compare to this online survey. The last Register poll, conducted in February 2011, found Iowans “split three ways” on the Iowa Supreme Court’s marriage ruling: 32 percent of respondents favored or strongly favored the controversial ruling, 37 percent opposed or strongly opposed it and 30 percent said they don’t care much one way or the other. That was a shift from the Register’s September 2009 poll, which found 26 percent of respondents favored the Supreme Court ruling on marriage, 43 percent opposed it and 31 percent didn’t care or were unsure.

Share any relevant thoughts in this thread.

UPDATE: A large sample size does not automatically produce a low margin of error for a survey. That would be the case only if the researchers used random sampling methods to reach the large group of respondents. This survey was not sent to a randomly-selected group of Iowans.

About the Author(s)

desmoinesdem

  • It's obvious...

    Why did they conflate “liberals” with “Democrats,” etc.?  It gets them the results they’re looking for.

    Nowhere near 33% of the electorate in Iowa describes themselves as liberals, but that’s about the number registered as Democrats.  This methodology skews the results in favor of same sex marriage in a big way.

    I’m not particularly passionate about this issue one way or another (sorry), but self-delusion doesn’t help the cause.

    If they believe these numbers, shouldn’t they welcome a referendum on a constitutional amendment to put the issue to rest once and for all?

    • can't speak for them

      I don’t believe that minority rights should be contingent on a majority vote, period. My opinion would not change even if I felt confident that 90 percent of Iowans would vote against a marriage amendment.

    • Biased or Incompetent?

      Were they aiming for a certain result or are they just no good at polling? I read through the “Authors” section of their results site and none of these folks have a background in statistics–a few have some politics background, but not a majority.

      Is it possible they just kinda botched their methods and now don’t want to admit it?

  • In response to some of the questions raised ...

    Although ModeratelyExtreme seems to think it’s odd that an author of this study would want to reply to comments to provide additional information and clarification, I’m going to do it again. My intention is to address some of the questions and concerns raised here – nothing more, nothing less.

    ModeratelyExtreme was correct in pointing out that this study was done by a group of graduate students working toward their master’s degrees in public administration. This was a class project for us, not a PR stunt or some sort of exercise in “self-delusion.” It was not co-authored by our professor because it was an assignment for him. @SharpHawkeye: one of our group members does have quite a bit of experience with statistics, though it may not be mentioned in her bio. In addition, we enlisted the help of a university professor who teaches statistics and is trained in demography and population studies.

    That being said, was our survey flawless? Of course not. This was a six-week summer course and we had to work quickly. Some of the questions in the original survey weren’t worded as they should have been so we threw out those results. The findings that we do list in our report, however, are statistically significant because of our large sample — over 1,700 used for analysis. (Take a look at other surveys done and they usually have a sample size in the hundreds.) Plus, we had good representation in all the major demographics (such as age group). We then adjusted the survey results by standardizing them to a standard population. (That makes this more than just a straight opinion poll.)

    When we started this project we were hoping for a few hundred responses – 1,000 was our lofty goal. Twelve days later we had over 2,200 attempts at taking the survey. (“Attempts” refers to anyone who started the survey. If they didn’t complete it, we didn’t count their responses for this analysis.)

    We chose to post our results online because the survey was spread virally online and we needed a way to somehow make it possible for everyone who took the survey to also access the results.

    Our goal was to assess the opinions and impressions of Iowans two years after the legalization of same-sex marriage. It’s a social science examination of where Iowans are at. It is not our place to call for a referendum or anything like that.

    And now, here’s my question to you: Why do you think the comments on this blog have focused more on finding an ulterior motive (there is none … except perhaps an “A” grade) instead of YOUR observations and impressions of same-sex marriage, or how you think other Iowans view the issue? Regardless of whether or not you personally agree with our study’s findings, that, I think, would be a more interesting discussion.

    (In anticipation of a cynical response to my final question: no, I am not trying to change the subject to avoid answering further questions about our research or methodology. I would just appreciate it if those questions were actually in the form of questions, not accusations.)

    • thank you

      for coming here to discuss your study. I appreciate your willingness to engage in the debate.

      I was not trying to accuse or suggest ulterior motives, but I do think it was a mistake to collect data from self-identified “liberals,” adjust the results to conform to the proportion of Democrats in the electorate, and report the findings as representing Iowa Democrats.

      I do not see grounds for making that leap from “97 percent of self-identified Iowa liberals support gay marriage” to “97 percent of Iowa Democrats support gay marriage.” If you want my impressions on how Iowans view the issue, I just do not believe support for marriage equality is that high among Democrats, nor do I believe two-thirds of independents support same-sex marriage rights.

      I don’t think you can compare your sample of 1,700+ to a randomly-generated sample of a few hundred. Statistical significance depends on a lot of things, but starting with a random sample of the group you’re studying is important.

    • I didn't find it odd,

      I was just hoping that you didn’t intend to stand behind the study as academically rigorous. You were under constraints that made proper methodology impractical, and that’s not your fault. With some tweaks and the right resources, much of the process could have value. However, the limitations of your study just don’t allow the kind of conclusions that you’ve stated.

      The biggest problem, as many have mentioned, is the sampling method. Large sample sizes don’t mean much if the population sampled is not representative of the target population. Your sample population consisted of activists and individuals who self-selected (i.e. likely to be much more engaged in the subject than the average voter). This is the same reason why those online polls that you see TV news shows put up are always accompanied with a “not a scientific poll” disclaimer. It is unlikely that you can take these results and adjust them to demographic markers in order to get an accurate poll.

      For an example of how large sample sizes don’t mean much, look up a famous presidential poll conducted by The Literary Digest which had a sample of 2.4 million responders and predicted that Alf Landon would be elected president in 1936. Franklin Roosevelt, of course, won by a landslide.

      I believe you that the data has not been cooked to come up with a particular result, but you have to realize that even professional pollsters tend to have partisan bias, and so it is always in the forefront of people’s minds when they’re presented with such remarkable data about a hot-button issue. Couple this with the fact that your website uses a rainbow theme, and it is understandable that readers would be suspicious. To help with these perceptions (and probably your grade!), you ought to acknowledge the limitations of your study and temper the strength with which you’ve stated your conclusions.

Comments