Do you agree most polls are biased and misleading?

  • 1
  • Question
  • Updated 1 year ago
  • Answered
I am not new at all to IMDB, but I'm rather new to polls and brand new to this site. And as I started doing polls, I've noticed an unfortunate trend I believe is invisible to many people, leading to inaccurate poll results. 

I refer to the issue where in most polls, the most popular (or arguably most "obvious") options are listed at the top. I hypothesize that many users don't even make it to the bottom of the page, they pick the first one that they either recognize, prefer, or agree with, and usually it's in the top 5. You can see it for yourself....do a few polls and notice the options with the highest percentages are in the top of the list of options. This is true for the slight (or vast even) majority of polls. 

Do you agree or disagree?

I feel to get more accurate results, one must simply randomize the selections. OR even better, IMDB could randomize the options for each user every time the page is refreshed or opened. 

Thoughts?
Photo of Austin McMullin

Austin McMullin

  • 8 Posts
  • 5 Reply Likes

Posted 1 year ago

  • 1
Photo of Stephen N Russell

Stephen N Russell

  • 826 Posts
  • 1206 Reply Likes
Some polls never end on topic alone, some are super short & replied too.
& I agree.
Polls on Oscar,Grammy etc can take hours since poll subjects so long IE Best Oscar  Winners for the 1980s etc.
Shorten, emphisize Top  Box  Office or TV ratings alone.
Can Help.
Photo of ACT_1

ACT_1

  • 3284 Posts
  • 3099 Reply Likes

I am not new at all to IMDB,
but I'm rather new to polls and brand new to this site.
And as I started doing polls,
I've noticed an unfortunate trend I believe is invisible to many people,
leading to inaccurate poll results.
by Austin McMullin
Joined on March 28, 2018
https://getsatisfaction.com/imdb/people/austin_mcmullin
- - -

lots to read here....

https://getsatisfaction.com/imdb/topics/same-person-with-many-accounts-flooding-the-polls-and-rating...
Same person with many accounts Flooding the Polls and Ratings
Posted 4 weeks ago
by ACT_1

- - -

Today: Looking at some of the older Users Profiles listed - their Poll votes have been deleted

Most (all) Users are active for one day


(Edited)
Photo of Peter

Peter, Champion

  • 5942 Posts
  • 6926 Reply Likes
Hi,

You are probably right that the first poll options do better on average. The order of the options is generally up to the poll author. Sometimes you also see popular options listed toward the end of a list.

Automatic randomizing might work, but would require rebuilding the poll feature.
Photo of ElM.

ElM.

  • 3274 Posts
  • 3384 Reply Likes
Here's a simple answer:

- when you make a list, the immediate options are the most "popular", that's how the mind works
- when one expect a list, he expect the "popular" one so it makes sense to have them as introductions to the list, if you make a book about Western, you'll have High Noon or The Searchers on your cover not Johnny Guitar.
- also, when users make lists, they wish it can get on the homepage so the best-looking options better be on the top

now, about the bias:

- it's possible that some users vote for the sake of voting
- but it's doubtful that one would be so lazy he or she wouldn't be able to scroll down a list and check if there is not a more interesting option somewhere (it's not like the list are discouragingly long)

The trick is to have a "popular" option near the end of the list, believe me, if it's popular enough, it'll get on the top of the votes.

Another thing is that many polls don't make it to the homepage, so you can't come to any definite conclusion when the poll gathers something like 100 or 200 votes, when it gets to the thousands, the initial position becomes meaningless.

In other words, if there is a bias, it'll be cancelled out by the number of votes, sooner or later.

This conversation is no longer open for comments or replies.