Rating Idea

  • 37
  • Idea
  • Updated 2 years ago
  • Not Planned
Merged

This conversation has been merged. Please reference the main conversation: Ratings: Allow more precise voting

I Think That The User Should Be Able To Gove Ratings In Terms Of Points Like The Official Ratings Of The IMDb. As In '6.6' or '8.9' or Something Like This Instead Of Just '8.0' or '6.0' . It Would Better Because We Would Be Able To Give Exactly The Type Of Rating That We Wanna Give To Any Title.
Photo of Kumar Avi Tandon

Kumar Avi Tandon

  • 1 Post
  • 0 Reply Likes
  • confident that this could be a very big inprovement in the IMDb website and application.

Posted 5 years ago

  • 37
Photo of Dan Dassow

Dan Dassow, Champion

  • 13918 Posts
  • 14495 Reply Likes
Hi Kumar Avi Tandon,

I'm another user, not an IMDb staff member.

Other users have suggested something similar. IMDb's official response is that they will NOT consider this idea.

IMDb's voting infrastructure depends upon the 10 point scale. It would take a significant amount of effort for IMDb to implement your idea with very little or any additional benefit.

Research on rating scales indicate that people find it difficult to effectively use a rating scale with more than 10 points.

For more details, please see:
Chapter 9
Question and Questionnaire Design
Jon A. Krosnick and Stanley Presser
Handbook of Survey Research, Second Edition
Copyright (C) 2010 by Emerald Group Publishing Limited
ISBN: 9781-84855-224-1
https://pprg.stanford.edu/wp-content/uploads/2010-Handbook-of-Survey-Research.pdf
Photo of Myriam Alcobas García

Myriam Alcobas García

  • 2 Posts
  • 3 Reply Likes
This reply was created from a merged topic originally titled I really need, at least, half points, for the rating system!!!.

As a regular user of this site, I really find necessary a finer rating when qualifying movies/series I watch. Sometimes, I have a real problem deciding what to rate, because for example, I find a movie can be not good enough for an 8, but that deserves more than a 7. 
I know this is not the first, nor it'll be the last time, that users ask you to do this, I still think you really should consider this, we all love movies, and we all would like to be as fair as we could with them.
Photo of JODW

JODW

  • 2 Posts
  • 2 Reply Likes
This reply was created from a merged topic originally titled Ratings: decimal system.

The IMDB rating system needs improvement: decimals. Movies will be graded more accurately if you rate them on a scale of 1-10 that includes decimals. IMDB will have a more precise rating database for all the ''average'' movies, which scores between the 5 and 7. I suppose people feel like watching the movie if it scores higher than a 7, but i am confident that a more accurate rating will improve the rating/reviewing experience, as users will have a more accurate grade. 

Furthermore, IMDB could implement a more thorough rating system, meaning that users can give an overall rating and ratings for music, screenplay, acting etc etc. You can link this feature with IMDB pro users for example ..

Anyway, I strongly believe that the grading system needs an upgrade. 
Photo of Laurent Grimal

Laurent Grimal

  • 6 Posts
  • 6 Reply Likes
This may make a difference at the user level but on an aggregated basis this won't matter. You would end up with virtually the same decimal over a certain number of votes. In particular the relative position of two films would be unchanged. Also a decimal rating would not be as immediate and less people would rate films as a result. The superposed star rating on the current aggregate rating is just too good a rating process to be abandoned.
Photo of Gavra Fan

Gavra Fan

  • 8 Posts
  • 1 Reply Like
This reply was created from a merged topic originally titled accurate ratings with 0.5.

You should give the option to rate 7.5 8.5 etc..
for example, when the cursor of the mouse is above the rate 7 it should show 7.5 above it so I can move my mouse easily and choose it.
It could give more acuurate ratings. I find it sometimes hard to decide wether it's a 7 or an 8..
Photo of Muhammad Imran Khan Lalwani

Muhammad Imran Khan Lalwani

  • 2 Posts
  • 0 Reply Likes
This reply was created from a merged topic originally titled Half Star.

Hi!
I think you should introduce "half stars" as well...e.g. if we want to give a movie 7.5 stars, we should be able to do so.
Sometimes, i feel that if a movie is worth half a star more or half a star less, than i could give her... full star isn't justified, nor half a star less.
Photo of Aleksandr Gimburg

Aleksandr Gimburg

  • 2 Posts
  • 0 Reply Likes
This reply was created from a merged topic originally titled Rate improvement.

Please, add opportunity to rate movies with .5 (example 7.5) I don't want to rate movie by 7 because it's better then 7, but not as good as 8 star movie. Hope you see my point.
Photo of Laurent Grimal

Laurent Grimal

  • 6 Posts
  • 6 Reply Likes
then use the 6 rating more often. you have a 10 star scale but most people only use 3-4 different ratings on all their films. Time to use the full scale.
Photo of Andreas Skapetis

Andreas Skapetis

  • 2 Posts
  • 0 Reply Likes
This reply was created from a merged topic originally titled More accurate rating...

I think that it would give to imdb rating outcome much better accuracy if users had the possibility to rate also fractions... for example i may think that a movie worth 6.5. Currently I have only the option to give 6 or 7 which is does not depict to the my actual opinion of this movie.
If many users have this problem then the total rating of the movie will be misleading.
Maybe it would be enough if users had the option to rate the halves (e.g 5.5, 6.5, 7.5 etc..) and not all the fractions..
Photo of Adityaraj Mishra

Adityaraj Mishra

  • 2 Posts
  • 0 Reply Likes
This reply was created from a merged topic originally titled Enable floating-point ratings for users for more accuracy..

Please enable IMDB users to rate an item more accurately by enabling floating-point ratings for users.
Photo of Orfeas

Orfeas

  • 2 Posts
  • 0 Reply Likes
This reply was created from a merged topic originally titled Movie Rating.

I think movie rating should have more choices,meaning to increase the scale of voting,for example 0.5, 1.5 , 2.5, 3.5 etc.That would make movie rating even more accurate and would make imdb even more thrustworthy for movie choices.I'm telling you this because a lot of people,including me,think that this would improve the site.
(sorry if my english arent very good :D) and thank you for your time.
Photo of Shaked Bar

Shaked Bar

  • 3 Posts
  • 0 Reply Likes
This reply was created from a merged topic originally titled rating titles.

Hi,
me and my friends really love to contribute by rating each title after we watch
it. and we were wondering if there's a possibility of rating titles by giving out half points or fractions at all?
There are some titles we all agree should have a fraction of a point and not a
whole point.

please consider.
thanks ahead,
Shaked Bar
Photo of Juraj Cichansky

Juraj Cichansky

  • 2 Posts
  • 0 Reply Likes
This reply was created from a merged topic originally titled Movie rating possibilities.

Hello IMDb team,

I'm big fan of IMDb.com and regular user, mostly of mobile application. I would like to ask why it's possible to rate movies only using integer number. I'm missing decimals... For instance, I would like to rate movie as 7.5, but I only can as 6 or 7. 

What about to change this option? :)

Thanks for reply

Juraj
Photo of yaya zidane

yaya zidane

  • 3 Posts
  • 0 Reply Likes
This reply was created from a merged topic originally titled More specific ratings.maybe??.

IMDb why don't you make the ratings more specific like for example 4.6 or 9.1 etc.
otherwise we overrate or underrate a lot of movies that actually aren't in the same level
i believe there's a lot of difference in 8.6 and 9.4 foe example
Photo of DavidAH_Ca

DavidAH_Ca, Champion

  • 3261 Posts
  • 2917 Reply Likes
Traditionally most rating systems have been 10 steps or less. 

I currently check the ratings in 2 daily newspapers here. One of them uses a simple five point system - they display 5 dots with those to be counted dark and the rest light.

The other one uses a 10 (or possibly 9) point system. Again it has five basic ratings :
5 - Oscar buzz
4 - Filmfest gem
3 - It's okay
2 - B-List
1 - Kill me now
However,   they display stars instead of dots, so they are able to show half-star ratings. This sets up a one-to-one relationship between their system and IMDb's ; however, I have never seen a rating of less than one and I seriously doubt that they would show a single half star. Therefore, it is likely actually a nine-point system matching 2 - 10 in IMDb.

In his Guide, Leonard Maltin used a 7 point system from 4 to 11⁄2 plus BOMB; again less than IMDb's.

Why do you feel you need a 20 (or 100) point system when the professionals get by with less than 10? A major reason for the ratings is so that others can understand how you feel about the film. Would they in general understand the difference between 8.0 and 8.5? And more so  between 8.0 and 8.1 ?

Making this change would not be simple. Depending on how the ratings are currently stored, the actual layout of the data records might need to be changed.  A new way of inputting the rating would need to be set up and moved out to all pages and apps where it is done.  A second icon (the half star) would need to be added to the system if they still want to display the rating graphically. The problems would only increase if they went to a full decimal, not just the half.

Personally, I would prefer to see the data shown as 5 stars with half-stars permitted. It is easier to understand 5 steps than 10,  using a scale such as I posted above. A 31⁄2 would be '"better than B-list but not quite good enough t be actually okay".  I find this easier to work wit than trying to decide just what 7 means in the 10 point scale.

If it is important to you to have this data for your own use, you can set up a separate 'My ratings' list, add the Titles there and store the more detailed rating in the description field.
(Edited)
Photo of SERGIU PETRISOR

SERGIU PETRISOR

  • 4 Posts
  • 2 Reply Likes
I wrote a post on the exact same topic as I thought of it a long time ago and I'm glad to see that I'm not the only one thinking of this.

I to think that finer ratings are better suited for imdb, as it has become the world's number one and most influential movie platform in the world. This influence comes also with responsibilities regarding fairness for the movies and for the people that use this platform.

There is a difference between a 6.7 and a 7.8 but with no steps in between, it's sometimes hard to rate a movie. If decimals are out of the questions, at least introduce a quarter step rating system (8 - 8.25 - 8.50 - 8.75 - 9) as it would, maybe, best suit this platform and still allow users to better fine tune their ratings. I strongly believe that people who have become in time very "movie educated" start to find the need for intermediate rating because sometimes a movie does not deserve an 8 but neither the usual 7 i.e. .

I think that imdb as a platform has enough people and revenue to change something if it best suites them, so the argument that it would be difficult is in my opinion not to be considered as a valid one. Solutions can always be found for the ones who search for them.

Lastly, David, a. just because others use simpler rating systems, doesn’t mean we have to go with the rest of them; b. a rating system that has 5 stars and a half-star permission is basically a 1 to 10 rating system, as it permits 10 possible ratings.
Photo of Chef88

Chef88

  • 15 Posts
  • 4 Reply Likes
Guys, unfortunately all the attempts on this matter seem sooo pointless,
since the IMDB staff choose to ignore this and list it under the "Not Planned" ideas,
not even "Acknowledged" in order to further explore it...
Such a pity, for the best global platform for movies,
to consider silly stuff like checking in etc
and to ignore the basic ingredient, that of ratings.

I mean, ok maybe it seems impossible to implement a full decimal approach or even the quarter step rating system that Sergiu proposes,

BUT AT LEAST enable your users to rate movies with half-stars (e.g 5.5, 6.5, 7.5 etc..) like all great reviewers do, contributing both to the user-satisfaction and to more accurate ratings..

Cause from another point of view, the current rating system in NO WAY reflects the actual ratings, and it ends up being just a rough estimate...

There are really tops 3-4 big user-satisfaction issues, like this one
https://getsatisfaction.com/imdb/topics/stop-displaying-movie-titles-with-users-local-language-title for example that if were solved adequately,
the site would skyrocket and EVERYONE would be happy and "loyal"
and not searching for alternatives..

Thanx in advance!

P.S. Maybe
IMDb's voting infrastructure depends upon the 10 point scale.
It woulld take a significant amount of effort for IMDb to implement
but isn ́t this effort that brings evolution and improvement,
instead of perpetuating some annoyingly wrong functionalities for the years to come??

After all, this isn't about some governmental service which is reluctant to change due to bureocracy or boredom.
Approaching such issues with a perception like "nah, we still gonna have millions of users, why bother", isn ́t the proper one.
Cause maybe one day, due to those issues, the true devotees of IMDB that contribute so much (not saying that I ́m amongst them yet) may take their stuff (reviews,ratings) elsewhere..
(Edited)
Photo of Chef88

Chef88

  • 15 Posts
  • 4 Reply Likes
Ok, I don't want to sound ignorant or arrogant, but I don ́t think that some studies of people sticking to numbers and making references from "prehistoric" figures like Likert (1932), Thurstone (1928) and Tannenbaum (1957), are able to canvass the real question here.
Let alone when they are mostly about questionnaires and focused on psychological constructs and political attitudes,
and not on movie ratings.
For such matters, yes, the preferred scale is a 5 or 7 point one, from my experience too.

Maybe the difference between a 6.5 and a 7 in a survey regarding social/political matters is pointless and impractical,
but trust me when it comes to content like movies/albums is practical and meaningful, and I don ́t care that much about research studies.

It ́s kinda late here, but I ́ll try to express my thoughts on this..

Many viewers watch only "good" stuff, so in a way, the available scale for them is the 6 point (5-10), with the threshold of what's watchable placed at 6.5-7.
Thus they need a better classification for ratings above that, like the US academic grading scales
                              

And of course having that kind of approach in mind,
it is difficult with the current system to rate a movie with 6 (kinda watchable but didn't deliver that much) just because it doesn't deserve to be rated as 7.

You might say that this approach can be adapted in a 10 scale as well.
I think it would be unfair and kinda confusing if we rate those movies with 2s or 3s.

Rating a movie with B- wouldn't be the same with rating it with B+.
Now for example, with the chaotic gap between 7 and 8
we have to bundle movies we rate with C+ with those that we rate with B+ (cause respectively, it wouldn't be "fair" to bundle them with those we rate with C- and D+ i.e. 6)
With the same notion, it's extravagant to rate those with B and B+, as perfect As or if you like 10s.

Consider it also with the psychological implications as well. Is 7.2 and 7.8 the same?

Take it from another point of view as well..
Estimating the mean of the 10 point current rating system, is as accurate and reflective of the actual ratings (at least with the halves) that many reviewers had in mind, or it ends up just a bare estimate?

Anyway, of course I ́m not claiming any expertise here but some things are kinda common sense and dictated by how people think or what they like, not by some studies.

Cheers!

P.S. Since by no means I'm providing my credit card info without an EV SSL Certificate to authenticate my account, and I can't send you a pm,
I'm posting it here..

1. The Shawshank Redemption (1994).........9.5
2. The Godfather (1972)...............................10
3. The Godfather: Part II (1974)....................9.5
4. The Dark Knight (2008).............................8.5
5. Pulp Fiction (1994)....................................9
6. Schindler's List (1993)...............................9.5
7. 12 Angry Men (1957).................................9
8. The Good, the Bad and the Ugly (1966)....8.5
9. The Lord of the Rings: The Return of the King (2003)....8
10. Fight Club (1999).................................... 8.5
(Edited)
Photo of Dan Dassow

Dan Dassow, Champion

  • 13914 Posts
  • 14487 Reply Likes
Chef88,

Thank you for your votes. You are the first to vote.

Note: Since I am not an IMDb staff member, this experiment is strictly for information purposes.
Photo of DavidAH_Ca

DavidAH_Ca, Champion

  • 3261 Posts
  • 2917 Reply Likes
Many viewers watch only "good" stuff, so in a way, the available scale for them is the 6 point (5-10), with the threshold of what's watchable placed at 6.5-7.
Thus they need a better classification for ratings above that, like the US academic grading scales
                              
I find it interesting that this "better classification for ratings" only has 12 options to IMDb's 10, and if you remove the GP of 0.0 only one more.
And of course having that kind of approach in mind,
it is difficult with the current system to rate a movie with 6 (kinda watchable but didn't deliver that much) just because it doesn't deserve to be rated as 7.
Again, if you count the 2.0  (4.0 /2) as matching IMDb's 5 (10/2) then once again there is only 1 more option in the Academic scale than in IMDb's in this restricted range.

It seems to me that this shows a weakness in your premise that at least a 20 point scale is necessary.

Personally, I would prefer to have a scale of  1-5 with half stars (which would probably end up being 9 steps as a rating of 1/2 is often not allowed) because I find it easier to quickly assign meanings :
1 : Bomb, Turkey, "Kill me now"
2 : Might be OK if you see it for free
3 : Average - good
4 : Very good - definitely worth seeing
5 : Excellent - a must see

The half stars simply refine these 5. I realize that the current system is basically the same, but I find that the 2-tiers make it easier to immediately grasp what is probably meant.

The difficulty I see in implementing this would be the data entry. Since the display should change to just 5 stars, the user could not just click on the stars as shown, the system would have to expand it so show all possible choices.

I.E. 2.5 would show 5 stars : On, On,  Half, Off, Off. If the user wanted to change the rating to 3.5 there is nothing in that display to click to give that result.

Photo of Chef88

Chef88

  • 15 Posts
  • 4 Reply Likes
Many viewers watch only "good" stuff, so in a way, the available scale for them is the 6 point (5-10), with the threshold of what's watchable placed at 6.5-7.
Thus they need a better classification for ratings above that, like the US academic grading scales
https://d2r1vs3d9006ap.cloudfront.net...

I hope you'll understand that just like the US grading scales, I was suggesting a 12 point scale for the movies with ratings from 6 (D-) to 10 (A+).
The rest below 6, just a plain fail (F), since there's no point of classifying failures (0-5) :)

For example,
http://www.reelingreviews.com/gonegir...
http://www.reelingreviews.com/whiplas...
http://www.reelingreviews.com/winters...

Anyhow, all this seems kinda pointless since nothing's gonna change,
not even this one
https://getsatisfaction.com/imdb/topi...
Btw, what are your thoughts on this?
Isn't what I'm suggesting feasible?
(Edited)
Photo of treetoon

treetoon

  • 1 Post
  • 0 Reply Likes
I support adding more precision, in fact I've stayed away from rating on IMDb entirely for several years due to the fact that I could not rate what I wanted to rate. 

I've got this notion based off of current scores on films, where 10/10 is unrealistically perfect that rating such is stupid since the highest rated films have roughly 9.0~. In order for estimates to work properly people of course need to rate higher than than the best film scores on the top-250 list. This lead me to think that vote ratings don't really represent the weighted average score as I wanted it to, because it can't. This poses an interesting statement, the two systems are fundamentally not compatible. 

I went on to create arbitrary definitions of how others uses the vote system when voting on films that have specific average scores on IMDb: 

w = IMDb Weighted Mean
u = User vote

w = [1,   2,   3,   4,   5,   6,   7,   8,   8.5,   9]
u =   1,   2,   3,   4,   5,   6,   7,   8,   9,    10
w(u)

This way I could give more accurate representations of a films current IMDb score. 

I sincerely believe there is a massive difference on a 8.5 and a 8 film. With fined tuned decimal accuracy I'd be able to give a better representation of what I personally feel. But realistically, noticing a difference of .1 isn't possible. However, merely adding .5 can cause drawbacks, a 7.8 and 8.2 has to be rounded off to 8; I think it's possible to fine tune slightly more. 

Of course, the two systems don't get solved, but you're still gonna have loads of people rating 10/10 even if fine tuning were to exist. 



TL;DR
I NEED MORE POINT PRECISION; AT LEAST .5
(Edited)
Photo of Laurent Grimal

Laurent Grimal

  • 6 Posts
  • 6 Reply Likes

All of this doesn't matter over a certain number of observations. On an aggregate basis the fine ranking is revealed. This functionality would only have merits for individual users who want to better track their film preferences, it will not impact the average rating for 95% of films, because the number of observations is so huge that the average converges towards the theoretical average with finer ratings.

Photo of SERGIU PETRISOR

SERGIU PETRISOR

  • 4 Posts
  • 2 Reply Likes

I have put a lot of thought into the rating system implemented on imdb.com, and I’ve changed my mind about the need for a finer tuning of the rating system, firstly, because I find it now to be of no real relevance for the platform nor for the general users and too complicated indeed. From the cost-benefit ratio perspective, it wouldn't be something worth considering.Secondly, because I think it could only benefit the few movie enthusiasts that have a tendency towards great movies and perfectionistic standards (I myself included; please don’t get offended by a subjective opinion, but only a few were really put off by the 1-10 scale).

I think this drive of mine to fine tune came from the following mistakes that I have made (I can only speak on my behalf, but maybe it is applicable to others as well):

1.       In time, my taste for movies craved for quality and finesse (regarding all possible aspects in a movie), and after a while, I realized I became extremely picky, watching only “the good ones”, or at least, avoiding “the bad ones”. Therefore, I became unable to really use the hole scale (1-10), because I rarely watched a bad movie and also held the believe that a 10 is only suited for something “beyond Godlike”.

Over time, focusing only on the “good movies” (movies that are currently rated from 6.5/7 to 9 on the imdb.com platform) I started to feel the need for greater accuracy between 6.5/7 and 9, trying to put a new scale of rating in between the 6.5/7 and 9. Let’s be honest, we all talked about 7.4 vs 7.6 or 8.3 vs 8.8, never about 3.3 vs. 3.8, and this, because the difference between 3.3 and 3.8 is irrelevant to those of us who posted about this topic and, all of us who wanted a finer tuning, were overly concerned about the higher graded movies. I find it now to be a wrong POV - the over focusing on the upper part of the scale only.

2.       Avoiding bad movies requires some form of COMPARISON, therefore,

a.       I developed a constant tendency to pick my movies in accordance with the following aspects (random order of presentation):

                                                                           i.      The general imdb.com rating,

                                                                         ii.      The metascore of the movie,

                                                                        iii.      Highly regarded opinions I have of a few film critics I follow/read,

                                                                       iv.      If the movie had participated in some prestigious film festivals I regard as good “movie barometers” ,

                                                                         v.      Special prizes it may have won;

b.      I also developed a constant tendency to compare the rating I gave to a movie with the previous ratings I’ve given others (this was the most prominent argument in my statement, and in other statements as well, i.e. <how can a give an 8, both for an 8.2 and an 8.9 movie?>)

However, it can be changed by CHANGING OUR RATING PERSPECTIVE and putting (excessive) COMPARISON, TO A STOP. I now rate the movies I watch in accordance with this rating in my mind, trying to be more impartial and to broaden my notes from 1 to 10:

1. Absolutely horrible; 2. Horrible / really bad; 3. Bad; 4. Bad-ish; 5. Average; 6. OK / works fine for decompressing with friends over beer; 7. Good; 8. Very good; 9. Excellent; 10. Masterpiece!

and I’m no longer discontent with the 1-10 barometer, because of all written above. Maybe it will work for you as well.

(Edited)
Photo of Tushar Kant

Tushar Kant

  • 1 Post
  • 0 Reply Likes
This reply was created from a merged topic originally titled Rating system on IMDB.

I use IMDB to follow past and upcoming movies & TV shows. After I have finished watching something, I usually go back and rate it out of 10, even various episodes of a series.
However, I feel that the current rating system on per point is too wide and needs to be detailed to 0.5 - like 7.5, 8 , 8.5 and so on. I have faced a situation many a times where a movie is not an 8 but does not deserve a 9 either. Being able to rate per 0.5 basis would fill this gap.
Photo of David Wood

David Wood

  • 1 Post
  • 0 Reply Likes
This reply was created from a merged topic originally titled Why can't I use a 0,5/integer rating online when ratings are given in integers?.

Why can't I use a 0,5/integer rating online when ratings are given in integers?

This conversation is no longer open for comments or replies.