Ratings: Top 250 movies by Top 1,000 reviewers

  • 1
  • Idea
  • Updated 3 years ago
  • (Edited)
The IMDB Top 250 movies used to be my source for what movies to watch.  My watchlist on IMDB starts with the movies I haven't seen in the IMDB Top 250.  However, the Top 250 has been massively devalued of late.  Mediocre (at best) Indian movies getting voted into the Top 250 by the sheer volume of the Indian population plus the usual style-over-substance Hollywood movies (eg comic book stuff) that clueless kids, who've probably not seen more than 20 movies in their life, give a 10/10 to.

A solution for people who want to see the actual Top 250 is to create a list based on the Top 250 as rated by the Top 1,000 reviewers.  This way you're seeing an average score based on the opinions of people who have seen a lot of movies, know a good movie when they see one and have a consistent calibration system for their ratings.

As an indication of how effective it would be, just looking at a few of the Indian movies in the Top 250 I already see average scores in the 4s and 5s by Top 1,000 reviewers, showing the true quality of these movies.

This score is already calculated in the rating stats for a movie so it shouldn't be too much of a problem to form a ranked list of the average scores.  You would obviously have to have a lower threshold for number of votes, as 25,000 is not mathematically possible.  Something like 50 or 100 should do.  IMDB could get their stats boffins to work out the cutoff, based on credibility theory / Bayesian stats.

Before you say "Oh, but we have an English Top 250", that's not what I'm after.  I'm after the best 250 worldwide, not the best 250 English movies.

The criterion / filter could be applied to TV series too.
Photo of grantss

grantss

  • 33 Posts
  • 14 Reply Likes
  • sad

Posted 3 years ago

  • 1
Photo of Dan Dassow

Dan Dassow, Champion

  • 13958 Posts
  • 14579 Reply Likes
Hi grantss,

This is an interesting idea. Unfortunately, there is a major problem that would likely make it infeasible. The membership in the Top 1,000 reviewers is variable and would result in a volatile list of Top 250 from these reviewers. IMDb could decide to keep the Top 1,000 reviewers constant, but that list of reviewers would eventually deviate from the actual list of Top 1,000 reviewers.
Photo of grantss

grantss

  • 33 Posts
  • 14 Reply Likes
Hi Dan.  Thanks for the feedback.  The way around the issue you raised is to only update the Top 1,000 reviewers (for the purpose of the Top 250) weekly or monthly.  Top 250 will update as quickly as the original Top 250 (daily, or quicker, I'm not sure how it works), based on that temporarily-locked-in Top 1,000 reviewers.

This said, the Top 1,000 reviewers is unlikely to cause that much volatility.  I can't imagine there's that many new entrants/departures into/from the top 1,000 every week or even month.  IMDB could do some analysis and, based on the turnover within the top 1,000, see what the best waiting period between list refreshments should be.