• On MovieTome: See the villain of IRON MAN 2!

Webware

Read all 'Wisdom of Crowds' posts in Webware
July 28, 2008 11:34 AM PDT

When the 'wisdom of crowds' turns on itself: IMDB edition

by Harrison Hoffman
  • 2 comments

The concept of the "wisdom of crowds" is a fundamental building block of a lot of the Web 2.0 services that we see today. While not all of them are built on this core concept, major sites like Digg, Wikipedia, and Mahalo rely heavily on crowds being wise. There have been several instances of this system breaking down in the past, one notable occurrence being the infamous Digg HD-DVD revolt. On occasions like this, a mob mentality tends to take over a very vocal and active segment of a community, greatly skewing the product of their collective "wisdom." We are seeing the latest meltdown of crowd wisdom over at IMDB, the popular movie information database as we speak.

(Credit: Warner Bros.)

Since the release of The Dark Knight, the film has made an incredible surge to the No. 1 position on IMDB's Top 250 list, a spot that has only been held by The Godfather for the last decade or so. While most serious movie watchers would argue that claiming that The Dark Knight is the best movie of all time is ridiculous, we might be able to chalk the massive surge up to the unparalleled amount of hype that surrounded this movie, particularly in Internet communities.

Since The Dark Knight's initial rise, an even more interesting trend has revealed itself. /Film is reporting that, in an attempt to keep the movie on top, fans of The Dark Knight have been voting down The Godfather. The movie has gotten hammered so badly by Batman fans that it has fallen to the No. 3 spot. So, not only has The Godfather dropped out of the No. 1 spot for the first time in a decade, but now it has dropped from the second spot as well. This sort of drastic shift hardly seems the work of a wise crowd.

The Dark Knight has taken the top spot on IMDB, while The Godfather, the previous top film for the last 10 years, dropped to third.

(Credit: IMDB.com)

We are seeing a similar effect here to what happened with the Digg HD-DVD debacle. This mob mentality, brought on by a significant event (in this case, the release of The Dark Knight), causes a total breakdown in a system that is otherwise fairly accurate, useful, and trustworthy. The original theory of the wisdom of crowds discusses this sort of failure. A quotation from Wikipedia on the topic reads, "...in these types of situations their cognition or cooperation failed because the members of the crowd were too conscious of the opinions of others and began to emulate each other and conform rather than think differently."

Cases like what is happening on IMDB's Top 250 right now are not the fault of the users of the site. They are just acting how humans have always acted. Mob mentality is in our nature. We are always being influenced heavily by these outside sources. Sites like IMDB and Digg need to be set up to deal with and process the effects of an eventual mob action.

I am still a firm believer in the wisdom of crowds. I think that it is a tremendously powerful concept that can be applied to a variety of areas. However, if it is not implemented correctly, you will occasionally get breakdowns like we see here. In the cases of Digg and IMDB, these breakdowns happen infrequently enough that it is not a major concern and does not usually disrupt the use of the site. That said, we have seen, with some consistency, that the system can be broken or manipulated by the actions of a passionate group of individuals, acting as a mob. If these incidents are not largely prevented in the future and become commonplace, we risk a lot of people losing faith in this otherwise very useful system.

Originally posted at The Web Services Report
Harrison Hoffman is a tech enthusiast and co-founder of LiveSide.net, a blog about Windows Live. He is a member of the CNET Blog Network, and is not an employee of CNET. Disclosure.
January 10, 2007 4:00 AM PST

inChorus tries to harness the wisdom of the crowd

by Rafe Needleman
  • Post a comment

Last August, I covered MyCroft, which was making a unique service that broke down tasks, such as translation, that could only be done well by humans. It spread out these tasks as challenges on advertising banners. Cool idea, but it was so way out there that it was unlikely to succeed. And indeed, is hasn't. The company has renamed itself inChorus and launched a new service with that name that takes the original MyCroft concept in a new direction. I got the skinny at last night's Silicon Valley New Tech Meetup.

Ask the crowd your (short) questions.

(Credit: CNET Networks)

Now, instead of challenging random users to perform rote tasks such as translation and tagging, it encourages its questioners to launch "projects" that seek advice from the crowd. For example, you can ask for feedback on a product you're thinking of launching, or put a multiple-choice poll on the service, or (just like with the old version) ask users to tag photos or items.

What do these tasks have in common? Not much that I can see, and that's not good. I was initially intrigued by the open-ended project template on inChorus, but to me, a "project" consists of more than a single question and an answer that can be crammed into a standard advertising banner. Here's my project, for example. There's no room for depth there. It pains me to say it, but inChorus seems to be even more an example of a technology in search of a business than MyCroft was.

The concept of spreading work out to multiple users and sites does make sense, though. For example, the voting engine Vizu is interesting. Like inChorus, it distributes questions to multiple sites and communities, but the Vizu business model seems better thought out.

I liked what MyCroft was doing previously. I still believe that yoking the crowd of Net users together into a single engine of intelligence is a powerful idea, but this project seems a bit scattered.

  • prev
  • 1
  • next
advertisement

About Webware

Say No to boxed software! The future of applications is online delivery and access. Software is passé. Webware is the new way to get things done.

Add this feed to your online news reader

Webware topics

Inside the Apple, er, Microsoft Store

Although Redmond's foray into retail bears a big resemblance to Apple's approach, Microsoft has added some distinctive features to draw casual PC buyers and techies alike.

Big marketing budget drives Moto Droid sales

Verizon and Motorola are spending big bucks--$100 million--on marketing the new smartphone, and it looks like it will pay off with 1 million devices sold by year's end.

Most Discussed

Inside CNET News

Scroll Left Scroll Right