• On BNET: Online porn struggles for profits
November 23, 2009 1:51 PM PST

The 'wisdom of crowds' loses steam

by Matt Asay
  • Font size
  • Print
  • 25 comments

If something seems too good to be true, it probably is. That popular aphorism never seemed truer than today when reading The Wall Street Journal's analysis of Wikipedia's declining volunteer base. Despite countless articles extolling the virtues and seeming omnipotence of "community" over the past several years, the technology industry seems to be settling back into old habits:

Command and control.

It's not that the "wisdom of crowds" idea hasn't influenced the way technology is developed, or how news and information are gathered and distributed. It has.

It's just that the promised sea change has proved to be far less disruptive than we expected.

Take Wikipedia. As the Journal calls out, volunteerism has declined as the ease of contribution has waned. The easy topics are taken. Rules for upping the quality have proliferated. Wikipedia is becoming...corporate.

Nick Carr has been pointing this out for years, but it's only now becoming self-evident. Wikipedia has grown up and, in so doing, is looking more and more like the encyclopedic world it sought to displace.

Nor is it alone. Open-source business models increasingly look like proprietary software models, as the Software Freedom Law Center's Bradley Kuhn suggests.

Even uber successful open-source communities like Joomla have discovered that reliance on volunteers falls short of what a few good paid developers can do.

That's a positive discovery by Joomla. A more worrisome discovery is that Mozilla remains far too dependent on Google to fund development of Firefox. Mozilla has lots of community, right? Yes. As Mozilla CEO John Lilly has said, 40 percent of Firefox's code comes from developers not employed by the foundation.

But that still leaves 60 percent, and virtually all of the core development work, that relies on "company," not "community," which is how much of the world's best open-source software is developed: funded by IBM and other "community" members.

For those who think "community" is a euphemism for "everyone else doing my work for me," think again. It just doesn't work that way.

Of course, companies can go to the opposite extreme, too. Apple, for one, gets beat up for a heavy-handed approach to its App Store approval process. Apple, in other words, doesn't seem to care one iota what "the community" thinks.

But then, this is the same App Store with more than 100,000 applications and 2 billion downloads to date. No wonder Apple isn't apologizing: it's clearly benefiting most people most of the time, or the application developers would take their complaints to a different platform.

But they haven't, and this calls out the problem with deifying "community." It's accepted wisdom that one shouldn't "anger the community," as if it's some unknown god that demands the occasional virgin to be thrown into the volcano. But the truth is, "community" is not really much different from the "customers" and "partners" the industry has sought to satisfy for decades.

So, yes, by all means seek to work with your community of users and partners, but don't expect "the community" to do your work for you. Guess what? "The community" already has a day job, and can't afford to work full-time for you unless you pay it.

All of which leaves us largely where we started. The most successful software companies don't rely on some vague "community" to build their products. Microsoft, Oracle, IBM, Google (Android, anyone?), and even, increasingly, Red Hat (JBoss, KVM, etc.) build great software based on their own, internal plans and expertise and "the community" buys it (or resells/embeds/etc. it).

The big shift, however, has been in the transparency of the feedback loop, which has been a welcome change in the industry. So, to the extent that "community" simply implies a more open way of developing and distributing software, then, yes, it has been significant.

But it hasn't changed the world. It has only changed the way the dominant technology companies...dominate.

Matt Asay brings a decade of in-the-trenches open-source business and legal experience to The Open Road, with an emphasis on emerging open-source business strategies and opportunities. Matt is chief operating officer at Canonical, the company behind the Ubuntu Linux operating system. Prior to Canonical, Matt was general manager of the Americas division and vice president of business development at Alfresco, an open-source applications company. He is a member of the CNET Blog Network and is not an employee of CNET. Disclosure. You can follow Matt on Twitter @mjasay.
Recent posts from The Open Road
What today's tech is teaching tomorrow's workforce
Google vs. Microsoft marketing
The application is the new the operating system
Oracle loses some MySQL mojo
From Alfresco to Canonical
Apple, Google, and the importance of Bing
Thank heaven for Apple's (upward) pricing pressure
Which open-source vendors can afford the cloud?
Add a Comment (Log in or register) (25 Comments)
  • prev
  • next
by cube3 November 23, 2009 2:21 PM PST
geez drone boyz, only took you how many years to figure this out?
stupid is what stupid does. and then idiocracy is proven to be a freaking documentary.:)
enjoy the bread lines.
Reply to this comment
by Super2online November 23, 2009 2:52 PM PST
I don't know if it's that simple, but yeah there is some truth in you're words.
by snigglepop November 23, 2009 2:22 PM PST
Wikipedia is only one model of "wisdom of crowds". The problem with wikipedia is there isn't a lot of incentive to contribute (for most people). Many other things -- for instance prediction markets, or recommendation systems such as that at Netflix -- tap into the crowd intelligence in a way that provides greater incentive to contribute meaningfully.
Reply to this comment
by derekwwww November 23, 2009 2:43 PM PST
I sense a political agenda or bias with the author.

I don't think anyone is pretending that open source (or wisdom of crowds, wiki, or any other names) was going to *replace* the traditional closed source approach. But it's a powerful force that no smart company should ignore.

And smart companies like Apple, Google, IBM have not ignored open source, but actively embraced it. But note that they only open source parts of their projects where it makes sense. They are smart enough to not assume open source is the solution to all things, nor do they think that open source should totally ignored.

The author seems to think that since open source didn't take over the world, it's a failure. I have to disagree.
Reply to this comment
by teh_chrizzle November 23, 2009 2:53 PM PST
matt asay is completely right. wikipedia didn't solve all of the world's problems, so clearly all of this open source stuff is a fad and is doomed to fail. now everyone has to stop using wikipedia and go back to buying encyclopedias.

congratulations matt, you beat the internet!
by solitare_pax November 23, 2009 2:44 PM PST
Many of these online communities are nothing more than fads that bloom, do insanely well, then die out. CompuServe and Geocities are two examples of extinct online communities. AOL, MySpace and Yahoo are two example of online communities on the decline.

Hopefully Wikipedia and Firefox won't go into decline as well - but when the shine of newness and usefulness wears off, and a set group of people occupy the top levels, leaving everyone behind, then the new people go off to set up a new community of their own, and the decline cycle begins again.
Reply to this comment
by solitare_pax November 23, 2009 2:45 PM PST
Many of these online communities are nothing more than fads that bloom, do insanely well, then die out. CompuServe and Geocities are two examples of extinct online communities. AOL, MySpace and Yahoo are two example of online communities on the decline.

Hopefully Wikipedia and Firefox won't go into decline as well - but when the shine of newness and usefulness wears off, and a set group of people occupy the top levels, leaving everyone behind, then the new people go off to set up a new community of their own, and the decline cycle begins again.
Reply to this comment
by wshun0 November 24, 2009 5:51 PM PST
Good say!
by safetee November 23, 2009 2:53 PM PST
In the cases of GPL software and wikipedia, a significant payoff is that the work done is always available. If the cathedral drops a project (e. g., X-window), the bazaar forks an x.org. The amateur might be more creative in starting a project or feature--if it is useful enough, a corporation may find it worthwhile to throw an expert team at the problem.
Reply to this comment
by SteveW928 November 23, 2009 3:04 PM PST
I've heard of this 'wisdom of the crowds' also referred to as 'a stupidity aggregate'.... it can go both ways. A great example is some of the debates which break out right here in response to Cnet articles. Often, 95% of the comments are this 'stupidity aggregate', with only a few comments here and there actually being well thought out. It doesn't matter much if you have 5 or 5 million uninformed people giving you their opinion on something... that doesn't equal wisdom. I think derekwwww said it well that smart companies (or everyone for that matter) know WHEN and WHERE to take the voice of the community into consideration or to involve the community in some way.

Apple is an excellent example. They are constantly listening to the community, they just are not ultimately driven by it. Other companies often either fake listening or don't have their own self-identity so they just put their finger into the wind and depend too much on what the community is saying, wise or not.
Reply to this comment
by Mergatroid Mania November 23, 2009 3:42 PM PST
So who says a company can`t be part of the "community"?
Reply to this comment
by Random_Walk November 23, 2009 3:47 PM PST
Heh. Everyone talks of "community" as if it were one entity that only had one context, ever.

Doesn't work that way.

Sometimes, the "community" can pull together and get good things done (Wikipedia's founding days, SCO being beaten to a pulp, etc), and sometimes, the "community" doesn't really give a damn - it wanders off, gets distracted, etc.

There are FOSS projects that have chugged along steadily for years on end with no shortage of help. There are others that generate a lot of initial buzz, but end up driving everyone off. Same with any other enterprise, really.
Reply to this comment
by LMarriner November 23, 2009 4:15 PM PST
Very insightful point of view. This surpasses what McKinsey just published in their Quarterly.
Reply to this comment
by littleM November 23, 2009 5:12 PM PST
The biggest problem and, perhaps, the secret to success of open source is "no one likes to support someone else's code." Therefore, if the code base is either frozen or in a constant state of development, then open source works. As soon as it becomes a job, open source will become history.
Reply to this comment
by me_arno November 23, 2009 5:33 PM PST
"Even uber successful open-source communities like Joomla have discovered that reliance on volunteers falls short of what a few good paid developers can do."

Matt, things may be a little different in this case than what your statement is telling. Do you really think a project with a community as huge as Joomla!'s doesn't have a whole pile of people ready to put in lot's of free time and effort at any given moment? Think about it.
Reply to this comment
by November 23, 2009 6:51 PM PST
"Even uber successful open-source communities like Joomla have discovered that reliance on volunteers falls short of what a few good paid developers can do."

Matt - did you read the last paragraph of OSM's announcement where they said they are excited about community engagement? Something doesn't fit, does it?

It is very disappointing to read this when some of us have been trying for some time, now, to get the project to acknowledge a problem with community engagement. It's unfortunate OSM isn't more open and transparent and that they don't engage the community in these decisions. I fear continued use of that type of decision-making only exasperates an already concerning problem.

You need to remember, Joomla! is 100% community based. This isn't a corporation or someone's personal investment. Joomla! was built by thousands of us.
Reply to this comment
by elinwaring November 24, 2009 4:21 AM PST
I think that in the case of Joomla! it is not one or the other. The goal of having some paid development in the Joomla! context is to get two things: big blocks of time from our most senior coders and the ability to manage development.

Among the limitations of 100% volunteer development is that it is hard to get those big blocks in sustainable ways, not just over a few months (we have lots of volunteers who will dive into a specific project that interests them for a month or two and do fantastic work) but over what is now 4 years and we hope will be many more years in the future.

Second, the more volunteers you have, the more time you need to spend coordinating and responding to their contributions. That is simply not the same fun as wriitng the code you are interested in or of the same personal value as write the improvements that help solve an issue you have.

One of our struggles has always been how to manage patches and code questions from volunteers. Now we have our most knowledgeable people doing that not just when they have some time and not at the expense of their businesses or of their personal lives. So in the end, I think we all think that one measure of success for this experiment will be sustained and then growing contributions from other people, especially people with the skill levels to make deep contributions to the Joomla! core.
Reply to this comment
by jheuristic November 24, 2009 6:40 AM PST
Hi -

"The reports of my death are greatly exaggerated ." - M. Twain

Enterprise collective intelligence, prediction markets, collaborative forecasting, etc. are booming. See:

http://www.pmcluster.com/

There are new suppliers, services and above all geometric enterprise adoption.

Remember, communities, corporations and WoC are complex network markets. They are simple not simplistic.

Cheers,

-j
http://www.networksingularity.com/
Reply to this comment
by jheuristic November 24, 2009 6:41 AM PST
Hi -

"The reports of my death are greatly exaggerated ." - M. Twain

Enterprise collective intelligence, prediction markets, collaborative forecasting, etc. are booming. See:

http://www.pmcluster.com/

There are new suppliers, services and above all geometric enterprise adoption.

Remember, communities, corporations and WoC are complex network markets. They are simple not simplistic.

Cheers,

-j
http://www.networksingularity.com/
Reply to this comment
by jheuristic November 24, 2009 6:42 AM PST
Hi -

"The reports of my death are greatly exaggerated ." - M. Twain

Enterprise collective intelligence, prediction markets, collaborative forecasting, etc. are booming. See:

http://www.pmcluster.com/

There are new suppliers, services and above all geometric enterprise adoption.

Remember, communities, corporations and WoC are complex network markets. They are simple not simplistic.

Cheers,

-j
http://www.networksingularity.com/
Reply to this comment
by Webconomist November 24, 2009 7:57 AM PST
It's human nature to organize. In order to scale, process is necessary. It's the way we as humans operate. Yes, some aspects are settling down as we develop behaviours...and as the novelty of some actions wears off.

But as the technologies evolve, we could see disruptions again. It will likely be a cycle. But organizing and process are what we do. Instead, we should look a little to the future.
Reply to this comment
by CoffeeGroupUSA November 24, 2009 11:53 AM PST
The volunteer community isn't shrinking. It's expanding. It's not at all depressing to witness certain projects experience atrophy in their volunteer community. It's NORMAL.

The time the volunteer community is most important and beneficial is during the founding and initial ramp-up of the organization - it's FORMATIVE time. Whether it be to start a software organization, raise funds for a cause, build a community playground or save people from natural disaster, volunteers play a critically important role in societies around the world.

But to diminish their importance or think the effort less meaningful because paid staff are taking over once-volunteer-driven efforts? Now that's UNWISE.

Once any volunteer organization reaches altitude, it's normal, and it's WISE to turn to a corporate model to sustain the organization or help it grow. It's up to that group's leadership to decide when to relinquish the reins, of course, but we can't go on, thinking it's somehow WISE to continue bleeding volunteers dry because the movement would be somehow blighted. That's bunk.

It is UNWISE to preclude the Business Community as part of the effort, whether that's in the formation- or the production-end. Sometimes it makes sense, sometimes it does not. It depends on the circumstances. Take for instance:

Volunteers don't run the military in the U.S. today, paid personnel lead the rank and file; but we sure tip our hats to the all-volunteer militia who fought under George Washington in the 1700's to give our Founding Fathers the power to start a new country.

Volunteers don't run most food banks or homeless shelters today, paid staff does a lion's share; but we sure appreciate those who recognized the need over the years and got them started on a volunteer basis in our local communities.

Volunteers don't operate most colleges and universities today, paid staff handles the day-to-day; but most were launched by a small group of volunteers who had the wisdom and stamina to ramp one up in their part of the world.

Volunteers don't handle the engineering, construction or insurance pay-outs near our rivers and waterways, but they sure as hell come through when back-breaking sandbagging is needed to save lives and property.

Volunteers come together to start things up at a time they're needed. Over time, the maintenance, repair, operation and in some case leadership are more times than not, relinquished to paid personnel.

Of course, strong leadership in the organizations is crucial to dictate the when, where and how this transition might take place. It is strong leadership that is in short supply - but that's a whole other subject.

Bottom line is, bringing in hired hands doesn't take away one iota of import or impact from the original all-volunteer community effort. It doesn't diminish the profound impact that effort had on society either (and Wikipedia has most certainly had a major impact on society!).

It is a natural, normal and welcome part of the organization's cycle to hand off some or all of the power to the "business community" once the initial ramp-up is over.

Volunteers start things. Paid staff carries it forward.

So, the 'Wisdom of Crowds' hasn't lost steam at all. It's just entered a new phase.
Reply to this comment
by jheuristic November 24, 2009 1:11 PM PST
Whew. Finally, someone that "get's it." Thanks for your post. Fluid, complex adaptive systems sustained by outcome, aka, communities, are expanding sharply and everywhere. They have a lifecycle like everything else. In fact, sometimes it is essential to 'eat your children,' to sustain robust, thriving community ecosystems. -j
by wshun0 November 24, 2009 5:51 PM PST
Agree!
by cube3 November 25, 2009 1:50 PM PST
what happened to the blocked comments without signing over my ID and add info from other 3rd party paid partners?

was it deemed unwise?:)
Reply to this comment
(25 Comments)
  • prev
  • next
advertisement

Google's social side aims for some Buzz

Facebook and Twitter are the darlings of the social-media world, not Google--which hopes to change that with Buzz, betting it can organize your online social life.

Watching the birth of a gaming start-up

Stewart Butterfield and his friends are back at it with a new company. CNET's Daniel Terdiman was given exclusive, behind-the-scenes access as they built it from scratch.

advertisement

About The Open Road

Matt Asay brings a decade of in-the-trenches open-source business and legal experience to The Open Road, with an emphasis on emerging open-source business strategies and opportunities. Matt is chief operating officer at Canonical, the company behind the Ubuntu Linux operating system. Prior to Canonical, Matt was general manager of the Americas division and vice president of business development at Alfresco, an open-source applications company. He is a member of the CNET Blog Network and is not an employee of CNET. Disclosure. You can follow Matt on Twitter @mjasay.

Add this feed to your online news reader

The Open Road topics

advertisement
advertisement

Inside CNET News

Scroll Left Scroll Right