The community and the game…
So I recently read an interesting blog entry by a power user at stackoverflow.com. If you are not familiar with it, stackoverflow is a website designed to help people with programming questions. People submit questions and othe users submit answers where the answers get voted on and, supposedly, the best answer rises to the top. Each use has a certain “reputation” score that they improve by giving good answers. Actually, they improve it by getting more votes.
Stackoverflow isn’t terribly unique, reddit.com and digg.com are both examples of websites that give users a score for how well they perform. Instead of relying on moderators like many on line communities, these websites use algorithms and input from the community to determine how well a user is doing. Many times users get extra priveliges or status for having done well.
Like any system though with well defined rules it has become a game to many users to literally game the system. The administrators can control the algorithms behind calculating a users score but they can’t control the input provided by the community and this is where some users find sport. One learns the algorithm, learns the “personality” of the community, and then manipulates the community to improve their score.
This isn’t entirely bad. Most of the algorithms on these websites are designed well enough that even behavior associated with “gaming” the system is not completely negative. Neither is it typically good though. Instead of encouraging growth or improvement there is more of a race to the mean which can often drown out the few truely altruistic users that are trying to help make the place better.
Which brings me back to the original paragraph and the stackoverflow power user… His blog entry was entirely about how to game the system and get as many reputation points as possible. Remembering that the purpose of stackoverflow is to answer programming questions, he would submit valid answers but would manipulate the timing of his submission, the formating, and questions that he answered so as to maximize his score.
These users are not doing anything wrong, they are just playing the game the that the site programmers created. But this leads me to some questions I have been asking myself lately. Can we create a framework that encourages an open egalitarian online community to grow and work towards a semi-common goal?
The problem, I think, is to much carrot and not enough stick. In the past, way back in the day, you get the idea, most online communities had moderators. These moderators had the job of banning the accounts of people who missbehaved too much and more often simply acting as a threat. This is terribly labor intensive, unreliable, and subject to the whims of the person moderating. A good moderator can create a great community, but he can quit or get bored.
Partly in response to this and the growing popularity of crowd-sourcing websites have starting allowing users to moderate. YouTube is an example of this, users can now vote on comments and theoretically the best comments rise to the top. It is a great idea, no longer is simply being the first to post enough, your comment has to appeal to other users to be seen. Unfortunately what usually rises to the top is some kind of humor, not discussion. Again, the system is doing its job, humor rarely offends enough to be down voted, is quick to “consume”, and makes the viewer happy. Having such comments rise to the top does maximize enjoyment.
Fortunately or unfortunately thats what most voting systems do, they maximize enjoyment. And, since most voting systems are binary, they maximize quantity of enjoyment, not quality. That is true of simple systems, but even more complex ones like reddit or stackoverflow fall prey to the same effect. These more complex systems use the voting to create a carrot of sorts by allowing user’s to accumulate points.
The carrot helps, but I believe that we need a return to the stick. Part of the problem is that these are profit making websites (or at least they are trying to be) and can’t afford to turn away users. So, I am proposing several ideas:
- Your ability to participate in the community is directly related to the communities acceptance of you.
- While a public score is hard to avoid, tie the user’s return from the site to their score. Do this in a continuous fashion, with diminishing returns as scores get higher.
- As a corollary to #2, make sure users who participate in the site get some kind of return on their investment. And, make sure that return is more then just “status in the community”.
- Give users the opportunity to provide more then just a yes/no input into the system.
1, 2, and 3 are really all related and can probably be summerized better but in the end they represent something unique, I think.