points by dang 11 years ago

It's based on comment scores only. My sense is that it's an irrelevant distraction and we should get rid of it.

For example, we caught a bunch of users who were gaming it by deleting any comments that brought their average down. We fixed that by treating deleted comments as comments of score 0 for average-computing purposes. It's an example of how, once you publish a metric, people start to care about it and do things based on it, regardless of how meaningful it is.

Comment average used to be used by a few algorithms (like comment ranking) but we turned that off as an experiment a while ago and nothing seemed to get worse. If anything, I think it may have helped a little.

tptacek 11 years ago

Get rid of it!

The coup de grace would be to figure out how to do away with karma altogether. If you will it, it is no dream.

brudgers 11 years ago

Even if it's not being used algorithmically, it may still be useful as a form of gamification. I mean, people deleting their poorer comments is probably a good thing - particularly when it doesn't effect the placement of their comments on the page.

Developing a willingness to delete my less productive comments was a big step toward improving my skill at self editing. Since average is not being used algorithmically, it's hard to see an advantage in penalizing self-editing.

  • dang 11 years ago

    Learning self-editing is great, of course, and you could still do that without a published comment average.

    I think optimizing comments for upvotes is a bad idea. You should optimize for saying substantive things.

    • brudgers 11 years ago

      Sure I agree.

      My sense is that Karma may correlate with what is substantial and awareness of its trends may correlate with awareness of one's own patterns. That awareness can produce, as you observed, heightened self editing.

      Now perhaps we disagree that more self editing is or is not a good thing or whether it outweighs the negative effects of deleted comments. Personally, I think more comments could stand self deletion and have observed few instances where a deleted comment has had much impact on an important discussion.

    • eevilspock 11 years ago

      I totally agree. But what you say does not jive with what the system encourages.