16

Today (2013-12-11), in 3-4 occasions, regulars in chat rooms expressed their concerns that users do not know how to use the site. Is not surprising considering that our eternal September hasn't ended yet, and senior members on AU aren't enough for the amount of new users that reach us. My previous proposal was more or less left without further discussion with +5/-3 votes and an answer of Eliah, so I would want to bring this up again.

Do we need already the reviews audits?

Reasons (?):

  • We are over Super User amount of questions per day, and SU has it.
  • We are more popular (aka hits) than all but 2 SE sites.
  • Our general question quality is bad.
  • The quality of the answers is somewhat bad too.
  • The amount of (bad) questions are almost reaching the amount of answers.
  • We get a better Ask Ubuntu, and we could be more alert when reviewing stuff
  • This has been pointed out already several times, even Moderators
  • reasons...

Cons:

  • Users will ask why they failed a review audit
  • Any other?
  • 1
    why are "We get a better (?) Ask Ubuntu" and "Users will ask why they failed a review audit" cons? – Flyk Dec 12 '13 at 11:25
  • @kalina because reasons – Braiam Dec 12 '13 at 11:52
  • All the questions linked seem to have been resolved? AFAICT that's what we use the chat room for no? – Jorge Castro Dec 12 '13 at 14:49
  • @JorgeCastro yeah, that was the one that we catch. But what about the ones that miss completely our radar? Problems that happens everywhere in the site. We need as many eyes on the site as possible, and I think the audits is a nice addition to check if the reviewers are doing things right too. I swear I'm learning DB to gather proof. – Braiam Dec 12 '13 at 15:26
  • One thing you can do is start writing data.se queries for things so that we can start actioning on them. – Jorge Castro Dec 12 '13 at 17:34
  • @JorgeCastro I would love to know where the problem is so I can generate the data, but if I can't trust reviewers are doing their stuff right, then no matter what actions I take if my sources are poisoned with bad data. – Braiam Dec 12 '13 at 18:22
  • I've brought this up before, perhaps merge? meta.askubuntu.com/questions/7234/… – Jorge Castro Dec 12 '13 at 19:30
  • 1
    Could you explain what you actually mean by "review audits." None of the linked questions explain this. Are you proposing that moderators do some kind of manual auditing of past reviews or some kind of automated process? You mentioned that this is something other sites have. Do you mean the "honeypot" review items that catch people approving junk? – andrewsomething Dec 13 '13 at 3:33
  • @andrewsomething The last thing you mentioned. meta.stackexchange.com/q/157121/213575 – Braiam Dec 13 '13 at 11:45
  • yes, because of robo reviewers. – Mateo Feb 19 '14 at 21:03
9

I've turned these on. I've also enabled automatic review bans to assist Oli's efforts here - we'll be keeping a sharp eye on how these play out in practice, since they may need some tweaking.

Remember: review audits are meant to be helpful, a tool for teaching new reviewers what is expected and maybe staving off fatigue in experienced reviewers.

  • 1
    Thank you so much. – Seth Feb 20 '14 at 16:41
  • Where do you expect reports about experience with the audits? – guntbert Feb 22 '14 at 23:28
  • 2
    Post them here on meta, @guntbert - tags support, review, audits – Shog9 Feb 23 '14 at 2:45
9

Here's an example of some problems, this is just a sampling from the first page of the review queue:

enter image description here

Now, if people are inexperienced reviewers or just suck at reviews, then that's okay I guess. New people learn and all that.

The problem is that most times "New Posts" is either 0 or single digits, if whoever clears out that queue and says "ubuntu 13.10 freeze" is okay then it just goes through, I never even get a chance to see it in my queue to fix it!

  • Yes, those are (some of) the problems I want to tackle with this solution. If we bring the hammer down to make reviewers actually do reviews will be the best. Remember that it doesn't matter if it has a good title, if the content sucks, too. – Braiam Dec 12 '13 at 19:30
  • 1
    BTW, they are live ;) – Braiam Feb 21 '14 at 2:15

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .