Sadly our attempts to better coordinate community reviews did not lead to the desired effect to make our close reasons more consistent. Still robo-reviews lead to close reasons that have nothing to do with the affected question. But a consistent community moderation is vital to the site. Especially new user will not understand such an inconsistent voting pattern, and they will also not learn much from a wrong close reason without any further comments.
We observed that some reviewers are affected more than others but we do not want to put anybody on the pillory. Besides, we would also not have the time, will, and resources to maintain a list of people who frequently did not pay enough attention when moderating.
As community review is a vital contribution to the site too, we do not want anybody to stop reviewing. We also understand that sometimes a close reason may not be so clear-cut. This is not what this is about. We are talking about severe or clear-cut cases only.
As a measure to make community moderation better, we decided that we will issue short term review ban for single clear-cut bad reviews, in particular close reasons that do not apply to the question at all (even if the closure is undisputed). To reduce the damage for false positives, we will keep such bans short, starting with 1 day and slowly escalating over 3 to 7 to 14 to 30 days in repeated cases. We will start one week after posting this.
We do hope that this will help that reviewers will just spend this one second more time on reviewing when selecting a close reason or making other community-moderation decisions. Reviewers who were accidentally affected or affected for the first time should not worry too much as the ban will cease quickly – they may not even notice. A review ban will not affect overall site reputation nor will it be displayed anywhere accessible to the public.