Mod Panel, Staff, Moderating Reviews

Discussion in 'News & Announcements' started by ChrisTurk, Oct 30, 2017.

  1. ChrisTurk

    ChrisTurk Administrator

    Messages:
    39,948
    Ratings:
    +99,650
    Mod Panel
    Its finally done & functions. Oh yeah baby, we've been fully wild wild west out there until now LOL. It has some cool features, right now it'll display:
    • Flagged reviews (duh) - which can be handled right in the mod panel. Either skip_calc'd (which means the review will still show up on the website, but its scores will not calculate for/against a Requester) or hidden (which means its been "soft deleted" more or less, currently only one review has been hidden).
    • Shows a list of recent reviews where flags like rejected, blocked, etc which will hopefully curb people just bomb'ing requesters blatantly without oversight.
    • Pulls reviews with weird/possibly inaccurate wage reports
    • Looks for reviews with Requester IDs that don't look valid (in case of booboos on copy/pastes haha
    Staff
    Of course.. none of the above is any good w/o folks checking on it (and letting me know what can be improved on it). As of now, the current @Moderator team from here on TH has full access to the panel, but I'm interested in grabbing more folks. Since this is largely a non-social / no-interaction role I'm very interested in anyone interested in contributing to data quality on the site. Preferably higher-level / experienced turkers who can spot likely low quality / unhelpful reviews.

    Shoot me a DM (or your favorite coloquial term) if you've got any interest in helping out.

    Moderating Reviews
    This currently isn't possible, but I'm curious what people think about mods being able to edit reviews, so long as the review is clearly marked as moderated.

    Mostly I'm considering it because of things like survey content, as a middle ground between wild west "whatever goes" reviews & hiding them completely (which kinda sucks to do).

    I also want information on TV to be accurate, but I don't want to be manually fiddling in people's stuff. Which means right now I'm more apt to just mark reviews as non-calculated if they aren't updated (in the case of mass rejections being overturned, for example) and leaving them be over manually changing them to be unrejected/etc.

    One thing I'm going to really push/reinforce is that reviews should be for the benefit of your fellow worker, not ones blood pressure. And by that I mean the kind of reviews that are just hatred fueled tirades against a rejection/low pay are not the kind of content that'll ever "stick" on TV. The hordes are likely coming, and as of right now TurkerView is actually incredibly helpful to me. Which I hope means its useful to other folks as well (despite it not yet being available on scrapers) because I haven't used TO in ages and I actually use TV lol.

    Anyway, just wondering if anyone has opinions on review moderation. The good, bad, ugly, etc etc.
     
    • Like Like x 3
    • Love Love x 1
  2. BooBooKitty

    BooBooKitty New Turker

    Messages:
    4
    Gender:
    Female
    Ratings:
    +1
    Not sure if I like reviews being edited. I would like if rude and not helpful comments could be marked and then hidden or deleted.
     
    • Like Like x 1
  3. th6378045

    th6378045 Well-Known Turker

    Messages:
    3,543
    Gender:
    Female
    Ratings:
    +2,522
    I like what @BooBooKitty suggested. A comment could show as "hidden by moderator" or something rather than editting its content. Whoever wants to read it can click on "read anyway" or something similar.
     
  4. NBadger

    NBadger Mod of Cat-Gifs

    Messages:
    13,886
    Gender:
    Female
    Ratings:
    +38,319
    I got so excited bc I thought CT had finally fixed the nightmare that is moderating reviews, but alas, this thread is a year old :p
    From a personal stand point I agree that rude reviews should just be hidden, as is currently done, but a lot of times I find myself hiding an entire review that has good information just because it mentions some kind of survey content, so I can see the argument for allowing specific edits.
     
    • LOL LOL x 2
    Last edited by a moderator: Nov 16, 2018
https://forum.turkerview.com/threads/mod-panel-staff-moderating-reviews.834/
forum.turkerview.com
crawl=CC-MAIN-2019-30
69455
application/http; msgtype=response
sha1:2SGQZTS7UZVY42GSSIQFG35ZHCFUUAS2
<urn:uuid:d086ae9b-4ee3-459e-9a36-2c293e0671e2>
2019-07-15T18:09:23Z
192.241.145.105
text/html
sha1:JJ6ANX3VFO7EBREE5DNOPSXWYKLQDLWJ
<urn:uuid:193118c0-8d4f-4927-814c-6a0755a8580b>
https://forum.turkerview.com/threads/mod-panel-staff-moderating-reviews.834/
response
<urn:uuid:24820db5-eadb-4001-9208-d241e4b92950>
isPartOf: CC-MAIN-2019-30
publisher: Common Crawl
description: Wide crawl of the web for July 2019
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-141-32-141.ec2.internal
software: Apache Nutch 1.15 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.1-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/