UCL logo

UCL Discovery

UCL home » Library Services » Electronic resources » UCL Discovery

Soft peer review: social software and distributed scientific evaluation

Taraborelli, D. (2008) Soft peer review: social software and distributed scientific evaluation. In: Hassanaly, P. and Ramrajsingh, A. and Randall, D. and Salembier, P. and Tixier, M., (eds.) Proceedings of the 8th International Conference on the Design of Cooperative Systems, Carry-le-Rouet, 20-23 May 2008. (pp. pp. 99-110). Institut d'Etudes Politiques d'Aix-en-Provence: Aix-en-Provence, France.

An open access version is available from UCL Discovery

[img]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
83Kb

Abstract

The debate on the prospects of peer-review in the Internet age and the increasing criticism leveled against the dominant role of impact factor indicators are calling for new measurable criteria to assess scientific quality. Usage-based metrics offer a new avenue to scientific quality assessment but face the same risks as first generation search engines that used unreliable metrics (such as raw traffic data) to estimate content quality. In this article I analyze the contribution that social bookmarking systems can provide to the problem of usage-based metrics for scientific evaluation. I suggest that collaboratively aggregated metadata may help fill the gap between traditional citation-based criteria and raw usage factors. I submit that bottom-up, distributed evaluation models such as those afforded by social bookmarking will challenge more traditional quality assessment models in terms of coverage, efficiency and scalability. Services aggregating user-related quality indicators for online scientific content will come to occupy a key function in the scholarly communication system.

Type:Proceedings paper
Title:Soft peer review: social software and distributed scientific evaluation
Open access status:An open access version is available from UCL Discovery
Publisher version:http://coop.wineme.fb5.uni-siegen.de/?id=coop2008
Language:English
Keywords:Peer review, rating, impact factor, citation analysis, usage factors, scholarly publishing, social bookmarking, collaborative annotation, online reference managers, social software, web 2.0, tagging, folksonomy

View download statistics for this item

Archive Staff Only: edit this record
http://eprints.ucl.ac.uk/8279/
eprints.ucl.ac.uk
crawl=CC-MAIN-2013-20
33000
application/http; msgtype=response
sha1:G7KEYCZJWX72NV7OTMLEN4GVL67S7AKN
<urn:uuid:7064d2a0-5634-46f7-adbb-ec2ce3a8d3d2>
2013-05-24T05:43:14Z
128.40.177.130
sha1:KUTD4ZUOBQOVQ26RYVC6NHPDGYSGJ6LK
<urn:uuid:1e10c89a-5f6d-4dc5-8c0c-27f9526582cc>
http://eprints.ucl.ac.uk/8279/
response
<urn:uuid:599d7e86-5df4-47fa-ab71-0c5c1b3746cb>
robots: classic
hostname: ip-10-60-113-184.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2013-20
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for Spring 2013
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf