System Update 2013

Chuck Koscher
Director of Technology
ckoscher@crossref.org
Notable changes


Deposits


FundRef

Deposit

stand-alone CrossMark and FundRef data

Include

MathML in article titl...
[root@cr4c ~]# uptime
09:04:20 up 260 days, 14:53,
[root@cr10 ~]# uptime
09:05:02 up 496 days, 16:58
DOI Clicks
365,176,670
Source Articles
(the ones doing the citing)
In the works
 Assigning

Multiple DOIsto books

Problem:

Book deposits from multiple sources had depended on multiple
r...
The Tech Team
2013 CrossRef Annual Meeting System Update Chuck Koscher
2013 CrossRef Annual Meeting System Update Chuck Koscher
2013 CrossRef Annual Meeting System Update Chuck Koscher
2013 CrossRef Annual Meeting System Update Chuck Koscher
2013 CrossRef Annual Meeting System Update Chuck Koscher
2013 CrossRef Annual Meeting System Update Chuck Koscher
2013 CrossRef Annual Meeting System Update Chuck Koscher
2013 CrossRef Annual Meeting System Update Chuck Koscher
2013 CrossRef Annual Meeting System Update Chuck Koscher
2013 CrossRef Annual Meeting System Update Chuck Koscher
2013 CrossRef Annual Meeting System Update Chuck Koscher
2013 CrossRef Annual Meeting System Update Chuck Koscher
Upcoming SlideShare
Loading in …5
×

2013 CrossRef Annual Meeting System Update Chuck Koscher

479
-1

Published on

2013 CrossRef Annual Meeting System Update presentation by Chuck Koscher.

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
479
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • During the past year we’ve continued to make changes and improvement, including high profile initiatives like FundRef. Some are incremental improvements but many of these activities continued to address sustainability and performance issues since this work is never really DONE. I’m coming to believe that there is no light at the end of the tunnel.This year we had 2 or 3 significant events that resulted in temporary performance issues, each of which were overcome and in the end left us with a stronger system.While the rewrite has been completed for over a year, I’d have to say we are now in a phase of redesign. Much of it is happening organically with a few more substantial activities still on the drawing board.
  • FundRef was one of the larger initiatives we worked on this past year, and I should still working on.We’ve made changes to facilitate easier deposits of Crossmark and FundRef dataModified the deposit schema to support MathML, Abstracts, non-CR DOIs and text mining data
  • Overall system availability and performance is good or very good. However, as I mentioned on my opening slide we have had a few problematic episodes lasting days or reoccurring over a few weeks.Most recently due to growth in deposits we found that the basic query function is slowing down at times due to a buildup of alternate spellings for titles and a buildup of deposited title ‘noise’ caused by mistaken deposits of titles and the like.Addressing this will be a top priority immediately after the AMM.
  • These charts show what I mean, as you can see in the charts there a spikes where query performance slows to several seconds/query. This behavior became very pronounced on about October 22nd and has continued since , particularly between 4 and 9AM
  • The one statistic we all should work to improve is the participation rate in cited-by linking . Still under 50% of journal DOIs, and less than 33% of all DOIs are deposited with references. Thisis the count of cited-by links available in CrossRef as of last week
  • Deposit of DOIs with references really drop off going backwards through the 2000’s and flatten out at very low levels even for the 1990’sDeposit of references for backfiles !!
  • For the 12 years I’ve been doing these system updates for you, I’ve almost always stuck to facts and charts which only give a snapshot of the state of affairs. But this year I’d like to high light some of the main reasons for our success
  • While there are certainly a number of people that make CrossRef possible such as in accounting, marketing and those in the UK office, I’d like to take a moment to give credit the US based tech team. These folks mostly toil away in obscurity except when I force them to take the stage for a few minutes like at yesterday’s workshops.
  • Tim Pickard has been with us since August 2002.He’s our jack of all trades: unix system admin, network admin, SW tool master and laptop Mr fixit.
  • Jon Stark has been here since January 2004.He’s one of our software developers and is the guy responsible for all the regular (automated) reports you receive. Jon has also become our query algorithm master and is usually the guy who finds out why some query did not match.
  • Patricia Feeney joined in April 2007She’s our support manager and oversees all support ticket issues, she’s the author of our help documentation and has become the RI for our various XML schemas. Patricia has also served on a number of industry initiatives for NISO and SSP.
  • He joined in September 2009 He is our main system architect and has implemented nearly all of the system infrastructure code.Along with Tim and myself Andrew receives wake up calls at 2AM when some gremlin is causing mischief in the system
  • Vaishali Patel joined us in January 2011.She works for Patricia and is our support desk and triages or answers just about every ticket,
  • Mike Yalter is also a software developer and joined us in August 2012.Mike had taken over development of deposit processing which includes all fundref deposits and registry management.
  • 2013 CrossRef Annual Meeting System Update Chuck Koscher

    1. 1. System Update 2013 Chuck Koscher Director of Technology ckoscher@crossref.org
    2. 2. Notable changes  Deposits  FundRef Deposit stand-alone CrossMark and FundRef data Include MathML in article titles Include abstracts (JATS)    Non-CrossRef DOIs as components Text-mining support (metadata about licenses) Queries   Can query on Orcids Internal  Improved data replication  Hardware upgrades System update 2013
    3. 3. [root@cr4c ~]# uptime 09:04:20 up 260 days, 14:53, [root@cr10 ~]# uptime 09:05:02 up 496 days, 16:58
    4. 4. DOI Clicks
    5. 5. 365,176,670
    6. 6. Source Articles (the ones doing the citing)
    7. 7. In the works  Assigning Multiple DOIsto books Problem: Book deposits from multiple sources had depended on multiple resolution but the participants found the process cumbersome or unworkable Solution: Allow multiple DOIs to be deposited for the same book content from one or more members (different or the same prefix) and make multiple resolution happen by magic behind the scenes.  Allow references to non CrossRef DOIs Problem:DOIs assigned in DataCite to databases may be referenced from journal articles Solution: Allow these DOIs deposited as <citations>. Then allow anyone to perform Cited-By queries on these DOIs. System update 2013
    8. 8. The Tech Team

    ×
http://www.slideshare.net/CrossRef/2013-crossref-annualmeetingsystemupdatechuckkoscher
www.slideshare.net
crawl=CC-MAIN-2016-07
120584
application/http; msgtype=response
sha1:Q75EW32SPRCB4YPZLBZEGBNW74MJXRRY
<urn:uuid:df7d6a01-3b8d-4e2a-9b65-53cbc543307f>
2016-02-13T20:04:36Z
108.174.10.19
sha1:NVM7XO62IL7ZXNZURJ4GHB7EHRLNYFES
<urn:uuid:2ba1016f-d2bb-45cf-905b-2919e0d9b880>
http://www.slideshare.net/CrossRef/2013-crossref-annualmeetingsystemupdatechuckkoscher
length
response
<urn:uuid:21654615-8641-407b-8091-e089130bc5a4>
robots: classic
hostname: ip-10-236-182-209.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2016-07
operator: CommonCrawl Admin
description: Wide crawl of the web for February 2016
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf