Difference between revisions of "FITS (File Information Tool Set)"

From COPTR
Jump to: navigation, search
(Development Activity: Release Feed)
Line 14: Line 14:
  
 
= Description =
 
= Description =
[http://fitstool.org FITS] allows data curators to identify, validate, and extract technical metadata for the objects in their digital repository. It does this by encorporating a range of mostly third-party open source tools, normalising and consolidating their output.
+
The File Information Tool Set ([http://fitstool.org FITS]) identifies, validates and extracts technical metadata for a wide range of file formats. It acts as a wrapper, invoking and managing the output from several other open source tools. Output from these tools are converted into a common format, compared to one another and consolidated into a single XML output file.
 
   
 
   
 
=== Provider ===
 
=== Provider ===
Line 20: Line 20:
  
 
=== Platform and interoperability ===
 
=== Platform and interoperability ===
FITS is written in Java and is compatible with Java 1.6 or higher.  
+
FITS is written in Java and is compatible with Java 1.7 or higher.  
It uses six external tools:  
+
The tools used in version 1.3.0 of FITS are:  
* [[JHOVE (Harvard Object Validation Environment)| JHOVE]]
+
* [[ADL Tool]]
* [[ExifTool]]
+
* [[Apache Tika]]
* [[Metadata Extraction Tool]]
+
 
* [[DROID_(Digital_Record_Object_Identification)|DROID]]
 
* [[DROID_(Digital_Record_Object_Identification)|DROID]]
* [http://web.archive.org/web/20061106114156/http://schmidt.devlib.org/ffident/index.html FFIdent]
+
* [[Exiftool]]
* [http://unixhelp.ed.ac.uk/CGI/man-cgi?file File Utility]
+
* [http://web.archive.org/web/20061106114156/http://schmidt.devlib.org/ffident/index.html FFIdent] (no longer maintained)
 +
* [[http://unixhelp.ed.ac.uk/CGI/man-cgi?file File Utility] (windows port)
 +
* [[JHOVE (Harvard Object Validation Environment)| JHOVE]]
 +
* [MediaInfo]
 +
* [[Metadata Extraction Tool] National Library of New Zealand Metadata Extractor]
 +
* [OIS Audio Information]
 +
* [OIS File Information]
 +
* [OIS XML Information]
  
A few Harvard Library-created tools; and many open source libraries.
 
 
Instructions for command line use are given for Windows and Unix.
 
Instructions for command line use are given for Windows and Unix.
 
   
 
   
Line 37: Line 42:
 
=== Documentation and user support ===
 
=== Documentation and user support ===
 
Documentation exists in the form of a user manual and more technical developer manual.  
 
Documentation exists in the form of a user manual and more technical developer manual.  
The project actively uses the fits-users google group has 30 members, and is active as of January 2012.  
+
The project actively uses the fits-users google group has 78 (Sept. 24, 2018) members, and is active as of January 2012.  
 
The FITS web site links to a [https://github.com/harvard-lts/fits github site] that includes the source code and an issues tracker.
 
The FITS web site links to a [https://github.com/harvard-lts/fits github site] that includes the source code and an issues tracker.
 
   
 
   
 
=== Usability ===
 
=== Usability ===
FITS uses a command line interface; it is designed to be integrated into other software workflows, and so is aimed at those with application design experience.
+
FITS uses a command line interface; it is designed to be integrated into other software workflows, and so is aimed at those with application design experience. In January 2016, version 1.0.0 of the FITS [https://projects.iq.harvard.edu/fits/downloads#fits-servlet web service] was released, giving the ability to deploy FITS as a service.
 
   
 
   
 
=== Expertise required ===
 
=== Expertise required ===
Line 55: Line 60:
 
= User Experiences =
 
= User Experiences =
 
<!-- Add hotlinks to user experiences with the tool (eg. blog posts). These should illustrate the effectiveness (or otherwise) of the tool. Use a bullet list. -->
 
<!-- Add hotlinks to user experiences with the tool (eg. blog posts). These should illustrate the effectiveness (or otherwise) of the tool. Use a bullet list. -->
 +
* '''National Archives of the Netherlands:'''
 +
** How [http://openpreservation.org/blog/2017/05/17/preservation-impact-assessments-how-preservation-tools-support-naneths-connection-projects/ FITS] supports pre-ingest impact assessments at the National Archives of the Netherlands.
 
* '''DNB (German National Library):'''
 
* '''DNB (German National Library):'''
 
** FITS v0.6.1 with modified [[JHOVE (Harvard Object Validation Environment)| Jhove 1.11]], Gentoo Linux, Java-Environment, Tomcat-Application Server
 
** FITS v0.6.1 with modified [[JHOVE (Harvard Object Validation Environment)| Jhove 1.11]], Gentoo Linux, Java-Environment, Tomcat-Application Server

Revision as of 15:50, 24 September 2018


FITS allows data curators to identify, validate, and extract technical metadata for the objects in their digital repository.
Homepage:http://fitstool.org
License:GNU Lesser General Public License
Platforms:Windows or Unix

Contents

Description

The File Information Tool Set (FITS) identifies, validates and extracts technical metadata for a wide range of file formats. It acts as a wrapper, invoking and managing the output from several other open source tools. Output from these tools are converted into a common format, compared to one another and consolidated into a single XML output file.

Provider

Harvard Library

Platform and interoperability

FITS is written in Java and is compatible with Java 1.7 or higher. The tools used in version 1.3.0 of FITS are:

Instructions for command line use are given for Windows and Unix.

Functional notes

FITS acts as a wrapper, invoking and managing the output from several other open source tools. Output from these tools are converted into a common format, compared to one another and consolidated into a single XML output file. Technical metadata is only output (and a part of the consolidation process) for tools that were able to identify the file. All other output is discarded.

Documentation and user support

Documentation exists in the form of a user manual and more technical developer manual. The project actively uses the fits-users google group has 78 (Sept. 24, 2018) members, and is active as of January 2012. The FITS web site links to a github site that includes the source code and an issues tracker.

Usability

FITS uses a command line interface; it is designed to be integrated into other software workflows, and so is aimed at those with application design experience. In January 2016, version 1.0.0 of the FITS web service was released, giving the ability to deploy FITS as a service.

Expertise required

Installation and configuration require deep systems administration and application design knowledge, as well as familiarity with file format and metadata standards.

Standards compliance

FITS outputs in XML format. A detailed description of the FITS-XML can be found here and an analysis of the output data here.

Influence and take-up

The FITS website shows over 2000 downloads of the software. The tool was designed for and is in use at the Harvard Library Digital Repository Service.

User Experiences

  • National Archives of the Netherlands:
    • How FITS supports pre-ingest impact assessments at the National Archives of the Netherlands.
  • DNB (German National Library):
    • FITS v0.6.1 with modified Jhove 1.11, Gentoo Linux, Java-Environment, Tomcat-Application Server
    • Since the end of 2012, DNB uses the FITS library as a part of its risk management within the automated ingest process. At present more than 1500 files are daily examined by FITS.
      • The purpose of the risk management and its implementation with metadata tools like FITS or JHOVE is to facilitate automatic technical quality checking (bitstream integrity and validation) of each digital publications. Furthermore, the analysis is aimed at recognising technical restrictions such as DRM at an early stage, which hinder or even prevent the task of long-term preservation and use of the digital objects.
      • The extracted technical metadata (the FITS output) are used further for future long-term preservation measures such as format migration and are stored and managed in the metadata management of the long-term archive of the DNB. The capture of these metadata is essential in order to execute targeted migration measures of files in endangered formats.
      • FITS also offers significant benefit in the form of easily configurable standardisation of the different tool outputs into the FITS format using XSLT. The DNB has used this function to adapt the FITS output to its own requirements, e.g. incorporating other metadata elements not included in the FITS distribution into the standardisation.
      • A further adjustment, which the DNB has made, is the integration of a DNB tool to analyse files in ePub format.

Development Activity

FITS 0.2.0 was first released as open source in July 2009. As of April 2014 the latest release was version 0.8, released in January 2014. The tool was created to be used in Harvard's Digital Repository Service, and development is active and ongoing.

All development activity is visible on GitHub: http://github.com/harvard-lts/fits/commits


Release Feed

Below the last 3 release feeds: Failed to load RSS feed from https://github.com/harvard-lts/fits/releases.atom: Error fetching URL: error:1407742E:SSL routines:SSL23_GET_SERVER_HELLO:tlsv1 alert protocol version


Activity Feed

Below the last 5 commits: Failed to load RSS feed from https://github.com/harvard-lts/fits/commits/master.atom: Error fetching URL: error:1407742E:SSL routines:SSL23_GET_SERVER_HELLO:tlsv1 alert protocol version


Contributors

Rvveenendaal (14.2%), Shein (21.0%), Yfriese (9.6%), Chlara (13.1%), Prwheatley (2.9%), Andrea Goethals (11.3%), COPTR Bot (27.8%)
https://coptr.digipres.org/index.php?title=FITS_(File_Information_Tool_Set)&diff=prev&oldid=3431
coptr.digipres.org
crawl=CC-MAIN-2020-24
43411
application/http; msgtype=response
sha1:GYI6F6KZUIJTSGF2LGRJBD4RPRUXXQMP
<urn:uuid:7cfa272b-9687-4cd6-ad82-73b0217056b2>
2020-06-02T00:57:26Z
172.104.134.96
text/html
sha1:7VHCJ57RBA5G4UVFV36M35MXZPXTEVXL
<urn:uuid:8a641c43-041e-4b0d-8d32-e484526f2c26>
https://coptr.digipres.org/index.php?title=FITS_(File_Information_Tool_Set)&diff=prev&oldid=3431
response
<urn:uuid:2fbf70a8-05bb-460c-baf8-bddfc5389180>
isPartOf: CC-MAIN-2020-24
publisher: Common Crawl
description: Wide crawl of the web for May/June 2020
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-62.ec2.internal
software: Apache Nutch 1.16 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.1-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: http://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/