Systems

Thom on text retrieval

Lorcan

Thom has a nice piece on text retrieval on ResourceShelf (arranged by Shirley).

To misquote William Gibson, “the future of text retrieval is already here, it’s just not evenly distributed.” High performance searching of large files is benefiting from the continuing exponential drop in computing and storage costs, with clusters of cheap Linux boxes becoming the standard platform for searching. The drop in hardware costs combined with recent advances in caching and computing document rankings, is making the computational cost of searches rapidly approach zero, even for very large collections. [Text retrieval, 2004. ResourceShelf]

Share
Comments
More from LorcanDempsey.net
The technology career ladder
Institutions

The technology career ladder

Library leaders should be drawn from across the organization. Any idea that technology leaders are overly specialised or too distant from general library work is outmoded and counter-productive.
Lorcan 7 min read
icon

Lorcan Dempsey dot Net

The social, cultural and technological contexts of libraries, services and networks

Great! You’ve successfully signed up.

Welcome back! You've successfully signed in.

You've successfully subscribed to LorcanDempsey.net.

Success! Check your email for magic link to sign-in.

Success! Your billing info has been updated.

Your billing was not updated.
https://www.lorcandempsey.net/thom-on-text-retrieval/
www.lorcandempsey.net
CC-MAIN-2024-10
71598
application/http; msgtype=response
sha1:EKVX2TUSMY6AHK252SEPPGAB2MNSYIP4
<urn:uuid:6c6d4a2f-7b06-4c0f-aebd-ec95fd4674a0>
2024-02-26T00:18:04Z
146.75.35.7
text/html
sha1:OWLFIFZUX3LOJDWQ4Q4GYGGSXYVENJRE
<urn:uuid:188b2d18-94ac-4078-80b1-1368ebe73728>
https://www.lorcandempsey.net/thom-on-text-retrieval/
response
<urn:uuid:2f465c79-0012-4409-a599-80dc7f525729>
isPartOf: CC-MAIN-2024-10
publisher: Common Crawl
description: Wide crawl of the web for February/March 2024
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-79
software: Apache Nutch 1.19 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.5-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/