Home > ResourceBlog > Article

« All ResourceBlog Articles

 

Bookmark and Share   Feed

Wednesday, 16th May 2007

Let's Talk Metasearch, Federated Search, or Universal Search

With all of the talk about Google's Universal Search initiative announced today, we think it's important to take a look at what's currently out there and where things are going. Of course, Search Engine Land has more and focuses on the fact that Google will be blending results from disparate databases into one results list -- the main results list (aka organic results).

The big issue we see here is searcher behavior. In other words, many good, relevant and useful results can be found on the web. Now, more content will be attempting to get into these results on Google. In other words, every good result can't be in the top 5 or top 10 where the typical searcher looks. It will be interesting from a searcher perspective (the ResourceShelf perspective) if gaming of the results becomes even more ferocious. In terms of what Google is doing, the query will trigger material from disparate data sources. It will be interesting to watch.

For many years, ResourceShelf has been talking about metasearch or, as some call it, federated search, single interface, or cross-database searching. In a nutshell, we're talking about one search that will query multiple databases in a single query, dedupe results, sort (as desired by the end user; most likely by relevance), and offer post processing options. Perhaps the most important issue is database selection help; with technology coming online, that can be made easier. This is key because, in truth, most users just want results and care little where they are coming from. Resource selection can be and should be a key role for the info professional.

All of this makes sense in our opinion. Why? If done properly, universal search/metasearch can save the end user/searcher time, effort and aggravation. If -- and this is a big if -- it's done correctly. If it's done incorrectly, you've created a mess.

The concept of querying multiple database (often from different providers vs. from a single database owner) itself is hardly new. What is new is the technology, which continues to get better both in terms of speed and relevance. Those of you who have been involved in web search for many years will remember tools like Copernic that searched disparate databases with a single query.

Of course, those of you who have been online since the pre-web era (e.g., back to 1972) know that database "supermarkets" like Dialog offers a common query language that can allows the searching of numerous databases -- of the hundreds in the Dialog catalog -- simultaneously. Of course, searching ALL of them at one time is probably not in the best interest (in terms of time, money, and effort) of the searcher. Dialog also has "pre-built"
collections/groups named OneSearch.

Fast Fact: NISO has had a Metasearch Initiative since 2003.

At the end of 2005, Gary, while still working at Search Engine Watch, posted an article on the importance (if done right) of metasearching.

These days, many libraries offer metasearch/federated search resources from a variety of providers like MuseGlobal, FretWell-Downing/OCLC, Autographics, and WebFeat. For example, the San Francisco Public Library offers a meta search tool to search multiple disparate databases with a single query. As noted above, many of these tools offer one results list but, if needed, allow the end user to sort by one of several criteria.

Specifically, Web Search
Well, when it comes to web search -- the single search box and adding value added info -- many have been doing this for years.

Clusty
Using Vivisimo's technology, Clusty gathers results and then dynamically generates clusters. Another search tool that pulls results from many databases is Bio-Meta Cluster.

AOL
AOL has offered Full-View since October 2006 -- e.g., results from various databases in the right rail. However, when we looked a few minutes ago, several of the full view examples are no longer available. Now, you see either AOL OneBox at the top of the page or links to specific verticals near the top of the results page. Here's the AOL Full View example page showing what is/was? available.

Yahoo
First, the new Yahoo OneSearch for Mobile (single box) and even longer if you toss in "shortcuts" when applicable on web results pages (top of the page). Note the visitors guide here and the local listings here.

This service is based on AltaVista's shortcuts, the first service to offer this feature. It came online in 2002.

Microsoft
MS Live has offered results from disparate services for a couple of years. In some cases, it offers direct links to actual answers. Top of the page.
Example #1
Example #2

Google
Of course, Google has offered OneBoxes for a couple of years. These boxes, found at the top of a results page, might include news headlines, movie times, stock prices, and other info.
+ Example #1
+ Example #2
+ Example #3

Ask.com*
Ask.com offers a number of Smart Answers with results coming from both internal and external sources. Some offer real time info, other actual answers, and others pre-built links to key sources and databases. Found at the top of a results page. Examples:
+ Real Time
+ Actual Answer (via IMDB)
+ Smart Answer #1 (Note the disambiguation options)
+ Smart Answer #2
Note the list of sources.

AskX, the Ask.com prototype, offers many types of disparate sources on a single results page. Here the results are placed both at the top of the page and in the right rail.

++ Example 1 (Chicago, IL)
Note the variety of sources at the top of the page and along the right rail. Suggestions are now found on the left rail.
++ Example 2 (No Doubt)
Note the images, shopping, reference material, videos, etc. BTW, click on the magnifying glass that will appear next to each database (on the right side); this allows you tp run a new search of that database without having to go to a new interface.

Others
Of course, hundreds of other metasearch database that focus on a specific type of info have been online for years. They include:

+ SearchforVideo.com and PureVideo
+ Topix (News)
+ Indeed.com and SimplyHired (Jobs)
+ FareCast and Kayak (Travel)
+ mPire and Become.com (Shopping)

* Gary is Director of Online Information Resources at Ask.com

UPDATE: On another note, companies like Metacarta have been working to make maps "text" searchable for several years. The company currently offers a free trial of its GeoIntel for Petroleum. Search historians might also remember the Northern Light, Vicinity product; that was seven long years ago.

UPDATE: Chris Sherman Writes: Google's Promising, But Yahoo's Doing, Cross Language Information Retrieval (via SEL)


Category:

Views: 3105

   




« All ResourceBlog Articles

 

FreePint

FreePint supports the value of information in the enterprise. Read more »


FeedLatest FreePint Articles:


  • Click to view the article Big Data In Action: Epilogue
    Wednesday, 19th June 2013

    The FreePint Series: Big Data in Action wrapped up with a global webinar. Victor Camlek reviews the highlights of the webinar, recent interviews with key big data experts Attunity, Connotate, Linguamatics and Opera Solutions, and offers a final view of the Series.

  • Click to view the article Mobile Deployment: Which Challenges for Content Vendors?
    Wednesday, 19th June 2013

    Content vendors and publishers are facing a raft of challenges as they face increasing pressure to deliver content to a wide variety mobile devices - and in a way that's engaging and entertaining as well as informative, easy-to-use and optimised for mobile workflow. Robin Neidorf reports on recent discussions in FreePint's Community of Practice: Mobile Deployment in the Enterprise which delved into the challenges of build, buy or partner and development platforms.

  • Click to view the article Information Professionals Recharge at AIIP in Denver
    Wednesday, 19th June 2013

    Jan Knight spotlights some of the best sessions from the recent AIIP (Association of Independent Information Professionals) Conference, an annual event which brings together speakers and delegates interested in the unique business development and marketing needs of independent information pros. The highlights range from social capital to socialisation (tips for better small talk skills) and a provocative talk on the Power of the Unpopular. Other practical tips were gained on primary research skills, using newsletters for sales generation, creating superior websites and improving negotiation skills. 

  • ... more ...

All Family Articles »
Family Articles by Category »


A FreePint Subscription delivers articles and reports that support your organisation's information practice, content and strategy.

Start the conversation about a subscription by
completing our online form: "How can FreePint help?"


FreePint Testimonials

" FreePint has been an excellent resource to both myself and colleagues for furthering insight, bringing together snapshots of easily digestible ..."

Read more testimonials and supply yours »






 

 
 
 

Register

Register to receive the free ResourceShelf Newsletter, featuring highlighted posts.

Find out more »

ResourceShelf sponsored by:

Article Categories

All Article Categories »

Archive

All Archives »
http://web.resourceshelf.com/go/resourceblog/46722
web.resourceshelf.com
crawl=CC-MAIN-2013-20
33653
application/http; msgtype=response
sha1:Z27KTQXGGR6JCIHCSMOKAPNWWPDVQTAH
<urn:uuid:78fb9af7-7c63-4299-ae85-e64b9eddffd3>
2013-06-19T20:16:23Z
176.56.58.22
sha1:AIDBVLNCSX4N6PDBIOANDSO56OVGDOTD
<urn:uuid:d86cf600-ca64-49b4-b9b8-2770c8f7423d>
http://web.resourceshelf.com/go/resourceblog/46722
response
<urn:uuid:32fa8cf2-37c8-4cfa-b459-a44d0ddbb87b>
robots: classic
hostname: ip-10-60-113-184.ec2.internal
software: Nutch 1.6 (CC)/CC WarcExport 1.0
isPartOf: CC-MAIN-2013-20
operator: CommonCrawl Admin
description: Wide crawl of the web with URLs provided by Blekko for Spring 2013
publisher: CommonCrawl
format: WARC File Format 1.0
conformsTo: http://bibnum.bnf.fr/WARC/WARC_ISO_28500_version1_latestdraft.pdf