Information retrieval

From Academic Kids

Information retrieval (IR) is the art and science of searching for information in documents, searching for documents themselves, searching for metadata which describes documents, or searching within databases, whether relational stand alone databases or hypertext networked databases such as the Internet or intranets, for text, sound, images or data. There is a common confusion, however, between data retrieval, document retrieval, information retrieval, and text retrieval, and each of these have their own bodies of literature, theory, praxis and technologies.

IR is a broad interdisciplinary field, that draws on many other disciplines. Indeed, because it is so broad, it is normally poorly understood, being approached typically from only one perspective or another. It stands at the junction of many established fields, and draws upon cognitive psychology, information architecture, information design, human information behaviour, linguistics, semiotics, information science, computer science and librarianship.

Automated information retrieval (IR) systems were originally used to manage information explosion in scientific literature in the last few decades. Many universities and public libraries use IR systems to provide access to books, journals, and other documents. IR systems are often related to object and query. Queries are formal statements of information needs that are put to an IR system by the user. An object is an entity which keeps or stores information in a database. User queries are matched to documents stored in a database. A document is, therefore, a data object. Often the documents themselves are not kept or stored directly in the IR system, but are instead represented in the system by document surrogates.

In 1992 the Department of Defense, along with the National Institute of Standards and Technology (NIST), cosponsored the Text Retrieval Conference (TREC) as part of the TIPSTER text program. The aim of this was to look into the information retrieval community by supplying the infrastructure that was needed for such a huge evaluation of text retrieval methodologies.

Web search engines such as Google and Lycos are amongst the most visible applications of information retrieval research.

Contents

Performance measures

There are various ways to measure how well the retrieved information matches the intended information:

Precision

The proportion of relevant documents of all documents retrieved:

P = (number of relevant documents retrieved) / (number of documents retrieved)

In binary classification, precision is analogous to specificity. Precision can also be evaluated at a given cut-off rank, denoted P@n, instead of all retrieved documents.

Recall

The proportion of retrieved documents of all relevant documents available:

R = (number of relevant documents retrieved) / (number of relevant documents)

In binary classification, recall is called sensitivity.

F-measure

The harmonic mean of precision and recall:

<math>F = 2 \times \mathrm{precision} \times \mathrm{recall} / (\mathrm{precision} + \mathrm{recall}).\,<math>

Mean average precision

Over a set of queries, find the mean of the average precisions, where Average Precision is the average of the precision after each relevant document is retrieved.

Where r is the rank, N the number retrieved, rel() a binary function on the relevance of a given rank, and P() precision at a given cut-off rank:

<math> \operatorname{Ave}P = \frac{\sum_{r=1}^N (P(r) \times \mathrm{rel}(r))}{\mbox{number of relevant documents}} \!<math>

This method emphasizes returning more relevant documents earlier.

Model types

For a successful IR, it is necessary to represent the documents in some way. There are a number of models for this purpose roughly dividable into three main groups:

Set-theoretic / Boolean models

Algebraic / vector space models

Probabilistic models

Open source information retrieval systems

  • Lemur (http://www.lemurproject.org/) Language Modelling IR Toolkit
  • Lucene (http://lucene.apache.org/java/docs/) Apache Jakarta project
  • SMART (ftp://ftp.cs.cornell.edu/pub/smart/) Early IR engine from Cornell University
  • Terrier (http://ir.dcs.gla.ac.uk/terrier) Information Retrieval Platform
  • Xapian (http://www.xapian.org/) Open source IR platform based on Muscat
  • Zettair (http://www.seg.rmit.edu.au/zettair/)

Major information retrieval research groups

Major figures in information retrieval

Awards in this field: Tony Kent Strix award

ACM SIGIR Gerard Salton Award

1983 - Gerard Salton, Cornell University 
"About the future of automatic information retrieval"
1988 - Karen Sparck Jones, University of Cambridge 
"A look back and a look forward"
1991 - Cyril Cleverdon, Cranfield Institute of Technology 
"The significance of the Cranfield tests on index languages"
1994 - William S. Cooper, University of California, Berkeley 
"The formalism of probability theory in IR: a foundation or an encumbrance?"
1997 - Tefko Saracevic, Rutgers University 
"Users lost: reflections on the past, future, and limits of information science"
2000 - Stephen E. Robertson, City University London 
"On theoretical argument in information retrieval"
2003 - W. Bruce Croft, University of Massachusetts, Amherst 
"Information retrieval and computer science: an evolving relationship"

See also

External links

de:Information-Retrieval es:Recuperación de la información fr:recherche d'information

Navigation

Academic Kids Menu

  • Art and Cultures
    • Art (http://www.academickids.com/encyclopedia/index.php/Art)
    • Architecture (http://www.academickids.com/encyclopedia/index.php/Architecture)
    • Cultures (http://www.academickids.com/encyclopedia/index.php/Cultures)
    • Music (http://www.academickids.com/encyclopedia/index.php/Music)
    • Musical Instruments (http://academickids.com/encyclopedia/index.php/List_of_musical_instruments)
  • Biographies (http://www.academickids.com/encyclopedia/index.php/Biographies)
  • Clipart (http://www.academickids.com/encyclopedia/index.php/Clipart)
  • Geography (http://www.academickids.com/encyclopedia/index.php/Geography)
    • Countries of the World (http://www.academickids.com/encyclopedia/index.php/Countries)
    • Maps (http://www.academickids.com/encyclopedia/index.php/Maps)
    • Flags (http://www.academickids.com/encyclopedia/index.php/Flags)
    • Continents (http://www.academickids.com/encyclopedia/index.php/Continents)
  • History (http://www.academickids.com/encyclopedia/index.php/History)
    • Ancient Civilizations (http://www.academickids.com/encyclopedia/index.php/Ancient_Civilizations)
    • Industrial Revolution (http://www.academickids.com/encyclopedia/index.php/Industrial_Revolution)
    • Middle Ages (http://www.academickids.com/encyclopedia/index.php/Middle_Ages)
    • Prehistory (http://www.academickids.com/encyclopedia/index.php/Prehistory)
    • Renaissance (http://www.academickids.com/encyclopedia/index.php/Renaissance)
    • Timelines (http://www.academickids.com/encyclopedia/index.php/Timelines)
    • United States (http://www.academickids.com/encyclopedia/index.php/United_States)
    • Wars (http://www.academickids.com/encyclopedia/index.php/Wars)
    • World History (http://www.academickids.com/encyclopedia/index.php/History_of_the_world)
  • Human Body (http://www.academickids.com/encyclopedia/index.php/Human_Body)
  • Mathematics (http://www.academickids.com/encyclopedia/index.php/Mathematics)
  • Reference (http://www.academickids.com/encyclopedia/index.php/Reference)
  • Science (http://www.academickids.com/encyclopedia/index.php/Science)
    • Animals (http://www.academickids.com/encyclopedia/index.php/Animals)
    • Aviation (http://www.academickids.com/encyclopedia/index.php/Aviation)
    • Dinosaurs (http://www.academickids.com/encyclopedia/index.php/Dinosaurs)
    • Earth (http://www.academickids.com/encyclopedia/index.php/Earth)
    • Inventions (http://www.academickids.com/encyclopedia/index.php/Inventions)
    • Physical Science (http://www.academickids.com/encyclopedia/index.php/Physical_Science)
    • Plants (http://www.academickids.com/encyclopedia/index.php/Plants)
    • Scientists (http://www.academickids.com/encyclopedia/index.php/Scientists)
  • Social Studies (http://www.academickids.com/encyclopedia/index.php/Social_Studies)
    • Anthropology (http://www.academickids.com/encyclopedia/index.php/Anthropology)
    • Economics (http://www.academickids.com/encyclopedia/index.php/Economics)
    • Government (http://www.academickids.com/encyclopedia/index.php/Government)
    • Religion (http://www.academickids.com/encyclopedia/index.php/Religion)
    • Holidays (http://www.academickids.com/encyclopedia/index.php/Holidays)
  • Space and Astronomy
    • Solar System (http://www.academickids.com/encyclopedia/index.php/Solar_System)
    • Planets (http://www.academickids.com/encyclopedia/index.php/Planets)
  • Sports (http://www.academickids.com/encyclopedia/index.php/Sports)
  • Timelines (http://www.academickids.com/encyclopedia/index.php/Timelines)
  • Weather (http://www.academickids.com/encyclopedia/index.php/Weather)
  • US States (http://www.academickids.com/encyclopedia/index.php/US_States)

Information

  • Home Page (http://academickids.com/encyclopedia/index.php)
  • Contact Us (http://www.academickids.com/encyclopedia/index.php/Contactus)

  • Clip Art (http://classroomclipart.com)
Toolbox
Personal tools