This book explains, collects and reports on the latest research results that aim at narrowing the so-called multimedia "Semantic Gap": the large disparity between descriptions of multimedia content that can be computed automatically, and the richness and subjectivity of semantics in user queries and human interpretations of audiovisual media. Addressing the grand challenge posed by the "Semantic Gap" requires a multi-disciplinary approach (computer science, computer vision and signal processing, cognitive science, web science, etc....
am delighted to see a book on multimedia semantics covering metadata, analysis, and
interaction edited by three very active researchers in the field: Troncy, Huet, and Schenk.
This is one of those projects that are very difficult to complete because the field is
advancing rapidly in many different dimensions. At any time, you feel that many important
emerging areas may not be covered well unless you see the next important conference in
the field. A state of the art book remains a moving, often elusive, target. But this is only a
part of the dilemma.
The Automatic Content Linking Device is a just-in-time document retrieval system which monitors an ongoing conversation or a monologue and enriches it with potentially related documents, including multimedia ones, from local repositories or from the Internet. The documents are found using keyword-based search or using a semantic similarity measure between documents and the words obtained from automatic speech recognition.