1st Edition

Multimedia Ontology Representation and Applications

    304 Pages 108 B/W Illustrations
    by Chapman & Hall

    304 Pages 108 B/W Illustrations
    by Chapman & Hall

    The result of more than 15 years of collective research, Multimedia Ontology: Representation and Applications provides a theoretical foundation for understanding the nature of media data and the principles involved in its interpretation. The book presents a unified approach to recent advances in multimedia and explains how a multimedia ontology can fill the semantic gap between concepts and the media world. It relays real-life examples of implementations in different domains to illustrate how this gap can be filled.

    The book contains information that helps with building semantic, content-based search and retrieval engines and also with developing vertical application-specific search applications. It guides you in designing multimedia tools that aid in logical and conceptual organization of large amounts of multimedia data. As a practical demonstration, it showcases multimedia applications in cultural heritage preservation efforts and the creation of virtual museums.

    The book describes the limitations of existing ontology techniques in semantic multimedia data processing, as well as some open problems in the representations and applications of multimedia ontology. As an antidote, it introduces new ontology representation and reasoning schemes that overcome these limitations. The long, compiled efforts reflected in Multimedia Ontology: Representation and Applications are a signpost for new achievements and developments in efficiency and accessibility in the field.

    Introduction
    The Multimedia Wave
    Semantic Multimedia Web: Bridging the Semantic Gap
    Multimedia Web Ontology Language
    Organization of the Book

    Ontology and the Semantic Web
    Introduction
    Evolution of the Semantic Web
    Semantic Web Technologies
    What is an Ontology
    Formal Ontology Definition
    Ontology Representation
    Conclusions

    Characterizing Multimedia Semantics
    Introduction
    A First Look at Multimedia Semantics
    Percepts, Concepts, Knowledge and Expressions
    Representing Multimedia Semantics
    Semantic Web Technologies and Multimedia
    Conclusions

    Ontology Representations for Multimedia
    Introduction
    An Overview of MPEG-7 and MPEG-21
    MPEG-7 Ontologies
    Using MPEG-7 Ontology for Applications
    Multimedia Concept Modeling
    Ontology Applications
    Conclusions

    Multimedia Web Ontology Language
    Introduction
    Perceptual Modeling of Domains
    An Overview of the Multimedia Web Ontology Language
    MOWL: Concepts, Media Observables and Media Relations
    MOWL: Spatio-temporal Constructs for Complex Events
    MOWL Language Constructs
    The Observation Model
    MOWL Inferencing Framework
    Reasoning Modes with Bayesian Network and MOWL
    Conclusions

    Modeling the Semantics of Multimedia Content
    Introduction
    Data Driven Learning for Multimedia Semantics Extraction
    Media Features for Semantic Modeling
    Semantic Classification of Multimedia Content
    Use of Ontology for Semantic Classification
    Conclusions

    Learning Multimedia Ontology
    Introduction
    State of the Art in Ontology Learning
    Learning an Ontology from Multimedia Data
    Ontology-based Management of Multimedia Resources
    Application of Multimedia Ontology Learning
    Concluding Remarks

    Applications Exploiting Multimedia Semantics
    Introduction
    Multimedia Retrieval and Classification
    Recommendation of Media-rich Commodities
    Information Integration from Open Resources
    Conclusion

    Distributed Multimedia Applications
    Introduction
    Challenges for Web-scale Multimedia Data Access
    Architectures for Distributed Multimedia Data Processing
    Peer-to-Peer Architecture
    Multi-agent Architecture for Distributed Multimedia Systems
    Ontology Alignment
    Knowledge-based Access to Massively Distributed Multimedia
    Conclusion

    Application of Multimedia Ontology in Heritage Preservation
    Introduction
    Preserving the Intangible Heritage of Indian Classical Dance
    Intellectual Journey: Space-Time Traversal Using an Ontology
    Cross-modal Query and Retrieval
    Conclusion

    Open Problems and Future Directions
    Knowledge and Human Society
    Knowledge Organization and Formal Representation
    The Perceptual World and MOWL
    The Big Debate: Data Driven vs. Knowledge Driven Approaches
    Looking Forward: Convergence Between Knowledge-based and Data

    Appendices
    A: MOWL Schema in Notation
    B: MOWL Syntax Structural Specification
    C: Examples of WSDL Specification for Media Pattern Detectors

    Biography

    Santanu Chaudhury did his BTech (1984) in Electronics and Electrical Communication Engineering and PhD (1989) in Computer Science and Engineering from Indian Institute of Technology (IIT), Kharagpur, India. Currently, he is a professor in the Department of Electrical Engineering at IIT Delhi. He was also Dean, Undergraduate Studies at IIT Delhi. He was awarded INSA medal for young scientists in 1993. He is a fellow of Indian National Academy of Engineering and National Academy of Sciences, India. He is also a fellow of the International Association of Pattern Recognition. His research interests are in the areas of Computer Vision, Artificial Intelligence and Multimedia Systems. He has published more than 150 papers in international journals and conference proceedings. He has been on the programme committee of a number of international conferences, including ICCV, ACCV, ICPR, ICVGIP, and PReMI.

    Anupama Mallik did her BSc (1986) in Physics and Masters in Computer Applications (1989) from Delhi University, and PhD (2012) in Electrical Engineering from the Indian Institute of Technology (IIT), Delhi. Her PhD thesis dealt with ontology based exploration of multimedia contents. She is associated with Multimedia research group of the Electrical Engineering Department, IIT Delhi and has worked as a Research Scientist in projects sponsored by the Department of Science and Technology, Government of India. Her current research interests include Semantic web based applications, multimedia ontology, ontology applications in Internet of Things, and in cultural heritage preservation. She is a visiting faculty at the Indraprastha Institute of Information Technology, Delhi (IIIT-D). She is a member of the ACM.

    Hiranmay Ghosh is a principal scientist with TCS Innovation Labs Delhi and leads its multimedia research track. He received his PhD from IIT, Delhi and his BTech and BSc degrees from the University of Calcutta. His current research interests include multimedia systems, knowledge representation and reasoning, semantic web, intelligent agents, cognitive models and robotics. He is an adjunct faculty member of the Electrical Engineering Department of IIT, Delhi and is associated with its multimedia research group. He is a member of the academic advisory committee of IIT, Ropar. He is a senior member of the Institute of Electrical and Electronics Engineers (IEEE), and a member of ACM and IUPRAI.