MPEG-7 Video Browsing and Summarization
The Murray Hill Laboratory (MHL) of Mitsubishi Electric Research Laboratories has developed a Motion-based Indexing and Summarization system for video. It is based on our work on descriptors of motion activity and their combination with descriptors of other features such as color, as well as our work on Directed Acyclic Graph (DAG) based Description schemes, both of which have also been accepted into the MPEG-7 standard. Most recently we have also incorporated audio features into our indexing framework. The purpose of the system is to help the user quickly traverse recorded video content using both top-down i.e. summarization based, and bottom-up, i.e. indexing based, access. We illustrate the MISE web-based interface in the figure on the left.
Background & Objective: As more and more audio-visual content becomes available in digital form in various places around the world, the ability to locate desired content will become more and more important. Already text based search engines help retrieve textual data from the World Wide Web, but no equivalent identifying information exists for A/V content. The proposed MPEG-7 standard will standardize a multimedia content description interface that will enable efficient searching and browsing of worldwide multimedia content. In this project we emphasize the Personal Video Recorder application, that provides the user with the content he wants when he wants it by storing a large volume of content recorded from broadcast and then providing effective navigation of the stored content using summarization and indexing.
Technical Discussion: The system relies on extraction of compact descriptors in the compressed domain, which makes both the content preparation and the content access fast. It primarily relies on the MPEG-7 motion activity descriptor, and also makes use of simple color histograms. We have a unique motion activity based approach to video summarization.
Contacts:
Anthony Vetro
Technology Areas:
Audio Video Processing
Advanced Digital Television
Modification Date: June 13, 2008
