An Audio-Video Summarization Scheme Based on Audio and Video Analysis

The availability of video files in the Internet is growing at an exceptional speed and in the near future video browsing will be a common activity. To facilitate such activity it will be necessary to have a small clip for any given video. Currently, video skimming and video summarization techniques can reduce the temporal representation of a given video. However, most of these techniques do not include audio in the produced summaries. Here, we propose a mechanism that, using audio and video analysis, produces video summaries coupled with intelligible audio. Experimental results show that the summaries are largely reduced (up to 50%) and that the perceived video quality may be comparable to the one of the original video (in term of jerkiness). Consumers satisfaction has been investigated through MOS and results show that our summaries can be considered as an alternative to the original videos.