Dynamic Multi-video Summarization of Sensor-Rich Videos in Geo-Space

Abstract

User generated videos are much easier to be produced today due to the progress in camera technology on mobile devices. The ubiquitous built-in sensors in digital devices greatly enrich these videos with sensor descriptions, especially geo-spatial properties. A repository of such sensor-rich videos can be a great source of information for prospective tourists when they plan to visit a city and would like to get a preview of its main areas.

In this study we propose an interactive geo-video search system. When a user specifies a start point and a destination (e.g., on a map), the system dynamically retrieves a video summarization along the path between the two points. Moreover, the query can be interactively updated during the video playback, by changing either the tour path or the target destination. The main features of our technique are, first, that it is fully automatic and leverages sensor meta-data information which is acquired in conjunction with videos. Second, the system dynamically adapts to query updates in real-time, and no prior knowledge is required by users. Third, a concise but comprehensive summarization from multiple user generated videos is proposed for any queried route. Finally, the system incrementally adapts to the latest contributions to the video repository.