NUS Enterprise

GeoVid: Methods for Sensor-rich Video Management

Technology #11119n

Questions about this technology? Ask a Technology Manager

Download Printable PDF

Image Gallery
Figure 1
Managed By
Ms Asha Srinivasan (
Associate Director (65)65161671
Patent Protection

Apparatus, System and Method for Annotation of Media Files with Sensor Data

US Patent US9509968B2

Apparatus, System and Method for Annotation of Media Files with Sensor Data

PCT Patent Application WO 2012/115593
Files and Attachments
Technology Offer [PDF]

Mobile devices are increasingly popular for the versatile capture and delivery of video content. However, the acquisition and transmission of large amounts of video data on mobile devices face fundamental challenges such as power and wireless bandwidth constraints. To support diverse mobile video applications, it is critical to overcome these challenges.

This invention presents a design framework that brings together several key ideas to enable energy-efficient mobile video management applications. First, we leverage off-the-shelf smartphones as mobile video sensors. Second, concurrently with video recordings we acquire geospatial sensor meta-data to describe the videos. Third, we immediately upload the metadata to a server to enable low latency video search. This last step allows for very energy-efficient transmissions, as the sensor data sets are small and the bulky video data can be uploaded on demand, if and when needed. Experimental results show that our approach substantially prolongs the battery life of mobile devices while only slightly increasing the search latency. 

Figure 1

Video management, energy efficiency, smart phones, mobile devices

iOS and Android apps available.

Smart phone video streaming applications 

1. A mobile device can continuously transmit the sensor stream to a portal server, while at the same time recording and storing video in its local memory 
2. The small size of the sensor data allows for robust and fast transmission to, say, a portal, on which the information can be further processed and made available to other users
3. Key frames are extracted from the video and represent snapshots that allow a user to gain a quick understanding of the visual content of a video.
4. Sensor data indexing allows for efficient search of identifying and selecting videos with certain properties e.g. videos or video segments that show a certain geographical area.
5. Large archives of sensor-rich videos may be browsed and presented in various ways, such as camera location, the camera viewing direction or the viewable scene, and Multiple camera trajectories representing different captured videos can be shown on a map simultaneously.

Patent granted in the US. Pending in Israel and Singapore. Available for licensing and/or joint collaboration.