HKUST Library Institutional Repository Banner

HKUST Institutional Repository >
Computer Science and Engineering >
CSE Technical Reports >

Please use this identifier to cite or link to this item:
Title: Video annotation by motion interpretation using optical flow streams
Authors: Sudhir, G.
Lee, John Chung-Mong
Issue Date: 13-Jul-1997
Series/Report no.: Computer Science Technical Report ; HKUST-CS96-16
Abstract: A new approach to automatic annotation of video sequences by dom-inant motion interpretation is presented. Unlike others, we separate the optical flow into two categories - singular and non-singular - which as we show is a more natural way of classif-ication for the purpose of dominant motion interpretation. We show that identification of patterns created by such natural categories, which can be observed from the measured optical flow, can help focus the interpretation of dominant motion in video segments. For robust observation of such natural patterns, we propose the computation of optical flow treams (OFS) from the video data and analyse the OFS for extraction of dominant motion content in the video segments. Our roposed approach has both bottom-up and top-down schemes suitably applied. The bottom-up scheme computes the OFS purely by local optimization of optical-flow equation. Then, the top-down scheme interprets the signature of the projection of the OFS on to the image coordinates for the detection of the natural category of the observed flow. Finally, further bottom-up analyses are done for sub-classification of the motion content in the video segments. The advantage of the pro-posed pproach is robustness in the extraction of dominant motion content in a video segment. We demonstrate this on a variety of real video sequences by generating the automatic motion annota-tion of the video frames and comparing with manual motion annota-tion.
Appears in Collections:CSE Technical Reports

Files in This Item:

File Description SizeFormat
tr9616.pdf543KbAdobe PDFView/Open

All items in this Repository are protected by copyright, with all rights reserved.