Real-time Activity Recognition by Discerning Qualitative Relationships Between Randomly Chosen Visual Features
In Proceedings British Machine Vision Conference 2014
AbstractIn this paper, we present a novel method to explore semantically meaningful visual information and identify the discriminative spatiotemporal relationships between them for real-time activity recognition. Our approach infers human activities using continuous egocentric videos of object manipulations in an industrial setup. In order to achieve this goal, we propose a random forest that unifies randomization, discriminative relationships mining and a Markov temporal structure. Discriminative relationships mining helps us to model relations that distinguish different activities, while randomization allows us to handle the large feature space and prevents over-fitting. The Markov temporal structure provides temporally consistent decisions. The proposed random forest uses a discriminative Markov decision tree, where every nonterminal node is a discriminative classifier and the Markov structure is applied at leaf nodes. The proposed approach outperforms the state-of-the-art methods on a new challenging dataset of assembling a pump system.
FilesExtended Abstract (PDF, 1 page, 1.2M)
Paper (PDF, 13 pages, 2.2M)
Supplemental Materials (ZIP, 7.1M)