Aerial photograph of the Immaculate Conception Chapel

Human Activity Segmentation

Adaptive segmentation technique for automatic object region and boundary extraction in human activity video sequences

Automatic video segmentation for human activity recognition has played an important role in several computer vision applications. Active contour model (ACM) has been used extensively for unsupervised adaptive segmentation and automatic object region and boundary extraction in video sequences. This research presents optimizing Active Contour Model using recurrent architecture for automatic object region and boundary extraction in human activity video sequences. Taking advantage of the collective computational ability and energy convergence capability of the recurrent architecture, energy function of Active Contour Model is optimized with lower computational time. The system starts with initializing recurrent architecture state based on the initial boundary points and ends up with final contour which represent actual boundary points of human body region. The initial contour of the Active Contour Model is computed using background subtraction based on Gaussian Mixture Model (GMM) such that background model is built dynamically and regularly updated to overcome different challenges including illumination changes, camera oscillations, and changes in background geometry. The recurrent nature is useful for dealing with optimization problems due to its dynamic nature, thus, ensuring convergence of the system. The proposed boundary detection and region extraction can be used for real time processing. This method results in an effective segmentation that is less sensitive to noise and complex environments. Experiments on different databases of human activity show that our method is effective and can be used for real-time video segmentation.

H.A.S. Chart

Input Video Segmented Video

H.A.S. Hands

H.A.S. Table

Publications in this field:

  • Fatema Albalooshi and Vijayan K. Asari, "Optimization of object region and boundary extraction by energy minimization of a recurrent neural network for activity recognition," Proceedings of SPIE Conference on Defense, Security, and Sensing: Independent Component Analyses, Compressive Sampling, Wavelets, Neural Net, Biosystems, and Nanoengineering XI (Neural Network Learning Application), Baltimore, MD, USA, vol. 8750, 29 April - 03 May 2013.
  • Fatema Albalooshi and Vijayan K. Asari, "Video segmentation for automatic extraction of human body region for action and activity recognition," Brother Joseph W Stander Symposium 2013, University of Dayton, Dayton, OH, USA, 16-17 April 2013
  • Alex Mathew, Fatema Albalooshi and Vijayan K. Asari, "Water body segmentation in aerial imagery," Brother Joseph W Stander Symposium 2013, University of Dayton, Dayton, OH, USA, 16-17 April 2013
  • Fatema Albalooshi and Vijayan K. Asari, "An adaptive segmentation technique for automatic object region and boundary extraction for human activity recognition," Proceedings of the SPIE Conference on Defense, Security, and Sensing: Visual Information Processing XXI, Baltimore, MD, USA, vol. 8399, 839907: 1-11, 23-27 April 2012.