Real time vision/sensor based features processing for efficient HCI employing canonical correlation analysis

In this paper, a global algorithm for facial and gesture recognition is presented. The algorithm basically consists of three modules: features sensing and processing, dominant features selection and finally features matching. Depending on the type of data used (vision or sensor based), the proposed algorithm exploits multiple features employing 2DPCA that efficiently compact features’ descriptors maintain the spatial and temporal alignment of features’ components. Canonical Correlation Analysis (CCA) is employed to fuse different features from different descriptors or different performers. CCA also transforms training and testing features sets into new space where similar pairs become highly correlated pairs. Different experiments were conducted using well known data sets in addition to our newly collected data sets to verify the efficiency of the proposed algorithm. Excellent recognition accuracy, and fast performance are factors that promotes the proposed algorithm for real time implementation.