DBSCAN for Hand Tracking and Gesture Recognition


Wisnu Aditya, Herman Tolle, Timothy K Shih


Hand segmentation and tracking are important issues for hand-gesture recognition. Using depth data, it can speed up the segmentation process because we can delete unnecessary data like the background of the image easily. In this research, we modify DBSCAN clustering algorithm to make it faster and suitable for our system. This method is used in both hand tracking and hand gesture recognition. The results show that our method performs well in this system. The proposed method can outperform the original DBSCAN and the other clustering method in terms of computational time.

Full Text:



X. Zheng, Q. Lei, R. Yao, Y. Gong, and Q. Yin, “Image segmentation based on adaptive K-means algorithm,” Eurasip J. Image Video Process., vol. 2018, no. 1, 2018.

A. Jati, G. Singh, S. Koley, A. Konar, A. K. Ray, and C. Chakraborty, “A novel segmentation approach for noisy medical images using Intuitionistic fuzzy divergence with neighbourhood-based membership function,” J. Microsc., vol. 257, no. 3, pp. 187–200, 2015.

C. H. Lin, C. C. Chen, H. L. Lee, and J. R. Liao, “Fast K-means algorithm based on a level histogram for image retrieval,” Expert Syst. Appl., vol. 41, no. 7, pp. 3276–3283, 2014.

Z. Khan, J. Ni, X. Fan, and P. Shi, “An improved K-means clustering algorithm based on an adaptive initial parameter estimation procedure for image segmentation,” Int. J. Innov. Comput. Inf. Control, vol. 13, no. 5, pp. 1509–1526, 2017.

M. H. Khan, K. Shirahama, M. S. Farid, and M. Grzegorzek, “Multiple human detection in depth images,” 2016 IEEE 18th Int. Work. Multimed. Signal Process. MMSP 2016, pp. 1–6, 2017.

J. Shotton et al., “Efficient human pose estimation from single depth images,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 12, pp. 2821–2840, 2013.

U. Soni, A. Trivedi, and N. Roberts, “Real-Time hand tracking using integrated optical flow and CAMshift algorithm,” Proc. - 2016 2nd IEEE Int. Conf. Res. Comput. Intell. Commun. Networks, ICRCICN 2016, pp. 135–140, 2017.

J. Hou, C. Sha, L. Chi, Q. Xia, and N. M. Qi, “Merging dominant sets and DBSCAN for robust clustering and image segmentation,” 2014 IEEE Int. Conf. Image Process. ICIP 2014, pp. 4422–4426, 2014.

K. Essmaeel, L. Gallo, E. Damiani, G. De Pietro, and A. Dipandà, “Temporal denoising of Kinect depth data,” 8th Int. Conf. Signal Image Technol. Internet Based Syst. SITIS 2012r, pp. 47–52, 2012.

A. Chatterjee and V. M. Govindu, “Noise in Structured-Light Stereo Depth Cameras: Modeling and its Applications,” arXiv:1505.01936, 2015 (available at http://arxiv.org/abs/1904.09927).

R. Chaudhary and H. Dasgupta, “An Approach for Noise Removal on Depth Images,” arxiv.org/1602.05168, no. 1, pp. 1–2, 2016 (available at https://arxiv.org/pdf/1602.05168.pdf).

G. Halmetschlager-Funek, M. Suchi, M. Kampel, and M. Vincze, “An empirical evaluation of ten depth cameras: Bias, precision, lateral noise, different lighting conditions and materials, and multiple sensor setups in indoor environments,” IEEE Robot. Autom. Mag., vol. 26, no. 1, pp. 67–77, 2019.

C. D. Megawati, E. M. Yuniarno, and S. M. S. Nugroho, “Clustering of Female Avatar Face Features Consumers Choice using KMeans and SOM Algorithm,” Proc. - 2019 Int. Semin. Intell. Technol. Its Appl. ISITIA 2019, pp. 366–370, 2019.

N. Fatemi, H. Sajedi, and M. E. Shiri, “Salient object detection with segment features using mean shift algorithm,” 2018 8th Int. Conf. Comput. Knowl. Eng. ICCKE 2018, no. Iccke, pp. 20–26, 2018.

A. Omrani, K. Santhisree, and Damodaram, “Clustering sequential data with OPTICS,” 2011 IEEE 3rd Int. Conf. Commun. Softw. Networks, ICCSN 2011, pp. 591–594, 2011.

H. K. Kanagala and V. V. Jaya Rama Krishnaiah, “A comparative study of K-Means, DBSCAN and OPTICS,” 2016 Int. Conf. Comput. Commun. Informatics, ICCCI 2016, pp. 1–6, 2016.

Y. Li, J. Zhang, P. Gao, L. Jiang, and M. Chen, “Grab Cut Image Segmentation Based on Image Region,” 2018 3rd IEEE Int. Conf. Image, Vis. Comput. ICIVC 2018, pp. 311–315, 2018.

R. Augustauskas and A. Lipnickas, “Robust hand detection using arm segmentation from depth data and static palm gesture recognition,” Proc. 2017 IEEE 9th Int. Conf. Intell. Data Acquis. Adv. Comput. Syst. Technol. Appl. IDAACS 2017, vol. 2, pp. 664–667, 2017.

N. L. Hakim, T. K. Shih, S. P. K. Arachchi, W. Aditya, Y. C. Chen, and C. Y. Lin, “Dynamic hand gesture recognition using 3DCNN and LSTM with FSM context-aware model,” Sensors (Switzerland), vol. 19, no. 24, 2019.

M. Z. Rodriguez et al., “Clustering algorithms: A comparative approach,” PLoS One, vol. 14, no. 1, pp. 1–31, 2019.

R.-M. Ştefan, “A Comparison of Data Classification Methods,” Procedia Econ. Financ., vol. 3, no. 12, pp. 420–425, 2012.

C. Bodenstein, M. Gotz, A. Jansen, H. Scholz, and M. Riedel, “Automatic Object Detection Using DBSCAN for Counting Intoxicated Flies in the FLORIDA Assay,” 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 746–751, 2017.

DOI: http://dx.doi.org/10.25126/jitecs.202052174