Recent advancements in the field of computer vision with the help of deep neural networks have led us to explore and develop many existing challenges that were once unattended due to the lack of necessary technologies. Hand Sign/Gesture Recognition is one of the significant areas where the deep neural network is making a substantial impact. In the last few years, a large number of researches has been conducted to recognize hand signs and hand gestures, which we aim to extend to our mother-tongue, Bangla (also known as Bengali). The primary goal of our work is to make an automated tool to aid the people who are unable to speak. We developed a system that automatically detects hand sign based digits and speaks out the result in Bangla language. According to the report of the World Health Organization (WHO), 15% of people in the world live with some kind of disabilities. Among them, individuals with communication impairment such as speech disabilities experience substantial barrier in social interaction. The proposed system can be invaluable to mitigate such a barrier. The core of the system is built with a deep learning model which is based on convolutional neural networks (CNN). The model classifies hand sign based digits with 92% accuracy over validation data which ensures it a highly trustworthy system. Upon classification of the digits, the resulting output is fed to the text to speech engine and the translator unit eventually which generates audio output in Bangla language. A web application to demonstrate our tool is available at http://bit.ly/signdigits2banglaspeech.
Filter by Year
Filter by Author
P. D. Gujrati (8)
Manish Shrivastava (7)
Umapada Pal (5)
Partha Pratim Roy (5)
Ayan Kumar Bhunia (4)
C.V. Jawahar (4)
Manish Shrivastava (7)
Umapada Pal (5)
Partha Pratim Roy (5)
Ayan Kumar Bhunia (4)
C.V. Jawahar (4)
Iti Mathur (4)
Nisheeth Joshi (4)
Ram Sarkar (3)
Akash Mohta (3)
Pushpak Bhattacharyya (3)
Dipak kumar Basu (3)
Mita Nasipuri (3)
Kamal Sarkar (3)
Ankush Khandelwal (3)
Nibaran Das (3)
Dipak Kumar Basu (3)
Sahil Swami (3)
Subhadip Basu (3)
Mahantapas Kundu (3)
B.B. Chaudhuri (2)
Raj Nath Patel (2)
Mohd Zeeshan Ansari (2)
U. Pal (2)
Shweta Nigam (2)
Prakash B. Pimpale (2)
Bidisha Samanta (2)
Rekha Jain (2)
MD. Saiful Islam (2)
Rajat Singh (2)
Nurendra Choudhary (2)
Sabir Ismail (2)
Syed Sarfaraz Akhtar (2)
Richa Sharma (2)
Md. Saiful Islam (2)
Siva Reddy (1)
Vivek Kr Verma (1)
Anoop Namboodiri (1)
Minesh Mathew (1)
Evan Askanazi (1)
Md. Hanif Seddiqui (1)
Syed S. Akhtar (1)
Vaishali Sharma (1)
Sudeshna Sarkar (1)
Md Saddam Hossain (1)
Devendra Sachan (1)
Neeraj Battan (1)
Vinay Singh (1)
Rajasree M S (1)
A. K. A. Azad (1)
Asif Ekbal (1)
Vasudeva Varma (1)
Shashi Pal Singh (1)
Vijayan K. Asari (1)
Md. Ataur Rahman (1)
Manojna K. S. S (1)
Tark M. Taha (1)
Utpal Sharma (1)
Stephan Vogel (1)
Sreelekha. S (1)
Nikita Moghe (1)
T.S. Naveen (1)
Md. Rafiqul Islam (1)
Shruti Tyagi (1)
M Rema (1)
Souvik Bhowmick (1)
Preethi Jyothi (1)
Animesh Mukherjee (1)
Jahid Hassan (1)
Paheli Bhattacharya (1)
Saurabh Singh (1)
Sagar S. Rane (1)
Pawan Goyal (1)
Prasenjit Majumder (1)
Sushma Yalamanchili (1)
Sakshi Gupta (1)
Vineet Chaitanya (1)
Mirzanur Rahman (1)
Vishwajeet Kumar (1)
N Masha (1)
Sanjay Saha (1)
Simon King (1)
Abdul Hannan (1)
D. Meenakshy (1)
Rohit Mishra (1)
Abhipsa Basu (1)
S. M. Kamruzzaman (1)
Comma seperated list of Authors (1)
Prithwish Mukherjee (1)
Mallikarjun Hangarge (1)
Madan Gopal Jhanwar (1)
Manju Manuel (1)
Minhaz Uddin Ahmed (1)
Irina Temnikova (1)
Sandip Modha (1)
Priya Rani (1)
M Abdul Rahiman (1)
Raveesh Motlani (1)
Jasabanta Patro (1)
P. P. Aung (1)
Arpita Das (1)
N.V. Neeba (1)
Ameya Prabhu (1)
Mahmudul Hasan (1)
Tasmin Afroz (1)
Nadir Durrani (1)
Akshar Bharati (1)
Md Arshad Ali (1)
Raveena R Kumar (1)
M Sasikumar (1)
Md. Nawab Yousuf Ali (1)
Shubham Tripathi (1)
Mimisha Nesan (1)
Md. Fahad Hasan (1)
Somnath Roy (1)
Ritika Agarwal (1)
Ching Y. Suen (1)
Kaustubh Bhattacharyya (1)
S. Sphoorthy Reddy (1)
Lukáš Neumann (1)
Ashis Kumar Mandal (1)
Deepti Chopra (1)
Monojit Choudhury (1)
Dipti M. Sharma (1)
Pawanesh Abrol (1)
Dipaloke Saha (1)
Rezwana Sharmeen (1)
Niloy Ganguly (1)
Sreelekha S (1)
Piyush Bansal (1)
Lubna Khan (1)
Andrea Corsi (1)
P.J. Narayanan (1)
Aditya Joshi (1)
Pramod Pandey (1)
Dipti Mishra Sharma (1)
Arnav Sharma (1)
Anirudh Dahiya (1)
Uma Shanker Tiwary (1)
Bharath A (1)
G Manoj Kumar (1)
S.S. Ravi Kiran (1)
Md Zahangir Alom (1)
Bidyut B. Chaudhuri (1)
Srikanth Doddamani (1)
T. V. Prasad (1)
Manish Srivastava (1)
Shahjalal Ahmed (1)
Nicola Nobile (1)
Tanvir Ahmad (1)
Girish Nath Jha (1)
Peheding Sidike (1)
Mitesh M. Khapra (1)
Suranjit SinhaUmapada PalB. B. Chaudhuri (1)
Shikha Kabra (1)
Bajibabu Bollepalli (1)
Shaikh Muhammad Allayear (1)
Arijit Mukherjee (1)
M.B. SUKHASWAMI (1)
Mohit Jain (1)
S. V. A. V. Prasad (1)
Chun Lei He (1)
Baharul Islam (1)
Sree Harsha Ramesh (1)
P. SEETHARAMULU (1)
R SaidasS. (1)
S. Padmavathi (1)
Shamim Ripon (1)
Abdul Rahiman M (1)
Rajeev Sangal (1)
Soumen Chakrabarti (1)
Ahmad Musleh (1)
Md. Shopon (1)
ARUN K. PUJARI (1)
Nitigya Sambyal (1)
Ishita Bindlish (1)
Tushar Patnaik (1)
M. Kameswara Rao (1)
Amir Sadeghi (1)
Shabbir Ahmad (1)
Juhi Ameta (1)
U. Pal ; B.B. Chaudhuri (1)
K. C. Santosh (1)
Amba P. Kulkarni (1)
Nayan Jyoti Kalita (1)
Preslav Nakov (1)
Rajmohan Pardeshi (1)
Jiří Matas (1)
M S Rajasree (1)
Ganesh Ramakrishnan (1)
N. Mohammed (1)
Pranjal Das (1)
Rohit Sinha (1)
Ondřej Bojar (1)
Shikhar Kr. Sarma (1)
Md. Abul Kalam Azad (1)
Kandarpa Kumar Sarma (1)
Shrikant Malviya (1)
Ankit Kumar (1)
Srikanth Ronanki (1)
M. R. Amin (1)
Radhika Mamidi (1)
Osama Alsaad (1)
Akanksha Gehlot (1)
Shrey Dutta (1)
Sufal Das (1)
Atul Kr. Ojha (1)
Purnendu Banerjee (1)
Nitish Joshi (1)
Ajai Kumar (1)
Shantipriya Parida (1)
Siddhartha Arora (1)
S. Madhvanath (1)
Kalyanee Kanchan Baruah (1)
Suman Banerjee (1)
Bilkis Jamal Ferdosi (1)
Rikta Sen (1)
M.N.S.S.K. Pavan Kumar (1)
R Meenakshi (1)
A. Hassan (1)
Malik Waqas Sagheer (1)
Ganji Sreeram (1)
Avirup Bhattacharyya (1)
John Everatt (1)
Bradley P. Lambeth Jr (1)
Kamlesh Sharma (1)
Satya Ranjan Dash (1)
Deepak Gupta (1)
More
Nisheeth Joshi (4)
Ram Sarkar (3)
Akash Mohta (3)
Pushpak Bhattacharyya (3)
Dipak kumar Basu (3)
Mita Nasipuri (3)
Kamal Sarkar (3)
Ankush Khandelwal (3)
Nibaran Das (3)
Dipak Kumar Basu (3)
Sahil Swami (3)
Subhadip Basu (3)
Mahantapas Kundu (3)
B.B. Chaudhuri (2)
Raj Nath Patel (2)
Mohd Zeeshan Ansari (2)
U. Pal (2)
Shweta Nigam (2)
Prakash B. Pimpale (2)
Bidisha Samanta (2)
Rekha Jain (2)
MD. Saiful Islam (2)
Rajat Singh (2)
Nurendra Choudhary (2)
Sabir Ismail (2)
Syed Sarfaraz Akhtar (2)
Richa Sharma (2)
Md. Saiful Islam (2)
Siva Reddy (1)
Vivek Kr Verma (1)
Anoop Namboodiri (1)
Minesh Mathew (1)
Evan Askanazi (1)
Md. Hanif Seddiqui (1)
Syed S. Akhtar (1)
Vaishali Sharma (1)
Sudeshna Sarkar (1)
Md Saddam Hossain (1)
Devendra Sachan (1)
Neeraj Battan (1)
Vinay Singh (1)
Rajasree M S (1)
A. K. A. Azad (1)
Asif Ekbal (1)
Vasudeva Varma (1)
Shashi Pal Singh (1)
Vijayan K. Asari (1)
Md. Ataur Rahman (1)
Manojna K. S. S (1)
Tark M. Taha (1)
Utpal Sharma (1)
Stephan Vogel (1)
Sreelekha. S (1)
Nikita Moghe (1)
T.S. Naveen (1)
Md. Rafiqul Islam (1)
Shruti Tyagi (1)
M Rema (1)
Souvik Bhowmick (1)
Preethi Jyothi (1)
Animesh Mukherjee (1)
Jahid Hassan (1)
Paheli Bhattacharya (1)
Saurabh Singh (1)
Sagar S. Rane (1)
Pawan Goyal (1)
Prasenjit Majumder (1)
Sushma Yalamanchili (1)
Sakshi Gupta (1)
Vineet Chaitanya (1)
Mirzanur Rahman (1)
Vishwajeet Kumar (1)
N Masha (1)
Sanjay Saha (1)
Simon King (1)
Abdul Hannan (1)
D. Meenakshy (1)
Rohit Mishra (1)
Abhipsa Basu (1)
S. M. Kamruzzaman (1)
Comma seperated list of Authors (1)
Prithwish Mukherjee (1)
Mallikarjun Hangarge (1)
Madan Gopal Jhanwar (1)
Manju Manuel (1)
Minhaz Uddin Ahmed (1)
Irina Temnikova (1)
Sandip Modha (1)
Priya Rani (1)
M Abdul Rahiman (1)
Raveesh Motlani (1)
Jasabanta Patro (1)
P. P. Aung (1)
Arpita Das (1)
N.V. Neeba (1)
Ameya Prabhu (1)
Mahmudul Hasan (1)
Tasmin Afroz (1)
Nadir Durrani (1)
Akshar Bharati (1)
Md Arshad Ali (1)
Raveena R Kumar (1)
M Sasikumar (1)
Md. Nawab Yousuf Ali (1)
Shubham Tripathi (1)
Mimisha Nesan (1)
Md. Fahad Hasan (1)
Somnath Roy (1)
Ritika Agarwal (1)
Ching Y. Suen (1)
Kaustubh Bhattacharyya (1)
S. Sphoorthy Reddy (1)
Lukáš Neumann (1)
Ashis Kumar Mandal (1)
Deepti Chopra (1)
Monojit Choudhury (1)
Dipti M. Sharma (1)
Pawanesh Abrol (1)
Dipaloke Saha (1)
Rezwana Sharmeen (1)
Niloy Ganguly (1)
Sreelekha S (1)
Piyush Bansal (1)
Lubna Khan (1)
Andrea Corsi (1)
P.J. Narayanan (1)
Aditya Joshi (1)
Pramod Pandey (1)
Dipti Mishra Sharma (1)
Arnav Sharma (1)
Anirudh Dahiya (1)
Uma Shanker Tiwary (1)
Bharath A (1)
G Manoj Kumar (1)
S.S. Ravi Kiran (1)
Md Zahangir Alom (1)
Bidyut B. Chaudhuri (1)
Srikanth Doddamani (1)
T. V. Prasad (1)
Manish Srivastava (1)
Shahjalal Ahmed (1)
Nicola Nobile (1)
Tanvir Ahmad (1)
Girish Nath Jha (1)
Peheding Sidike (1)
Mitesh M. Khapra (1)
Suranjit SinhaUmapada PalB. B. Chaudhuri (1)
Shikha Kabra (1)
Bajibabu Bollepalli (1)
Shaikh Muhammad Allayear (1)
Arijit Mukherjee (1)
M.B. SUKHASWAMI (1)
Mohit Jain (1)
S. V. A. V. Prasad (1)
Chun Lei He (1)
Baharul Islam (1)
Sree Harsha Ramesh (1)
P. SEETHARAMULU (1)
R SaidasS. (1)
S. Padmavathi (1)
Shamim Ripon (1)
Abdul Rahiman M (1)
Rajeev Sangal (1)
Soumen Chakrabarti (1)
Ahmad Musleh (1)
Md. Shopon (1)
ARUN K. PUJARI (1)
Nitigya Sambyal (1)
Ishita Bindlish (1)
Tushar Patnaik (1)
M. Kameswara Rao (1)
Amir Sadeghi (1)
Shabbir Ahmad (1)
Juhi Ameta (1)
U. Pal ; B.B. Chaudhuri (1)
K. C. Santosh (1)
Amba P. Kulkarni (1)
Nayan Jyoti Kalita (1)
Preslav Nakov (1)
Rajmohan Pardeshi (1)
Jiří Matas (1)
M S Rajasree (1)
Ganesh Ramakrishnan (1)
N. Mohammed (1)
Pranjal Das (1)
Rohit Sinha (1)
Ondřej Bojar (1)
Shikhar Kr. Sarma (1)
Md. Abul Kalam Azad (1)
Kandarpa Kumar Sarma (1)
Shrikant Malviya (1)
Ankit Kumar (1)
Srikanth Ronanki (1)
M. R. Amin (1)
Radhika Mamidi (1)
Osama Alsaad (1)
Akanksha Gehlot (1)
Shrey Dutta (1)
Sufal Das (1)
Atul Kr. Ojha (1)
Purnendu Banerjee (1)
Nitish Joshi (1)
Ajai Kumar (1)
Shantipriya Parida (1)
Siddhartha Arora (1)
S. Madhvanath (1)
Kalyanee Kanchan Baruah (1)
Suman Banerjee (1)
Bilkis Jamal Ferdosi (1)
Rikta Sen (1)
M.N.S.S.K. Pavan Kumar (1)
R Meenakshi (1)
A. Hassan (1)
Malik Waqas Sagheer (1)
Ganji Sreeram (1)
Avirup Bhattacharyya (1)
John Everatt (1)
Bradley P. Lambeth Jr (1)
Kamlesh Sharma (1)
Satya Ranjan Dash (1)
Deepak Gupta (1)