Research Article
A Bidirectional Indian Sign Language Translation System using Speech Recognition and a 3D Avatar
|
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
|
| Volume 187 - Issue 134 |
| Published: August 2026 |
| Authors: Mackenzie Rebelo, Vaishnavi Vasant Lotulkar, Vedant Gaonkar, Athary Prabhu, Nisha Costa, Manjusha Sanke, Prajacta Naik |
10.5120/ijcaf3e03846c333
|
Mackenzie Rebelo, Vaishnavi Vasant Lotulkar, Vedant Gaonkar, Athary Prabhu, Nisha Costa, Manjusha Sanke, Prajacta Naik . A Bidirectional Indian Sign Language Translation System using Speech Recognition and a 3D Avatar. International Journal of Computer Applications. 187, 134 (August 2026), 17-21. DOI=10.5120/ijcaf3e03846c333
@article{ 10.5120/ijcaf3e03846c333,
author = { Mackenzie Rebelo,Vaishnavi Vasant Lotulkar,Vedant Gaonkar,Athary Prabhu,Nisha Costa,Manjusha Sanke,Prajacta Naik },
title = { A Bidirectional Indian Sign Language Translation System using Speech Recognition and a 3D Avatar },
journal = { International Journal of Computer Applications },
year = { 2026 },
volume = { 187 },
number = { 134 },
pages = { 17-21 },
doi = { 10.5120/ijcaf3e03846c333 },
publisher = { Foundation of Computer Science (FCS), NY, USA }
}
%0 Journal Article
%D 2026
%A Mackenzie Rebelo
%A Vaishnavi Vasant Lotulkar
%A Vedant Gaonkar
%A Athary Prabhu
%A Nisha Costa
%A Manjusha Sanke
%A Prajacta Naik
%T A Bidirectional Indian Sign Language Translation System using Speech Recognition and a 3D Avatar%T
%J International Journal of Computer Applications
%V 187
%N 134
%P 17-21
%R 10.5120/ijcaf3e03846c333
%I Foundation of Computer Science (FCS), NY, USA
Abstract
Communication is often challenging for hearing-impaired individuals due to the limited awareness of Indian Sign Language (ISL). Most existing solutions are text-based and lack an interactive and visual approach, making communication less effective and difficult to understand. This paper presents a bidirectional ISL translation system that converts speech or text into ISL using a 3D animated avatar and enables reverse translation from ISL to text or speech. By combining speech recognition, natural language processing, gesture recognition, and 3D animation, the proposed system provides an interactive approach to facilitate communication between hearing and hearing-impaired individuals. The trained sign recognition model achieved a test accuracy of 93.18% on the collected dataset, demonstrating its ability to recognize the sign classes used in the system.
References
- E. Sakthivel, “Indian Sign Language to Text/Speech Translation,” International Journal for Research in Applied Science and Engineering Technology, vol. 13, no. 5, 2025, doi: 10.22214/ijraset.2025.70817.
- K. Mahale, N. V. Sawant, N. S. Mane, and N. Nandurkar, “Study and Overview of Multilingual Voice and Text to Sign Language Translator,” International Research Journal on Advanced Engineering Hub, vol. 3, no. 10, 2025, doi: 10.47392/irjaeh.2025.0581.
- P. Jaiswal, D. Rade, P. Kumbhare, P. Mindhe, and S. Rabade, “Real-Time Speech-to-Sign Language (ISL) Converter for Enhancing Communication Accessibility,” International Journal of Engineering Research & Technology, vol. 14, no. 10, 2025, doi: 10.17577/IJERTV14IS100160.
- P. Ahinsa, S. Thrimahavithana, and K. Karunanayaka, “Bridging Communication Gaps: Advancements, Challenges, and Future Directions in Text-to-Sign Language Translation,” Journal of Future Artificial Intelligence and Technologies, vol. 2, no. 1, pp. 110–134, 2025, doi: 10.62411/faith.3048-3719-91.
- L. Goyal and V. Goyal, “Automatic Translation of English Text to Indian Sign Language Synthetic Animations,” in Proc. 13th Int. Conf. on Natural Language Processing, Varanasi, India, 2016, pp. 144–153.
- J. Peguda, V. S. S. Santosh, Y. Vijayalata, A. D. R. N., and V. Mounish, “Speech to Sign Language Translation for Indian Languages,” 2022, doi: 10.1109/ICACCS54159.2022.9784996.
- O. Tipare, S. Pathre, P. Pathak, and D. Karia, “GestureSpeak: A Real-Time Sign to Speech Translation,” in 2025 3rd International Conference on Inventive Computing and Informatics (ICICI), Bangalore, India, 2025, pp. 120–125, doi: 10.1109/ICICI65870.2025.11069898.
- H. Monga, J. Bhutani, M. Ahuja, N. Maida, and H. Pande, “Speech to Indian Sign Language Translator,” in Recent Trends in Intensive Computing, IOS Press, 2021, doi: 10.3233/APC210172.
- R. Hegde, S. Shivashankara, S. M. Soumyasri, M. T. Thirthe Gowda, Y. N. Mahadeva Prasad, and C. S. Tejeshwini, “An Hand Gesture Smart Translation System for Differently Abled People,” in 2024 International Conference on Recent Advances in Science and Engineering Technology (ICRASET), B. G. Nagara, Mandya, India, 2024, pp. 1–6, doi: 10.1109/ICRASET63057.2024.10895579.
- Z. Liang, H. Li, and J. Chai, “Sign Language Translation: A Survey of Approaches and Techniques,” Electronics, vol. 12, no. 12, p. 2678, 2023, doi: 10.3390/electronics12122678.
- F. M. Najib, “Sign language interpretation using machine learning and artificial intelligence,” Neural Computing and Applications, 2024, doi: 10.1007/s00521-024-10395-9.
- Kulkarni, A. V. Kariyal, V. Dhanush, and P. N. Singh, “Speech to Indian Sign Language Translator,” Atlantis Highlights in Computer Sciences, 2021, doi: 10.2991/ahis.k.210913.035.
- N. Nayan, D. Ghosh, and P. M. Pradhan, “Development of an Animation-Based Indian Sign Language e-Learning App for Persons with Hearing and Speech Impairment,” Cureus Journal of Computer Science, 2024, doi: 10.7759/s44389-024-00347-8.
- D. Khurana, A. Koli, K. Khatter, and S. Singh, “Natural Language Processing: State of the Art, Current Trends and Challenges,” Multimedia Tools and Applications, vol. 82, no. 3, pp. 3713–3744, 2022, doi: 10.1007/s11042-022-13428-4.
- R. Damdoo and P. Kumar, “An Integrative Survey on Indian Sign Language Recognition and Translation,” 2025, doi: 10.1049/ipr2.70000.
Index Terms
Keywords