Voice-Based Humanoid Robot Interaction
El Sayed M. Saad1, Medhat H. Awadalla2, Hosam Eldin I. Ali3, Rasha F. A. Mostafa4
1El Sayed M. Saad, Department of Communications, Electronics and Computers, Helwan University, faculty of Engineering Cairo, Egypt.
2Medhat H. Awadalla, Department of Communications, Electronics and Computers, Helwan University, faculty of Engineering Cairo, Egypt& Department of Electrical and computer engineering, SQU, Oman.
3Hossam E.I.Ali, Department of Communications, Electronics and Computers, Helwan University, faculty of Engineering Cairo, Egypt .
4Rasha.F.A.Mostafa Department of Communications, Electronics and Computers, Helwan University, faculty of Engineering Cairo, Egypt.
Manuscript received on September 01, 2012. | Revised Manuscript received on September 02, 2012. | Manuscript published on September 05, 2012. | PP: 60-65 | Volume-2 Issue-4, September 2012. | Retrieval Number: D0871072412/2012©BEIESP
Open Access | Ethics and Policies | Cite
© The Authors. Published By: Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Abstract: Recently, the interest in service robots endowed with communicative capabilities has been increased. These robots should operate in cluttered and uncluttered environments and interact with humans using natural language to perform a variety of service-oriented tasks. Recognizing and fetching of a user-specified object can be considered as one of the major tasks for a humanoid robot. To get the robot capable of identifying the geometric shapes and colors of the objects, a vision system is proposed. Furthermore, the paper proposes a natural language understanding system, where the robot will be able to effectively communicate with human through a dialogue developed in Arabic language. The developed dialogue and a dynamic object model are used for learning the semantic categories and object descriptions. In this paper, a robot will be developed to interact with the users performing some specified actions. Moreover, integration between the proposed vision and natural language understanding systems has been presented. Finally, a voice-based dialogue between the user and robot will be developed. Intensive experiments have been conducted indoor to address the validity of the complete proposed system. The achieved results show that the overall system performance is high compared with the related literature to the theme of this paper.
Keywords: Vision System, Speech system, object category recognition, Object Detection, Color detection, Natural Language Understanding, Ontology, Syntax, knowledge Representation, Semantic Networks.