One small step for a man
One Giant leap for the mankind

There is no wealth like Knowledge
                            No Poverty like Ignorance
Journal of Emerging Trends in Computing and Information Sciences Logo

Journal of Emerging Trends in Computing and Information Sciences >> Call for Papers Vol. 8 No. 3, March 2017

Journal of Emerging Trends in Computing and Information Sciences

Using Multimodal Fusion in Accessing Web Services

Full Text Pdf Pdf
Author Atef Zaguia, Manolo Dulva Hina, Chakib Tadj, Amar Ramdane-Cherif
ISSN 2079-8407
On Pages 121-138
Volume No. 1
Issue No. 2
Issue Date October 1, 2010
Publishing Date October 1, 2010
Keywords multimodal fusion, web service, human-computer interface


In our days, the technology allows us to produce extended and totally human-controlled multimodal systems. These systems are equipped with multimodal interfaces allowing a more natural and more efficient interaction between man and machine. End users could take advantage of natural modalities (e.g. eye gaze, speech, gesture, etc.) to communicate or exchange information with applications. The use of multimodal applications in web services, integrated with natural modalities, is an effective solution for users who cannot use a keyboard or a mouse, on users who have visual handicap, on mobile users equipped with wireless telephone/mobile devices, on weakened users, etc. Our work presents an approach in which various input modalities (speech, touch screen, keyboard, eye gaze, etc.) are available at user’s disposition in order to access web services. While current state-of-the-art uses two (on rare cases, three) pre-defined modalities, our approach allows an unlimited number of concurrent modalities using semantic level called “multimodal fusion”. Such approach gives user the flexibility to use the modalities as he sees fit for his situation. The detailed description of the proposed approach as well as the application that has been developed that uses these multimodalities is presented in this paper.

    Journal of Computing | Journal of Networks and Communication | Journal Management System | Journal of Systems and Software | ARPN Journal of Science and Technology     
© 2015 Journal of Computing