Multimodal interaction provides the user with multiple modes of interacting with a system. A multimodal interface provides several distinct tools for...
31 KB (5,160 words) - 15:55, 14 March 2024
Multimodal learning is a type of deep learning that integrates and processes multiple types of data, referred to as modalities, such as text, audio, images...
9 KB (2,338 words) - 08:44, 24 October 2024
with multiple peaks Multimodal interaction, a form of human-machine interaction using multiple modes of input/output Multimodal therapy, an approach...
837 bytes (146 words) - 20:04, 4 April 2025
Human-computer Interaction. Berkshire Publishing Group LLC. p. 483. ISBN 9780974309125. Grifoni, Patrizia (2009). Multimodal Human Computer Interaction and Pervasive...
8 KB (882 words) - 20:16, 29 March 2025
Multimodal sentiment analysis is a technology for traditional text-based sentiment analysis, which includes modalities such as audio and visual data. It...
15 KB (1,687 words) - 15:48, 18 November 2024
Interaction design, often abbreviated as IxD, is "the practice of designing interactive digital products, environments, systems, and services.": xxvii...
22 KB (2,213 words) - 22:52, 22 April 2025
Gemini (language model) (category Multimodal interaction)
Gemini is a family of multimodal large language models developed by Google DeepMind, and the successor to LaMDA and PaLM 2. Comprising Gemini Ultra, Gemini...
52 KB (4,226 words) - 20:15, 19 April 2025
Multimodality is the application of multiple literacies within one medium. Multiple literacies or "modes" contribute to an audience's understanding of...
71 KB (9,189 words) - 00:13, 12 April 2025
detection Haptic technology Human–computer interaction Interactive Systems Engineering Multimodal interaction Natural-language understanding Telematics...
55 KB (6,457 words) - 17:33, 18 April 2025
W3C MMI (category Multimodal interaction)
The Multimodal Interaction Activity is an initiative from W3C aiming to provide means (mostly XML) to support Multimodal interaction scenarios on the Web...
3 KB (308 words) - 00:19, 24 November 2023
report specifying a multimodal system architecture and its generic interfaces to facilitate integration and multimodal interaction management in a computer...
34 KB (3,852 words) - 16:11, 13 April 2025
The Interaction Design Foundation (IxDF) is an educational organization which produces open access educational materials online with the stated goal of...
7 KB (577 words) - 00:47, 20 August 2024
Large language model (redirect from Multimodal large language model)
multimodal, having the ability to also process or generate other types of data, such as images or audio. These LLMs are also called large multimodal models...
114 KB (11,942 words) - 05:35, 30 April 2025
A multimodal browser is one which allows multimodal interaction for input and/or output - for example, keyboard and voice interfaces. Examples include...
539 bytes (41 words) - 05:33, 26 March 2024
SCXML (section Multimodal applications)
support to VoiceXML). It could also be used as a multimodal control language in the Multimodal Interaction Activity. One of the goals of this language is...
7 KB (842 words) - 22:54, 22 December 2024
Huawei PanGu (category Multimodal interaction)
PanGu, PanGu-Σ or PanGu-π (Chinese: 盘古大模型; pinyin: pángǔ dà móxíng) is a multimodal large language model developed by Huawei. It was announced on July 7,...
12 KB (1,154 words) - 15:34, 31 March 2025
In interaction design, PACT (an acronym for People, Activities, Contexts, Technologies) is a structure used to analyse with whom, what and where a user...
2 KB (174 words) - 20:57, 1 August 2024
Wired glove (category Multimodal interaction)
called a dataglove or cyberglove) is an input device for human–computer interaction worn like a glove. Various sensor technologies are used to capture physical...
10 KB (1,215 words) - 20:36, 26 November 2024
Artificial human companion (category Multimodal interaction)
Seniors typically watch TV to avoid loneliness; yet TV limits social interaction, thus creating a vicious circle. In 2012 Judith Masthoff, a professor...
12 KB (1,500 words) - 09:06, 24 April 2025
Sensorama (category Multimodal interaction)
the earliest known examples of immersive, multi-sensory (now known as multimodal) technology. This technology, which was introduced in 1962 by Morton Heilig...
4 KB (486 words) - 12:16, 26 May 2024
Memex (category Multimodal interaction)
lasting effect in stimulating others." The pioneer of human–computer interaction Douglas Engelbart was inspired by Bush's proposal for a co-evolution...
20 KB (2,586 words) - 22:43, 20 March 2025
Conference on Human–robot interaction HCII: Human–Computer Interaction International ICMI: International Conference on Multimodal Interfaces ITS: ACM conference...
49 KB (5,656 words) - 06:25, 29 April 2025
Computer-mediated reality (category Multimodal interaction)
devices are often used with mediated reality. With the use of EyeTap, such interaction is called "seeing eye-to-eye". Applications of mediated reality include...
15 KB (1,680 words) - 07:35, 21 April 2025
Palanque, P., and Porcher Nedel, L. 2003. Formal description of a multimodal interaction technique in an immersive virtual reality application. In Proceedings...
11 KB (1,382 words) - 05:34, 22 January 2025
Videoplace (category Multimodal interaction)
In the mid-1970s, Myron Krueger established an artificial reality laboratory called the Videoplace. His idea with the Videoplace was the creation of an...
3 KB (388 words) - 21:41, 5 October 2024
Mixed reality (category Multimodal interaction)
Computer-mediated reality Extended reality Mixed reality games Multimodal interaction Simulated reality Cosco, F.; Garre, C.; Bruno, F.; Muzzupappa, M...
38 KB (4,244 words) - 23:24, 22 April 2025
Automatic identification and data capture (category Multimodal interaction)
Automatic identification and data capture (AIDC) refers to the methods of automatically identifying objects, collecting data about them, and entering them...
10 KB (1,170 words) - 09:36, 20 March 2024
contributions to multimodal interaction. In 2015, he received the ACM ICMI Sustained Accomplishment Award for contributions to multimodal interaction. His work...
50 KB (4,910 words) - 18:48, 4 February 2025
Virtual retinal display (category Multimodal interaction)
A virtual retinal display (VRD), also known as a retinal scan display (RSD) or retinal projector (RP), is a display technology that draws a raster display...
7 KB (825 words) - 04:23, 1 April 2025
Dialogue system (redirect from Multimodal conversational companion)
Bangalore, Srinivas, and Michael Johnston. "Robust understanding in multimodal interfaces." Computational Linguistics 35.3 (2009): 345-397. Lester, J...
14 KB (1,316 words) - 15:09, 9 July 2024