NexTech 2021 Congress
October 03, 2021 to October 07, 2021 - Barcelona, Spain

  • UBICOMM 2021, The Fifteenth International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies
  • ADVCOMP 2021, The Fifteenth International Conference on Advanced Engineering Computing and Applications in Sciences
  • SEMAPRO 2021, The Fifteenth International Conference on Advances in Semantic Processing
  • AMBIENT 2021, The Eleventh International Conference on Ambient Computing, Applications, Services and Technologies
  • EMERGING 2021, The Thirteenth International Conference on Emerging Networks and Systems Intelligence
  • DATA ANALYTICS 2021, The Tenth International Conference on Data Analytics
  • GLOBAL HEALTH 2021, The Tenth International Conference on Global Health Challenges
  • CYBER 2021, The Sixth International Conference on Cyber-Technologies and Cyber-Systems

SoftNet 2021 Congress
October 03, 2021 to October 07, 2021 - Barcelona, Spain

  • ICSEA 2021, The Sixteenth International Conference on Software Engineering Advances
  • ICSNC 2021, The Sixteenth International Conference on Systems and Networks Communications
  • CENTRIC 2021, The Fourteenth International Conference on Advances in Human-oriented and Personalized Mechanisms, Technologies, and Services
  • VALID 2021, The Thirteenth International Conference on Advances in System Testing and Validation Lifecycle
  • SIMUL 2021, The Thirteenth International Conference on Advances in System Simulation
  • SOTICS 2021, The Eleventh International Conference on Social Media Technologies, Communication, and Informatics
  • INNOV 2021, The Tenth International Conference on Communications, Computation, Networks and Technologies
  • HEALTHINFO 2021, The Sixth International Conference on Informatics and Assistive Technologies for Health-Care, Medical Support and Wellbeing

NetWare 2021 Congress
November 14, 2021 to November 18, 2021 - Athens, Greece

  • SENSORCOMM 2021, The Fifteenth International Conference on Sensor Technologies and Applications
  • SENSORDEVICES 2021, The Twelfth International Conference on Sensor Device Technologies and Applications
  • SECURWARE 2021, The Fifteenth International Conference on Emerging Security Information, Systems and Technologies
  • AFIN 2021, The Thirteenth International Conference on Advances in Future Internet
  • CENICS 2021, The Fourteenth International Conference on Advances in Circuits, Electronics and Micro-electronics
  • ICQNM 2021, The Fifteenth International Conference on Quantum, Nano/Bio, and Micro Technologies
  • FASSI 2021, The Seventh International Conference on Fundamentals and Advances in Software Systems Integration
  • GREEN 2021, The Sixth International Conference on Green Communications, Computing and Technologies

TrendNews 2021 Congress
November 14, 2021 to November 18, 2021 - Athens, Greece

  • CORETA 2021, Advances on Core Technologies and Applications
  • DIGITAL 2021, Advances on Societal Digital Transformation

 


ThinkMind // COGNITIVE 2019, The Eleventh International Conference on Advanced Cognitive Technologies and Applications // View article cognitive_2019_3_30_40042


Multimodal Interactions Viewed as Dual Process on Multi-Dimensional Memory Frames Under Weak Synchronization

Authors:
Muneo Kitajima
Jéôme Dinet
Makoto Toyota

Keywords: Dual process; Multimodal interaction, Two Minds, Multi-dimensional memory frames; Weak synchronization; Time scale of human action

Abstract:
Behavior of users interacting with multimodal interfaces looks complex because the degrees of freedom of sensory input and motor output is large. This paper suggests that this complexity can be alleviated by applying the Simon’s ant metaphor to the multimodal interaction situations, i.e., “What users do is simple. 1) they use perceptual input to generate a mirror image of the real world surrounding the self to be shared in conscious and unconscious processes, 2) they select next actions by consciously planning ahead and unconsciously tuning motor movements for the event to happen, and after performing the action, they unconsciously modify the participated neural network and consciously reflect on the result of action, and 3) they perform 1 and 2 in synchronous with the ever-changing external environment, which this paper calls “weak synchronization.” A cognitive architecture, Model Human Processor with Realtime Constraints (MHP/RT) and its associated memory structure, Multi-Dimensional Memory Frames, developed by the authors is briefly introduced considering the situation of users interacting with multimodal environment. Then, the above three items are derived as the essential principles for organizing user’s behavior in multimodal interaction environment. Future work on designing mixed reality multimodal interaction environment is introduced that has its basis on the perspectives for multimodal interactions this paper claims.

Pages: 44 to 51

Copyright: Copyright (c) IARIA, 2019

Publication date: May 5, 2019

Published in: conference

ISSN: 2308-4197

ISBN: 978-1-61208-705-4

Location: Venice, Italy

Dates: from May 5, 2019 to May 9, 2019

SERVICES CONTACT
2010 - 2017 © ThinkMind. All rights reserved.
Read Terms of Service and Privacy Policy.