DataSys 2020 Congress
September 27, 2020 to October 01, 2020 - Lisbon, Portugal

  • AICT 2020, The Sixteenth Advanced International Conference on Telecommunications
  • ICIW 2020, The Fifteenth International Conference on Internet and Web Applications and Services
  • ICIMP 2020, The Fifteenth International Conference on Internet Monitoring and Protection
  • SMART 2020, The Ninth International Conference on Smart Cities, Systems, Devices and Technologies
  • IMMM 2020, The Tenth International Conference on Advances in Information Mining and Management
  • INFOCOMP 2020, The Tenth International Conference on Advanced Communications and Computation
  • MOBILITY 2020, The Tenth International Conference on Mobile Services, Resources, and Users
  • SPWID 2020, The Sixth International Conference on Smart Portable, Wearable, Implantable and Disability-oriented Devices and Systems
  • ACCSE 2020, The Fifth International Conference on Advances in Computation, Communications and Services

InfoSys 2020 Congress
September 27, 2020 to October 01, 2020 - Lisbon, Portugal

  • ICNS 2020, The Sixteenth International Conference on Networking and Services
  • ICAS 2020, The Sixteenth International Conference on Autonomic and Autonomous Systems
  • ENERGY 2020, The Tenth International Conference on Smart Grids, Green Communications and IT Energy-aware Technologies
  • WEB 2020, The Eighth International Conference on Building and Exploring Web Based Environments
  • DBKDA 2020, The Twelfth International Conference on Advances in Databases, Knowledge, and Data Applications
  • SIGNAL 2020, The Fifth International Conference on Advances in Signal, Image and Video Processing
  • BIOTECHNO 2020, The Twelfth International Conference on Bioinformatics, Biocomputational Systems and Biotechnologies

SoftNet 2020 Congress
October 18, 2020 to October 22, 2020 - Porto, Portugal

  • ICSEA 2020, The Fifteenth International Conference on Software Engineering Advances
  • ICSNC 2020, The Fifteenth International Conference on Systems and Networks Communications
  • CENTRIC 2020, The Thirteenth International Conference on Advances in Human-oriented and Personalized Mechanisms, Technologies, and Services
  • VALID 2020, The Twelfth International Conference on Advances in System Testing and Validation Lifecycle
  • SIMUL 2020, The Twelfth International Conference on Advances in System Simulation
  • SOTICS 2020, The Tenth International Conference on Social Media Technologies, Communication, and Informatics
  • INNOV 2020, The Ninth International Conference on Communications, Computation, Networks and Technologies
  • HEALTHINFO 2020, The Fifth International Conference on Informatics and Assistive Technologies for Health-Care, Medical Support and Wellbeing

InfoWare 2020 Congress
October 18, 2020 to October 22, 2020 - Porto, Portugal

  • ICCGI 2020, The Fifteenth International Multi-Conference on Computing in the Global Information Technology
  • ICWMC 2020, The Sixteenth International Conference on Wireless and Mobile Communications
  • VEHICULAR 2020, The Ninth International Conference on Advances in Vehicular Systems, Technologies and Applications
  • INTERNET 2020, The Twelfth International Conference on Evolving Internet
  • COLLA 2020, The Tenth International Conference on Advanced Collaborative Networks, Systems and Applications
  • INTELLI 2020, The Ninth International Conference on Intelligent Systems and Applications
  • VISUAL 2020, The Fifth International Conference on Applications and Systems of Visual Paradigms
  • HUSO 2020, The Sixth International Conference on Human and Social Analytics
  • BRAININFO 2020, The Fifth International Conference on Neuroscience and Cognitive Brain Information

NexTech 2020 Congress
October 25, 2020 to October 29, 2020 - Nice, France

  • UBICOMM 2020, The Fourteenth International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies
  • ADVCOMP 2020, The Fourteenth International Conference on Advanced Engineering Computing and Applications in Sciences
  • SEMAPRO 2020, The Fourteenth International Conference on Advances in Semantic Processing
  • AMBIENT 2020, The Tenth International Conference on Ambient Computing, Applications, Services and Technologies
  • EMERGING 2020, The Twelfth International Conference on Emerging Networks and Systems Intelligence
  • DATA ANALYTICS 2020, The Ninth International Conference on Data Analytics
  • GLOBAL HEALTH 2020, The Ninth International Conference on Global Health Challenges
  • CYBER 2020, The Fifth International Conference on Cyber-Technologies and Cyber-Systems

ComputationWorld 2020 Congress
October 25, 2020 to October 29, 2020 - Nice, France

  • SERVICE COMPUTATION 2020, The Twelfth International Conference on Advanced Service Computing
  • CLOUD COMPUTING 2020, The Eleventh International Conference on Cloud Computing, GRIDs, and Virtualization
  • FUTURE COMPUTING 2020, The Twelfth International Conference on Future Computational Technologies and Applications
  • COGNITIVE 2020, The Twelfth International Conference on Advanced Cognitive Technologies and Applications
  • ADAPTIVE 2020, The Twelfth International Conference on Adaptive and Self-Adaptive Systems and Applications
  • CONTENT 2020, The Twelfth International Conference on Creative Content Technologies
  • PATTERNS 2020, The Twelfth International Conference on Pervasive Patterns and Applications
  • COMPUTATION TOOLS 2020, The Eleventh International Conference on Computational Logics, Algebras, Programming, Tools, and Benchmarking
  • BUSTECH 2020, The Tenth International Conference on Business Intelligence and Technology

NetWare 2020 Congress
November 15, 2020 to November 19, 2020 - Valencia, Spain

  • SENSORCOMM 2020, The Fourteenth International Conference on Sensor Technologies and Applications
  • SENSORDEVICES 2020, The Eleventh International Conference on Sensor Device Technologies and Applications
  • SECURWARE 2020, The Fourteenth International Conference on Emerging Security Information, Systems and Technologies
  • AFIN 2020, The Twelfth International Conference on Advances in Future Internet
  • CENICS 2020, The Thirteenth International Conference on Advances in Circuits, Electronics and Micro-electronics
  • ICQNM 2020, The Fourteenth International Conference on Quantum, Nano/Bio, and Micro Technologies
  • FASSI 2020, The Sixth International Conference on Fundamentals and Advances in Software Systems Integration
  • GREEN 2020, The Fifth International Conference on Green Communications, Computing and Technologies

DigitalWorld 2020 Congress
November 21, 2020 to November 25, 2020 - Valencia, Spain

  • ICDS 2020, The Fourteenth International Conference on Digital Society
  • ACHI 2020, The Thirteenth International Conference on Advances in Computer-Human Interactions
  • GEOProcessing 2020, The Twelfth International Conference on Advanced Geographic Information Systems, Applications, and Services
  • eTELEMED 2020, The Twelfth International Conference on eHealth, Telemedicine, and Social Medicine
  • eLmL 2020, The Twelfth International Conference on Mobile, Hybrid, and On-line Learning
  • eKNOW 2020, The Twelfth International Conference on Information, Process, and Knowledge Management
  • ALLSENSORS 2020, The Fifth International Conference on Advances in Sensors, Actuators, Metering and Sensing
  • SMART ACCESSIBILITY 2020, The Fifth International Conference on Universal Accessibility in the Internet of Things and Smart Environments

 


ThinkMind // ACHI 2017, The Tenth International Conference on Advances in Computer-Human Interactions // View article achi_2017_1_40_20089


Sonification of 3D Object Shape for Sensory Substitution: An Empirical Exploration

Authors:
Torkan Gholamalizadeh
Hossein Pourghaemi
Ahmad Mhaish
Gökhan İnce
Damien Jade Duff

Keywords: Sensory substitution; sensory augmentation; point clouds; depth cameras; sound synthesis

Abstract:
An empirical investigation is presented of different approaches to sonification of 3D objects as a part of a sensory substitution system. The system takes 3D point clouds of objects obtained from a depth camera and presents them to a user as spatial audio. Two approaches to shape sonification are presented and their characteristics investigated. The first approach directly encodes the contours belonging to the object in the image as sound waveforms. The second approach categorizes the object according to its 3D surface properties as encapsulated in the rotation invariant Fast Point Feature Histogram (FPFH), and each category is represented by a different synthesized musical instrument. Object identification experiments are done with human users to evaluate the ability of each encoding to transmit object identity to a user. Each of these approaches has their disadvantages. Although the FPFH approach is more invariant to object pose and contains more information about the object, it lacks generality because of the intermediate recognition step. On the other, since contour based approach has no information about depth and curvature of objects, it fails in identifying different objects with similar silhouettes. On the task of distinguishing between 10 different 3D shapes, the FPFH approach produced more accurate responses. However, the fact that it is a direct encoding means that the contour-based approach is more likely to scale up to a wider variety of shapes.

Pages: 18 to 24

Copyright: Copyright (c) IARIA, 2017

Publication date: March 19, 2017

Published in: conference

ISSN: 2308-4138

ISBN: 978-1-61208-538-8

Location: Nice, France

Dates: from March 19, 2017 to March 23, 2017

SERVICES CONTACT
2010 - 2017 © ThinkMind. All rights reserved.
Read Terms of Service and Privacy Policy.