Reshaping ubiquitous interaction through sensory augmentation

Abstract

Current technological advances enable unprecedented approaches for aiding human perception through digital technologies. Powerful Sensory Augmentation becomes feasible. Our concept aims to improve the natural sensory capabilities of users while transcending the traditional interaction concept of tools. This approach promises to facilitate a more natural interaction with ubiquitous computers and support the enhancement of interaction with reality through computing machines. The goal of this research is to investigate the possibilities of this emerging paradigm and to provide a formal structure for future efforts in this field. In this thesis, we propose a definition for Sensory Augmentation and a design space to structure its study. We present a vision for its application to human activities and identify opportunities and challenges for the incorporation of Sensory Augmentation to human activities. Further, we report on three research probes that help investigate these opportunities and challenges, as well as users’ experiences and preferences for this technology. Each of these probes explores a specific area of augmentation, both assessing specific theoretical aspects of Sensory Augmentation and providing practical insights in the technical challenges posed by the development of applications. Additionally, we investigate and discuss the implications of augmenting the senses from the perspectives of users and society, focusing on benefits but also addressing the main foreseeable negative effects and possible strategies to minimize them. Finally, we present a design process for Sensory Augmentation applications alongside with practical recommendations and discuss future research directions of this new field.