Please use this identifier to cite or link to this item: http://dx.doi.org/10.18419/opus-13783
|Usable and fast interactive mental face reconstruction
|ACM Symposium on User Interface Software and Technology (36th, 2023, San Francisco, Calif.)
|UIST '23 : proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. New York, NY : ACM, 2023. - ISBN 979-8-4007-0132-0, Article no. 99
|We introduce an end-to-end interactive system for mental face reconstruction - the challenging task of visually reconstructing a face image a person only has in their mind. In contrast to existing methods that suffer from low usability and high mental load, our approach only requires the user to rank images over multiple iterations according to the perceived similarity with their mental image. Based on these rankings, our mental face reconstruction system extracts image features in each iteration, combines them into a joint feature vector, and then uses a generative model to visually reconstruct the mental image. To avoid the need for collecting large amounts of human training data, we further propose a computational user model that can simulate human ranking behaviour using data from an online crowd-sourcing study (N=215). Results from a 12-participant user study show that our method can reconstruct mental images that are visually similar to existing approaches but has significantly higher usability, lower perceived workload, and is faster. In addition, results from a third 22-participant lineup study in which we validated our reconstructions on a face ranking task show a identification rate of , which is in line with prior work. These results represent an important step towards new interactive intelligent systems that can robustly and effortlessly reconstruct a user’s mental image.
|Appears in Collections:
|05 Fakultät Informatik, Elektrotechnik und Informationstechnik
Files in This Item:
Items in OPUS are protected by copyright, with all rights reserved, unless otherwise indicated.