Please use this identifier to cite or link to this item: http://dx.doi.org/10.18419/opus-13783
Authors: Strohm, Florian
Bâce, Mihai
Bulling, Andreas
Title: Usable and fast interactive mental face reconstruction
Issue Date: 2023
metadata.ubs.publikation.typ: Konferenzbeitrag
metadata.ubs.konferenzname: ACM Symposium on User Interface Software and Technology (36th, 2023, San Francisco, Calif.)
metadata.ubs.publikation.source: UIST '23 : proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. New York, NY : ACM, 2023. - ISBN 979-8-4007-0132-0, Article no. 99
URI: http://nbn-resolving.de/urn:nbn:de:bsz:93-opus-ds-138026
http://elib.uni-stuttgart.de/handle/11682/13802
http://dx.doi.org/10.18419/opus-13783
ISBN: 979-8-4007-0132-0
Abstract: We introduce an end-to-end interactive system for mental face reconstruction - the challenging task of visually reconstructing a face image a person only has in their mind. In contrast to existing methods that suffer from low usability and high mental load, our approach only requires the user to rank images over multiple iterations according to the perceived similarity with their mental image. Based on these rankings, our mental face reconstruction system extracts image features in each iteration, combines them into a joint feature vector, and then uses a generative model to visually reconstruct the mental image. To avoid the need for collecting large amounts of human training data, we further propose a computational user model that can simulate human ranking behaviour using data from an online crowd-sourcing study (N=215). Results from a 12-participant user study show that our method can reconstruct mental images that are visually similar to existing approaches but has significantly higher usability, lower perceived workload, and is faster. In addition, results from a third 22-participant lineup study in which we validated our reconstructions on a face ranking task show a identification rate of , which is in line with prior work. These results represent an important step towards new interactive intelligent systems that can robustly and effortlessly reconstruct a user’s mental image.
Appears in Collections:05 Fakultät Informatik, Elektrotechnik und Informationstechnik

Files in This Item:
File Description SizeFormat 
Usable_and_Fast_Interactive_Mental_Face_Reconstruction__UIST_2023.pdf20,81 MBAdobe PDFView/Open


Items in OPUS are protected by copyright, with all rights reserved, unless otherwise indicated.