Please use this identifier to cite or link to this item:

Ubii: Physical World Interaction Through Augmented Reality

Authors Lin, Sikun HKUST affiliated (currently or previously)
Cheng, Haofei HKUST affiliated (currently or previously).
Li, Weikai HKUST affiliated (currently or previously)
Huang, Zhanpeng HKUST affiliated (currently or previously)
Hui, Pan View this author's profile
Peylo, Christoph
Issue Date 2017
Source IEEE Transactions on Mobile Computing , v. 16, (3), March 2017, article number 7469860, p. 872-885
Summary We describe a new set of interaction techniques that allow users to interact with physical objects through augmented reality (AR). Previously, to operate a smart device, physical touch is generally needed and a graphical interface is normally involved. These become limitations and prevent the user from operating a device out of reach or operating multiple devices at once. Ubii (Ubiquitous interface and interaction) is an integrated interface system that connects a network of smart devices together, and allows users to interact with the physical objects using hand gestures. The user wears a smart glass which displays the user interface in an augmented reality view. Hand gestures are captured by the smart glass, and upon recognizing the right gesture input, Ubii will communicate with the connected smart devices to complete the designated operations. Ubii supports common inter-device operations such as file transfer, printing, projecting, as well as device pairing. To improve the overall performance of the system, we implement computation offloading to perform the image processing computation. Our user test shows that Ubii is easy to use and more intuitive than traditional user interfaces. Ubii shortens the operation time on various tasks involving operating physical devices. The novel interaction paradigm attains a seamless interaction between the physical and digital worlds. © 2002-2012 IEEE.
ISSN 1536-1233
Language English
Format Article
Access View full-text via DOI
View full-text via Scopus
View full-text via Web of Science