Mo-Bi: Contextual Mobile Interfaces through Bimanual Posture Sensing with Wrist-Worn Devices

HCI Korea 2016, January 25–27, 2016, Jeongsun, Korea – Paper Presentation


Han-Jong Kim, Seijin Cha, Richard Chulwoo Park, Tek-Jin Nam, Woohun Lee, Geehyuk Lee


Using multiple sensor-embedded devices enables detection of usage contexts that extend new interaction opportunities (e.g., a gesture and posture composite interface). In this study, we explored a design space of contextual interactions using a mobile device and two wrist-worn devices, suggesting Mo-Bi, the bimanual posture-based mobile interface system. Mo-Bi recognizes a user’s hand posture compositely utilizing the spatial configurations of the three devices. It provides the contextually appropriate interface layout or application function according to the inference based on bimanual posture information. We suggested four interface scenarios of Mo-Bi that are applicable for common use applications in mobile context. A technical evaluation shows the feasibility of the system, and users found that Mo-Bi enhanced physical comfort and stability, providing interfaces that fit their context without increasing interaction steps for the adaptive interface.


Hand posture; context inference; wearable device; adaptive interface; wrist-worn device

ACM Classification

H.5.2. Information interfaces and presentation (e.g., HCI): User Interfaces.