ISMAR 2023 Workshop on "Hybrid User Interfaces"

Workshop Results: Literature Survey Published

The results of this workshop have lead to a literature survey, which has now been published in IEEE Transactions on Visualization and Computer Graphics (TVCG) and is available as open access:

Hybrid User Interfaces: Past, Present, and Future of Complementary Cross-Device Interaction in Mixed Reality (DOI: 10.1109/TVCG.2026.3683941)

The article investigates hybrid user interfaces to establish a cohesive understanding and consistent terminology for this emerging field. It focuses on cross-device interaction between conventional 2D devices and mixed reality environments, highlighting how complementary device roles can combine familiarity, spatial awareness, and immersion. Based on a systematic survey, we present a taxonomy of HUIs and discuss historical and current challenges, the evolution of definitions, and future opportunities that connect three decades of prior work to a forward-looking research agenda.

We thank all workshop participants for their valuable contributions and discussions that have led to the insights presented in this article.

Call for Participation

Hybrid user interfaces combine the visual and interaction spaces of complementary device technologies (such as augmented reality headsets and handheld devices) to take advantage of the strong points of each. The simultaneous use of multiple interactive devices with input and output capabilities offers a large design space for novel interaction techniques that can be applied to a wide range of application scenarios. Given the challenges presented by augmented and virtual reality head-worn displays, there has been an increasing research interest in hybrid user interfaces that combine augmented reality headsets with traditional devices such as smartphones, tablets, and desktop computers. However, prior research shows a fragmented landscape with inconsistencies in terminology, models, and technologies within this space and overlapping research streams such as cross-device interaction and distributed user interfaces. We invite academics, designers, and practitioners to help create a common understanding and explore the opportunities and challenges of hybrid user interfaces, thereby generating a research agenda for this nascent space.

Topics

Relevant topics with regard to hybrid user interfaces include, but are not limited to:

• Establishing a taxonomy of hybrid user interfaces by disseminating and discussing prior research
• Exploring application areas for hybrid user interfaces
• Investigating potential challenges and opportunities in the design, use, and evaluation of hybrid user interfaces
• Discussing novel interaction techniques that are enabled through the use of hybrid user interfaces
• Examining the use of transitional interfaces for hybrid user interfaces
• Creating a roadmap to guide future research in the area of hybrid user interfaces

Submission

We invite the submission of position papers (2-4 pages), video showcases (3-5 minutes video and 1-2 pages abstract), or interactive demos (1-2 pages abstract, in-person participation required) in the IEEE Computer Society VGTC format to submission@hybrid-ui-workshop.io. We welcome contributions that are visionary, challenge existing definitions, or investigate new perspectives. The organizers will review submissions based on their quality, originality, and relevance to the workshop. Accepted submissions will be published with a DOI and citable link in the ISMAR 2023 adjunct proceedings and IEEE Xplore. Upon acceptance, at least one author of each submission must attend the workshop (i.e., register for the workshop and at least one day of the ISMAR 2023 conference) and will be expected to briefly present their work.

Submissions should not be anonymized and references do not count towards the page limit. When submitting your work to submission@hybrid-ui-workshop.io, please clearly indicate if - upon acceptance of your submission - you plan to attend in person or remotely.

Important Dates

Organizers

Sebastian Hubenschmid

University of Konstanz

Johannes Zagermann

University of Konstanz

Raimund Dachselt

Technische Universität Dresden

Niklas Elmqvist

Aarhus University

Steven Feiner

Columbia University

Tiare Feuchtner

University of Konstanz

Benjamin Lee

University of Stuttgart

Harald Reiterer

University of Konstanz

Dieter Schmalstieg

Graz University of Technology

Program

Due to the significant amount of remote participants from Europe, the workshop will be split into an earlier remote-only workshop and a hybrid workshop in Sydney, Australia. Participants of the remote-only workshop will be able to join the hybrid workshop in Sydney for the keynote by Steven Feiner and are welcome to stay for the hybrid workshop. We will include asynchronous activities before and after the actual workshop event to facilitate discussions between the remote-only and hybrid workshop participants.

Remote-Only Workshop

Hybrid Workshop (Sydney, Australia)

Proceedings (Preprints)