One of our project's main goals is to enhance the user experience when using kiosks. We want to change how users interact with kiosks by replacing touch-based controls with touchless technology. This change may be difficult for some users, so we aim to make the transition as easy as possible by designing the user interface in a user-friendly manner. We worked on this throughout the project, making improvements and adjustments along the way.

Our project consists of two UI components:
-> Kiosk Web-Extension (used by the end-user).
-> Kiosk Backend Launcher (used by the admin to start the software).

When designing the input for the kiosk, we had three major concerns. As our project aimed to solve accessibility issues, we wanted to ensure that the gestures required were not too difficult to achieve in terms of amplitude and finesse. At the same time, the gestures needed to be recognizable enough to avoid frequent misidentification. Lastly, we wanted to prevent user frustration.

To address these concerns, we decided to map common touching interactions with MI gestures. For example, in hand gesture mode, finger swipe was replaced by hand swipe movement, and clicking was replaced by clicking in the air. By using similarities between these gestures and their counterparts, we believe we can reduce user frustration when adapting to the new UI of the kiosk.

Our original intent was to not make any additions to the original kiosk GUI once the application was launched, to minimize interference with kiosk users. However, during one of our tests, we found that the interaction was painful. Unlike when using their hands directly, users would need feedback from the kiosk to track their own gestures. We decided to show an abstract hand image together with the checking thresholds of the MI in the corner of the screen, to help users notice and understand how the UI works. Since most kiosks will have blank spaces on their GUI, we felt that this addition to the original GUI was acceptable.