Leapmotion for Wimp Based Interfaces

PrintPrint
English
Type: 
Master, Doctorate and Post-Doctorate
Main researcher: 
Jorge C. S. Cardoso
Team elements (%affectation): 
Manuel Seixas (100%)
Abstract: 

The LeapMotion controller is a new 3d sensing device for hand gesture interaction with a computer. It is capable of sensing the position and orientation of the fingers of both hands, as well as the palm orientation and curvature. It is meant to be placed on the desktop and operated by positioning the hands over the device.
The controller can be used to point to a computer screen with a finger or with a tool (a pen or pencil, for example).
The LeapMotion is often depicted as a superior alternative to the computer mouse for various non-WIMP interaction tasks, but it has also been used for standard WIMP operations. The purpose of the proposed work is to study the usage of the LeapMotion for WIMP interfaces.

Objectives: 
  • Characterize the LeapMotion pointing movement using [MacKenzie et al.] measures and compare it to a standard mouse movement.
  • Compare the speed and accuracy of different selection techniques (different gestures for selecting objects)
  • Propose concrete interaction techniques for standard WIMP tasks such as menu selection, click and drag, etc., and analyze their performance.
Activities: 

Março 2014 - Julho 2014

Results: 

Tese de Mestrado: Manuel Seixas (2014) "Leap Motion para interfaces baseadas em WIMP". Master Thesis, FEUP - University of Porto.

Software: Leap Motion pointing movement evaluation software: https://github.com/jorgecardoso/leapmotionstudy

Software: Leap Motion pointing movement analysis scripts: https://github.com/jorgecardoso/leapmotionstudy-rscripts

Artigo: Seixas, M. C. B., Cardoso, J. C. S., & Dias, M. T. G. (2015). The Leap Motion Movement for 2D Pointing Tasks - Characterisation and Comparison to Other Devices. In "Proceedings of the 5th International Conference on Pervasive and Embedded Computing and Communication Systems", (pp. 15–24). SCITEPRESS Science and Technology Publications | doi:10.5220/0005206100150024

Artigo: Seixas, M. C. B., Cardoso, J. C. S., & Dias, M. T. G. (2015). One Hand or Two Hands? 2D Selection Tasks With the Leap Motion Device. In "ACHI 2015: The Eighth International Conference on Advances in Computer - Human Interactions" (pp. 33–38). Lisbon, Portugal, Portugal: IARIA.

State: 
Ongoing
Research group: 
Visual and Interactive Art
Summary: 

The LeapMotion controller is a new 3d sensing device for hand gesture interaction with a computer. It is capable of sensing the position and orientation of the fingers of both hands, as well as the palm orientation and curvature. It is meant to be placed on the desktop and operated by positioning the hands over the device. The controller can be used to point to a computer screen with a finger or with a tool (a pen or pencil, for example).
03/2014 to 07/2014