Interaction Abstraction Toolkit for Public Display Applications

PrintPrint
English
Type: 
Master, Doctorate and Post-Doctorate
Main researcher: 
Jorge S. Cardoso
Abstract: 

This project was developed in the course of a PhD program of the University of Minho.

Public, digital displays have become increasingly ubiquitous in our technological landscape, but they are still under-exploited. Considering their flexibility and communication potential, public displays can become an important communication channel in the future and even reach the attention, usage and relevance that smartphones have today.
For that to happen, however, there are several aspects that need improvement, and interactivity is one of the most important.
Only by thinking about and designing new, engaging, and relevant interactions with public displays we can raise their value in our societies. Currently, interaction with public displays is still in its infancy and faces similar problems to the ones that desktop computing faced in its early days.

Currently, every interactive display is implemented from scratch, resulting in wasted effort and heterogeneous interaction models that can only confuse users. Without accepted interaction paradigms and interaction abstractions, we are trapped in an ad-hoc, low-level, development mode that inhibits creativity.

The current work tries to accomplish two main things. The first is to bring some structure to the area of interactive public displays by analysing the current state of the art in interactive public displays, characterizing the type of interactions that have been created, and defining higher-level interaction abstractions for public display applications. We argue that this can better help us think about, and communicate, interaction with public displays. The second is to characterise the interaction environment surrounding public displays, extract design requirements for an interaction abstraction toolkit, and design and develop a programming toolkit built around those requirements and the previously identified abstractions. By making this toolkit publicly available, we hope to promote the development of more and newer kinds of interactive public display applications inside and, more importantly, outside the research community.

Objectives: 

The general objective of this work is to develop high-level interaction abstractions and tools for public display applications, that support public, shared, remote interaction, abstracting the low-level details of various input mechanisms.

An important aspect of this research is the focus on applications for public displays. Our goal is that the developed abstractions contribute to the emergence of open display networks.

Ideally, applications should be as much as possible agnostic of the concrete interaction mechanisms available in a particular display. This general goal can be further refined in the following objectives.

Analysis of public display interaction from the point of view of the information that is left behind and that may be used as the basis for several types of content adaptation behaviour on public displays. This analysis should result in a framework that maps digital footprints and adaptation strategies that can be used to create more relevant displays that are able to automatically adapt to their environment.

This mapping can be used by situated display designers to help choose the interaction mechanisms that a display should support in order to be able to collect a given set of footprints.

Identification and characterisation of the interaction tasks and controls that are appropriate for public display interaction. This should result in a design space of interaction tasks and controls that can form the basis of an abstractions toolkit, giving system developers with a reference for the types of high-level tasks and controls that can be incorporated into a toolkit.

Design, implementation, and evaluation of a software toolkit of interaction abstractions that programmers can use for incorporating interactive features into public display applications.

Activities: 

Septembre 2008 - Septembre 2013
Sponsored: FCT training grant SFRH/BD/47354/2008

Results: 

Website: http://purewidgets.org

Publicações:

Cardoso, J.C.S. 2014. Dynamic graphical user interface generation for web-based public display applications. Proceedings of the 4th International Conference on Pervasive and Embedded Computing and Communication Systems - PECCS 2014 (2014). (to appear)

Cardoso, J.C.S. and Rui José 2013. Evaluation of a programming toolkit for interactive public display applications. Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia - MUM ’13 (Lulea, Sweden, Sweden, 2013). (to appear)

Taivan, C. et al. 2013. Design considerations for application selection and control in multi-user public displays. JUCS special issue: Towards Sustainable Computing through Ambient Intelligence. (2013). (to appear)

José, R. et al. 2013. Mobile applications for open display networks: common design considerations. Proceedings of the 2nd ACM International Symposium on Pervasive Displays -- PerDis ’13 (Jun. 2013), 97–102.

Cardoso, J. C. S., & José, R. (2012). Creating web-based interactive public display applications with the PuReWidgets toolkit. Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia. Ulm, Germany.

Cardoso, J. C. S., & José, R. (2012). PuReWidgets: A programming toolkit for interactive public display applications. Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems. Copenhagen, Denmark: ACM.

Cardoso, J. C. S., & José, R. (2012). The PuReWidgets Toolkit for Interactive Public Display Applications. The International Symposium on Pervasive Displays. Porto.

Cardoso, J. C. S., & José, R. (2011). Assessing Feedback for Indirect Shared Interaction with Public Displays. In R. Meersman, T. Dillon, & P. Herrero (Eds.), On the Move to Meaningful Internet Systems: OTM 2011 Workshops (Vol. 7046, pp. 553-561). Springer Berlin / Heidelberg. doi:10.1007/978-3-642-25126-9_67

Jose, R., & Cardoso, J. C. S. (2011). Opportunities and Challenges of Interactive Public Displays as an Advertising Medium. In J. Mueller, F. Alt, & D. E. Michelis (Eds.), Pervasive Advertising (pp. 139-157). Springer-Verlag London Limited. doi:10.1007/978-0-85729-352-7_7

Cardoso, J. C. S., & Jose, R. (2009). A Framework for Context-Aware Adaptation in Public Displays. In R. Meersman, P. Herrero, & T. Dillon (Eds.), On the Move to Meaningful Internet Systems: OTM 2009 Workshops (Vol. 5872/2009, pp. 118-127). Vilamoura, Portugal: Springer Berlin / Heidelberg. doi:10.1007/978-3-642-05290-3_21

 

State: 
Finalized
Research group: 
Visual and Interactive Art
Summary: 

Public, digital displays have become increasingly ubiquitous in our technological landscape, but they are still under-exploited. Considering their flexibility and communication potential, public displays can become an important communication channel in the future and even reach the attention, usage and relevance that smartphones have today.
09/2008 to 09/2013