MAPP - Multimodal Analysis of Piano Performance

PrintPrint
Português
Estado: 
Em curso
Grupo de investigacao: 
Computação Musical e Sonora
Tipologia: 
Mestrado, Doutoramento e Pós-Doutoramento
Investigador principal: 
Sofia Lourenço da Fonseca
Elementos da equipa (%afetação): 
André Baltazar, Luís Gustavo Martins, Ricardo Megre
Resumo: 

This project aims to objectively characterize representative performances by experienced pianists in order to determine main influential trends in performance, derived specifically from traditional piano practices referred to as National Piano Schools. Previous research (Lourenço, 2005) has shown strong musical correlation of particular characteristics, namely the aesthetic, the technical, the historic and the repertoire. Piano pedagogy literature of each European National Piano School has been analysed together with an empirical audio analysis of recordings through a check-list survey. Overall the main National Piano Schools consist of three essential branches: the Russian school; the French school; the German school. The identification of National Piano Schools provides a powerful framework of study and awareness of the main influential European music intangible heritage. Furthermore, as pianists use their whole body to enhance their communication of the music’s spiritual, emotional and dramatic essence, this project also aims to contribute into research on performance practice. This post-doctorate research addresses the topic of collecting extensive multimodal datasets of precise measurements from expressive performances by skilled musicians, representing the three identified European Piano Schools. This multimodal approach goes beyond traditional case studies, since it allows the correlation of data acquired from different sources with great potential for new insights on this specific study (i.e. characterizing Piano performance according to European Piano Schools). This will require the setup of sophisticated audio, MIDI, Video in order to acquire the different modalities involved in a live piano performance, and the subsequent storage of the captured information into databases. In order to accurately acquire the performance data according to the project specifications, UCP and CITAR- Research Center already has the required equipment, such as: MOCAP and an Acoustic Piano with MIDI triggering mechanism incorporated (Yamaha Disklavier). It follows up on previous research related with the use to study the performance style of famous artists who clearly represent each one of the identified European Piano Schools (Lourenço, 2005), and available in CD audio (or video footage) formats. However, this will depend on the availability of computational methods for precise music information extraction from audio signals, which is still an open research problem (Tzanetakis, 2004; Lagrange et al. 2008).

With this Data it is possible to analyze and process the acquired descriptors data mining computational models to in order to extract significant results from correlating the extensive multimodal datasets. The outcomes of this post-doctorate research project will be:

  1. A better understanding of the main influential European Piano Schools, provided by a new approach on the analysis (multi - modality) presenting new insights on these techniques, assisting performers by fostering the exploration of musical ideas.
  2. An openly available database of multimodal datasets from the performance of pianists, which complies with standards of indexation and storage formats widely used by the International Scientific Community.
  3. A proof of concept application available to demonstrate the potential for automatic determination of the dominant Piano Schools’ influence on Piano performance.
  4. A new framework for potential application design in areas such as Sonic Interaction Design, Content Based Recommendation Systems or Expressive Generative Music. In order to conduct this research follows a multi-disciplinary approach concerning issues of musicology, technology, computer science, biomechanics, cognitive psychology and performance practice.
  5. Edition of a book, organisation of international conference, website.
  6. Benefits musicians, music pedagogy, scientists, doctors.

 

 

Pianist Pedro Burmester during interview after MOCAP session.

Some results of pianist MOCAP sessions.

Some results of pianist MOCAP sessions.

Objetivos do projeto: 

Financiamento: Fundação para a Ciência e Tecnologia (FCT): SFRH/BPD/85498/2012

Atividades e calendario: 

Data de início: 1 de Setembro de 2013
Data de conclusão: 1 de Setembro de 2016

Sumario: 

This project aims to objectively characterize representative performances by experienced pianists in order to determine main influential trends in performance, derived specifically from traditional piano practices referred to as National Piano Schools.
09/2013 to 09/2016