Encore

The augmented reality piano tutor

Encore is a fun way of learning a new piece of music on the Piano, using visual and auditory cues to guide playing and speed up the development of muscle memory. Originally focused on self-taught musicians, the device can be used by pianists of any skill level and includes a series of introductory exercises for beginners.

The augmented reality glasses use an inbuilt camera and intelligent software in order to recognise and track points on the keyboard, it then overlays a graphical interface which the user can interact with through highlighted control keys. The device uses a microphone to identify which notes have been played and uses this data to give feedback.

The interface allows the user to engage in deliberate practice, selecting short sections, reducing the speed and playing with hands separately.
An accompanying mobile or web application allows users to search for new material from an online database of digital sheet music. The app also allows musicians to keep track of their progress with each piece and schedule practice sessions.

 

  • May 2015
  • Queen Mary, University of London
  • Augmented Reality