demeTouch A New Approach to Human Music Interaction

1
demeTouchA New Approach to Human Music
Interaction

• Alexandre Fleury
• Masters thesis in Intelligent Multimedia
• Aalborg University 21st June 2007
• Supervisor Zheng-Hua Tan

2
Contents

• Music-color association
• Why associating pieces of music with colors?
• How are they mapped in demeTouch?
• How do users react?
• demeTouch music player
• What are the challenges, and the solutions?
• What does the player look like (after
  modification)?
• How can it be improved?
• Live demonstration
• Discussion

3
The music-color association

• Why associating music with colors?
• Personal audio libraries are increasing in size
• Classification process is time consuming and
  tedious
• Genres are difficult to get grips with

4
The music-color association

• How are they mapped in demeTouch?
• Using the HSV color space
• Acknowledged model
• Clearly distinguish its components
• Hue musical genre
• Saturation dynamic
• Value energy

5
The music-color association

• Mapping the hue
• Mapping the saturation
• Mapping the value

6
The music-color association

• How do users react?
• A questionnaire proposes three types of
  associations
• From a music style to a color
• From music features to color features
• From a mood to a fully defined color
• Results show that intuitively people are not used
  to associate music with color
• Educated users give much better results

7
demeTouch music player

• What are the challenges and solutions?
• Considering the tabletop constraints
• The area is split into active and display
• The visual elements are big
• Making the interface intuitive
• The actions associated with visual element are
  conventional
• The color chooser is well justified

8
demeTouch music player

• What does the player look like?
• A simple music player offering basic functions
• An efficient color selector to create playlists
• A simplified approach to the media library
• A colorful experience of music
• Recent modifications
• Display area is lit up in the current color
• Help is available at any time
• Minor bugs have been corrected

9
demeTouch music player

• How can it be improved?
• From a visual perspective
• Redesigning the components
• Proposing more information in the display area
• From a functional perspective
• Implementing a finger tracking function
• Making the audio equalizer work
• Offering a more consistent help section
• Users have to be trained

10
Live demonstration

• Conducted scenario
• Use the Player panel functions
• Create a color-based playlist and play it
• Choose some dynamic songs from the library and
  play them
• Free scenario
• Experience demeTouch

11
Discussion

• Thank you for your attention
• I hope you enjoyed your demeTouch experience