|
Lead Developer: Joshua Benjamin |
I've found this tutorial on
DirectMusic/DirectMidi extremely helpful. Essentially, our application will be an interface between
their tutorial app and the P5 glove. Infinite thanks to Carlos Jiménez de Parga for writing it.
The Gestural Music Interface is a control interface to manipulate real-time musical signals in a 3D virtual space, based on the P5's characteristics and finger bending. It's important to strongly stress that we intend to create an instrument, not develop software to emulate one, yet still be intuitive. The lack of an analogy should prove beneficial since there won't be a preexistent conflicting cognitive model.
Constraints by comparison: Wind and horn instruments use breath to control intensity, we can't do that. But for example, take a trumpet, location of the hand in relation to the body can completely replace the need for breath. Percussion/String instruments typically require two hands, we have only the use of the right hand for the perceptive instrument. No tactile feedback other than a desk or wall.
Physical Affordances by comparison: The glove detects motion in all dimensions of arm and wrist movement and has good precision of finger bending. Data provided via computer monitor can significantly help with feedback. Speakers will provide real-time sonification from movement as well. Though there is no left handed glove, the left hand will still be used to control modes or something via a keyboard or mouse.
Perceptual Affordances: A user should feel relatively comfortable with the system from the get-go since people already might drum their thumb on a table as a nervous habit, seen an orchestra conductor perform, have seen the movements to play a musical instrument before, etc. Instant audio feedback is analogous to musical instruments as well, though it should be noted that it may be confusing that the sound originates from speakers and not near the user's hand.
