Musical Trigger Gloves.

A Musical and Theoretical Interface.

 

Dave Corsie 1628876

 

MSc Audio Technology

7MU007  Musical Human-Computer Interaction 2016/17

 

 

The Initial Concept Idea

 

The original idea was to be able to play music without an instrument, using gloves with buttons/triggers/contacts on the ends of the fingers. These would be connected to a computer and pass signals to let the computer know what notes to play. The initial inspiration came from watching the progressive rock band Marillion in concert some years ago. The singer, Steve Hogarth, used a cricket bat to play keyboard sounds. This cricket bat had some triggers installed in it, and he had it slung around his neck, in the style of a guitar. The cricket bat was played with two hands, using one on the handle, and the other on the striking surface of the bat. Only a handful of triggers were used, and these set off pre-configured samples/arpeggios during the live concert. The use of a cricket bat on stage as an instrument caught my imagination, and shows that triggers can be installed in almost anything for a strong visual impact. Another inspiration came from watching Imogen Heap in concert at a WOMAD festival in 2010. Imogen uses a variety of high tech equipment in her music, which is mostly electronic vocal pop. Imogen has been in consultation with developers of the Mi.Mu gloves, and she was using a very early version in 2010. The gloves have been developed since then, and are now in production. They have been used by a variety of musical artists, including Ariana Grande on her 2015 world tour, as well as other performance artists and theatre practitioners. More information about the Mi.Mu gloves can be found here; http://mimugloves.com/

The Mi Mu gloves use sensors and gyroscopes to sense movement and direction, and this makes for a more visual experience, as the artist makes music using movement of the hands in air. Sounds and textures need to be pre-programmed, and then activated using the gloves. The concept for this project was entirely different.

 

The idea of the gloves was to be able to play in a more traditional sense, albeit without an instrument to hand. Triggers/sensors in the fingertips would tell the computer what notes to play, and a variety of ideas were tried in order to get the sensors to be pressure sensitive, enabling a more expressive performance. Instead of each fingertip corresponding to a set note, the idea was to have the left hand chose the key, or root of a chord, and the right hand play the degrees of the chord, ie root, third, fifth, seventh, etc. This would enable more choice of notes than the fingers could give using one note per finger. In order for there to be some more variation, sensors were also used on the palms, and when several sensors were used together, a full range of chromatic keys was made available on the left hand, while the degrees of the chord/key were triggered on the right hand.

 

 

 

Construction and Testing

 

In consultation with Mat Dalgleish, course leader, the original design for the sensors was to use pressure sensitive pads made from carbon impregnated foam. The idea was that as the foam was compressed, the voltage going through the pad would change, as more air is expelled, and the molecules get closer together, forming a stronger conductive medium. Initial tests showed that this concept could work, but the foam was not quite dense enough to give a wide signal variation, and therefore show much pressure variation. A variety of different thickness and density foams were tried, but there was not a strong enough or stable enough signal for this to be a practical proposition for this concept. 

 

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

Fig 1. Testing of foam pressure pad on end of finger.

 

 Unfortunately, the idea of pressure sensitive pads was abandoned at this stage, and conductive copper tape was introduced, which would give a strong electrical connection. The copper tape was tried in conjunction with the foam to see if a better connection could be established, but the results were still not stable enough or broad enough to give consistent or reliable results.

 

 

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

Figure 2. Testing of foam pressure pads with conductive copper tape.

 

 

Conductive thread was used to connect the pads, which was sewn into the gloves along the back of each finger, then terminated at the wrist. Wires were then attached to make a connection to the computer via an arduino circuit board.

 

 

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

Figure 3. Initial testing of copper tape.

 

 

 

 

Software/Coding

 

Along with the Arduino circuit boards, Pure Data software was to be used for converting the electrical signals into the correct notes to be produced when certain triggers were connected. As the two hands needed to be used together (one hand to set the ‘key’, while the other chose the notes to be played), there was a lot of calculations to be done, working out all the different permutations that could be used to get the full range of notes.