Browsing by Subject "Gestures"

Now showing 1 - 3 of 3
  • Thumbnail Image
    Item
    Gestural composition with arbitrary musical objects and dynamic transformation networks
    (2014-06) Thalmann, Florian
    This thesis proposes a theoretical framework and a working implementation of a music composition software that overcomes many aspects of the distance commonly perceived by composers when using software products dealing with abstract representations of music. It is based on elaborate musical spaces and complex algorithmic procedures (constructs from contemporary mathematical music theory), which it makes more accessible using an intuitive gestural interface. More specifically, the software applies the principles of transformational theory and gesture theory to composition rather than analysis, poiesis rather than esthesis. The overall design of the software is based on the three levels of the ontological dimension of embodiment: the levels of facts, processes, and gestures. Users can interact with any of these levels via the software's graphical user interface. They can define and manipulate arbitrary musical objects in a gestural way and their compositional process is recorded in a transformation graph. This graph, in turn can be modified in a gestural way and finally translated back into standardized gestures that represent the evolution of the musical work.
  • Thumbnail Image
    Item
    Hand Images in Virtual Spatial Collaboration for Traffic Incident and Disaster Management
    (Intelligent Transportation Systems Institute, Center for Transportation Studies, University of Minnesota, 2013-03) Drew, Daniel; Hayes, Caroline C.; Nguyen, Mai-Anh; Cheng, Xuan
    To develop demonstration technology that can overlay hand videos on spatial images such as traffic maps, and assess the impact of this technology on virtual collaboration. This work explores to what degree gestures impact collaboration effectiveness in the task of traffic incident management, with the goal of informing design of tools to support virtual collaboration in this domain. Methods: Eighteen participants worked in pairs to solve three traffic incident scenarios using three different interaction approaches: 1) face-to-face: participants worked together by marking up an electronic map projected on the table in front of them; 2) separated: participants were separated by a soft wall while they worked together on the electronic map with electronic drawing tools; or 3) hand images: same as 2 with the addition of the partner’s hand images projected on the map. Participants were video recorded. The questionnaires were given to participants after each trial to evaluate workload, positive interactions, team behaviors, connection to teammate, and frustration. Results: Participants spent more time on the task and perceived a higher level of time pressure when using hand images than when working face-to-face. When working face-to-face, participants felt more like their teammate was at the same table and felt less disconnected from their teammate than when working separately or using hand images. Conclusions: The results indicate that adding hand videos to a virtual drawing tool for the task of traffic incident management can increase team behaviors and change the way in which team members communicate information.
  • Thumbnail Image
    Item
    Musical Gestures between Scores and Acoustics: A Creative Application to Orchestra
    (2017-05) Mannone, Maria
    Musical gestures connect symbolic scores to physical sounds, and they can be mathematically investigated. Mathematics can also be used to transform images into music and vice versa. The two approaches work together if we consider a visual shape as the result of a drawing gesture. We present here a piece for orchestra, soprano, and piano as a creative application of the mathematical research on musical gestures and music/visual arts.