{"id":1484,"date":"2016-04-05T14:15:35","date_gmt":"2016-04-05T12:15:35","guid":{"rendered":"http:\/\/nivel.teak.fi\/carpa4\/?p=1484"},"modified":"2026-04-16T14:03:09","modified_gmt":"2026-04-16T12:03:09","slug":"workshop-which-scenic-subjects-may-emerge-when-interacting-with-machines-through-vocal-and-bodily-virtuosity-ludvig-elblaus-carl-unander-scharin-asa-unander-scharin","status":"publish","type":"post","link":"https:\/\/nivel.teak.fi\/carpa4\/workshop-which-scenic-subjects-may-emerge-when-interacting-with-machines-through-vocal-and-bodily-virtuosity-ludvig-elblaus-carl-unander-scharin-asa-unander-scharin\/","title":{"rendered":"Workshop: Which scenic subjects may emerge when interacting with machines through vocal and bodily virtuosity?"},"content":{"rendered":"\n<p>(all authors are first author)<\/p>\n\n\n\n<p>Building on our team\u2019s work with enhanced cross-over multi-modal expressivity through embodied interaction in opera and dance, we presented a participatory workshop at CARPA4. Following an overview of earlier work, the workshop included hands-on interaction with our new custom-built system OculiVocem. The workshop was followed by a discussion in order to inform the work that we presently undertake towards new premieres in 2016 and 2017, commissioned by the <a href=\"http:\/\/hnk-zajc.hr\/naslovnica\/\" target=\"_blank\">Croatian National Theatre<\/a> in Rijeka, <a href=\"http:\/\/www.musicavitae.com\" target=\"_blank\">Musica Vitae<\/a> in V\u00e4xj\u00f6, Sweden and <a href=\"http:\/\/sverigesradio.se\/berwaldhallen\" target=\"_blank\">Berwaldhallen<\/a> in Stockholm, Sweden.<\/p>\n\n\n\n<p>During a long-standing collaborative work, our team has developed new artistic tools where technology offers means to e.g. let bodies sing [1] , dancing life into machines [3] and to let opera singers accompany themselves through bodily interaction [2]. On an overarching level, our work proposes that performing with artistic interactive systems offers insights into perceptions of new scenic subjects [4] and raises questions of what is human and non-human. We propose that artistic expressivity is re-constituted through virtuoso interaction with machines, a topic that also was discussed during our session at CARPA4.<\/p>\n\n\n\n<p>Our workshop started with an overview of some of our previous technologies for vocal and bodily performance. We started with presenting The Virtual Viola da Gamba in which singers accompany themselves through bodily movement, transformed through flex-sensors to a synthesizer where a chord sequence is generated by movement. <a href=\"https:\/\/youtu.be\/K1XHBQdLf6Q\" target=\"_blank\" rel=\"noreferrer noopener\">Video  LASCIATEMI ExtendingOpera 2011<\/a><\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"531\" src=\"https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img12.jpg\" alt=\"\" class=\"wp-image-1785\" srcset=\"https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img12.jpg 800w, https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img12-300x199.jpg 300w, https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img12-768x510.jpg 768w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption class=\"wp-element-caption\">Figure 1: Maria Sanner performing with The Virtual Viola da Gamba in The Reactor Hall, KTH, 2011. Photo: Martin Hellstr\u00f6m<\/figcaption><\/figure>\n\n\n\n<p>Secondly, we presented The Vocal Chorder, a device that allows performers to interactively accompany themselves through pushing, leaning on, and bending steel wires. Audience members can also use the instrument to interact with the operatic voice. When a person steps into the Vocal Chorder, its wires enable full-body interaction to explore the sounds and the interactive pyramid projected in front of the performer. It is a visualization of the child in Ray Bradbury\u2019s short story \u201cTomorrow\u2019s Child,\u201d born in another dimension and perceivable by its parents only as a pyramid. <a href=\"https:\/\/youtu.be\/feUxPitHZaY?list=UUrCJwo2Rq_5goJ6jd_XhfEg\" target=\"_blank\" rel=\"noreferrer noopener\">Video The Vocal Chorder &#8211; Empowering Opera Singers with a Large Interactive Instrument<\/a><\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"900\" height=\"676\" src=\"https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img13.jpg\" alt=\"\" class=\"wp-image-1786\" srcset=\"https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img13.jpg 900w, https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img13-300x225.jpg 300w, https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img13-768x577.jpg 768w\" sizes=\"auto, (max-width: 900px) 100vw, 900px\" \/><figcaption class=\"wp-element-caption\">Figure 2: Carl Unander-Scharin performing in The Vocal Chorder, Toronto 2014. Photo: \u00c5sa Unander-Scharin<\/figcaption><\/figure>\n\n\n\n<p>We then continued with presenting the Coloratura Machine in The Charged Room, that enables opera singers to manipulate the sound of their voices through movement in space. A video camera transforms the X- and Y-axis movement to information that informs the playback of vocal sounds according to position.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"788\" height=\"314\" src=\"https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img14.jpg\" alt=\"\" class=\"wp-image-1787\" srcset=\"https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img14.jpg 788w, https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img14-300x120.jpg 300w, https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img14-768x306.jpg 768w\" sizes=\"auto, (max-width: 788px) 100vw, 788px\" \/><figcaption class=\"wp-element-caption\">Figure 3: Alexandra Zetterstr\u00f6m-B\u00fcchel interacting with her own voice in The Charged Room \u2013 also called \u201cThe Colorature Machine\u201d.<\/figcaption><\/figure>\n\n\n\n<p>Then followed a demonstration of a pilot version of OculiVocem, the new system that we are presently developing. At this point it consists of two &#8220;observers&#8221; \u2013 autonomous digital interactors. Each computer is equipped with a video-camera and software enabling them to communicate over Wi-fi to yet another computer that functions as a main component in the sounding result, merging signals together and producing sound.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large tall\"><img loading=\"lazy\" decoding=\"async\" width=\"435\" height=\"579\" src=\"https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img17.jpg\" alt=\"\" class=\"wp-image-1790\" srcset=\"https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img17.jpg 435w, https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img17-225x300.jpg 225w\" sizes=\"auto, (max-width: 435px) 100vw, 435px\" \/><figcaption class=\"wp-element-caption\">Figure 4: The two observers of OculiVocem, June 2015. Photo: Carl Unander-Scharin.<\/figcaption><\/figure>\n\n\n\n<p>Our work with OculiVocem is inspired and informed by Maria Callas\u2019(13) extreme vocal and bodily performances. In particular, her rendering of the role of&nbsp;&#8220;Medea&#8221; in the opera by Luigi Cherubini(14) from 1797 is in the foreground for our current work with OculiVocem. In order to explore Maria Callas\u2019 vocal expressivity, her voice is re-rendered through one of the observers, whereas the orchestra is re-rendered through the other. Thereby, the interactor may perform her voice and orchestra through bodily interaction, exploring her voice through the body.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"988\" height=\"462\" src=\"https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img18.jpg\" alt=\"\" class=\"wp-image-1788\" srcset=\"https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img18.jpg 988w, https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img18-300x140.jpg 300w, https:\/\/nivel.teak.fi\/carpa4\/wp-content\/uploads\/2016\/04\/img18-768x359.jpg 768w\" sizes=\"auto, (max-width: 988px) 100vw, 988px\" \/><figcaption class=\"wp-element-caption\">Figure 5: Preparatory work with OculiVocem, june 2015. Photo: Ludvig Elblaus and \u00c5sa Unander-Scharin<\/figcaption><\/figure>\n\n\n\n<p>After the demonstration, we invited participants to try the OculiVocem. Several audience-members did so and then followed a discussion.<\/p>\n\n\n\n<p>Topics that were raised during the discussion that will inform our future work were:<br>\n\u2013 How to define scenic subjects?<br>\n\u2013 How does the new work with OculiVocem relate to the topic of empowerment?<br>\n\u2013 How does bio-feedback change your performativity?<br>\n\u2013 How does the &#8220;spectre&#8221; of Maria Callas enter the equation?<br>\n\u2013 The topic of repeatability and &#8220;rehearsability&#8221; in relation to the new system?<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Notes<\/h2>\n\n\n\n<p><strong>13)<\/strong>&nbsp;Maria Callas (1923\u20131977) Greek-American opera-singer.<\/p>\n\n\n\n<p><strong>14)<\/strong>&nbsp;Luigi Cherubini (1760\u20131842), Italian composer.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">References<\/h2>\n\n\n\n<p>Elblaus, L., Unander-Scharin, C., &amp; Unander-Scharin, \u00c5. (2014). Singing Interaction: Embodied Instruments for Musical Expression in Opera. <em>Leonardo music journal<\/em>, 24, 7\u201312. (all authors contributed in equal parts to the writing of the article)<\/p>\n\n\n\n<p>Unander-Scharin, Carl. \u201cExtending Opera-Artist-led Explorations in Operatic Practice through Interactivity and Electronics.\u201d (2015).<\/p>\n\n\n\n<p>Unander-Scharin, \u00c5., &amp; Unander-Scharin, C. (2015). Robocygne: Dancing Life into an Animal-Human-Machine. <em>Leonardo<\/em>.<\/p>\n\n\n\n<p>Unander-Scharin, \u00c5. (2010). Three Interactive Scenes of The Crystal Cabinet. <em>Digital Resources in the Humanities and Arts-Sensual Technologies: Collaborative Practices of Interdiciplinarity<\/em>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>(all authors are first author) Building on our team\u2019s work with enhanced cross-over multi-modal expressivity [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[27],"tags":[],"class_list":["post-1484","post","type-post","status-publish","format-standard","hentry","category-conference-presentation"],"acf":[],"_links":{"self":[{"href":"https:\/\/nivel.teak.fi\/carpa4\/wp-json\/wp\/v2\/posts\/1484","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nivel.teak.fi\/carpa4\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nivel.teak.fi\/carpa4\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nivel.teak.fi\/carpa4\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/nivel.teak.fi\/carpa4\/wp-json\/wp\/v2\/comments?post=1484"}],"version-history":[{"count":9,"href":"https:\/\/nivel.teak.fi\/carpa4\/wp-json\/wp\/v2\/posts\/1484\/revisions"}],"predecessor-version":[{"id":2229,"href":"https:\/\/nivel.teak.fi\/carpa4\/wp-json\/wp\/v2\/posts\/1484\/revisions\/2229"}],"wp:attachment":[{"href":"https:\/\/nivel.teak.fi\/carpa4\/wp-json\/wp\/v2\/media?parent=1484"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nivel.teak.fi\/carpa4\/wp-json\/wp\/v2\/categories?post=1484"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nivel.teak.fi\/carpa4\/wp-json\/wp\/v2\/tags?post=1484"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}