Support Materials for FRQSC: Recherche-Création 07

 

Project Title: Volumétries: Experiencing Electronic Audiovisual Artworks in Real 3D Spaces

 

Jean Piché / Zack. Settel                                                                              Oct. 2007

 

 

see Project Description

 

The following material is intended to directly support this project, either as current documentation (what has directly been prepared for the project), or as closely related material, upon which artistic or technical elements for the project will be drawn. 

 

The material presented on this CDROM is intended to be browsed using any standard web browser (assembled using Safari), and consists of items in standard formats, jpeg, pdf, Quicktime etc.

 

Note that the latest version of this document is on-line at: http://www.zeep.com/zack/projects/fqrsc/index.htm

 

__________________________________________


Description of proposed works

 

The artistic creations to be realized in the scope of this project are described below:


SIWALIK

For four percussionists and twelve video screens/channels.

Jean Piché

 

 

Concept

 

Four percussionists will perform in a high ceilinged rectangular space dispersed in an array of 12 tridimentionally disposed high-definition video screens of different sizes (see tile display diagram).  The percussionists perform on portable 18” x 12” surfaces attached to themselves parade-style, providing freedom of movement. The percussionists are equipped with position sensors. Trigger signals from each persussionnist are relayed wirelessly to a remote control station where sound/image control/generation takes place.

 

By moving about the space, each of the percussionist controls (via the position sensor) the position of a virtual camera that looks onto a part of a composed scene inside the computer(s). This part of the scene is projected on a fixed group of three screens. Thus, a careful choreography of the percussionists will alow for a variable “sub-composition” of four individual views over the 12 screens depending directly on the variable position of each percusionist. For example, positioning the four percussionists in a straight line facing the public may result in a rendition of the complete scene over the 12 screens. In another situation, the positioning of the percussionists in a circle may be mapped to the representation of the same part of the scene from four different points of view over the 12 screens.

 

The nature and behaviour of objects included in the composed scene (2D video, particle generators, text, etc..) will all be precomposed. The performers control the angle of view into this scene. Experiments will also be made to determine the level of performer control that can practically be assigned to the speed of the visual material. The faster one plays (or “triggers”) the faster will the frames of the animated scene will  advance.

 

Content

 

The material for the scene will be filmed and generated. Some of the material will be different kinds of 2D and 3D abstractions but the running thread and original visual data/material will be concerned with Himalayan geography, using satelitte imaging, geothermal data and topological mappings from the lower Siwalik hills of Northern India, where the author has reside.

 

Duration of the work : 45 min

Siwalik will be premiered at the Elektra Festival in 2009 or 2010 



__________________________________________

 

Beauté et Abandon

Opéra en éspace 3D audiovisuelle

Zack Settel


Opéra en éspace 3D audiovisuelle,  situates its four singers (soprano, alto, tenor, bass)  and public within the same “augmented” audiovisual space.  The performance space, equipped with multiple projection screens and loudspeakers, provides an audiovisual space, through which,   “flow”  the opera’s elements: libretto text, score, electronic voice processing regions, musical accompaniment and imagery. The singers voices are captured and accompanied by these elements which eventually reach members of  the public located elsewhere in the space. 

 

__________________________________________


Figures

Click on the link below for items referred to from the main project description text

anamorphis: coherent perspective

anamorphis: incoherent perspective

volume display

ribbon display A

ribbon display B

ribbon display C

multi display

tile display

simulator


__________________________________________


Additional Information

Click on the link below for items referred to from the main project description text

Volumetric Displays and Display Simulation



__________________________________________


Related Works and Concepts in 3D Audiovisual Arts

 

Artistic

 

Settel has been creating pieces for several years using environments with 3D audiovisual rendering and projection systems.  In an early installation work,  Bruits de L’Esprit  music is spatialized and loosely synchronized with the 2D image. In a later installation work, Espace-V the and Soundscape Pour la Voix, prototype for Soundscape, a 3D audiovisual environment, was used to provide for live 3D spatial processing of the voice.  In the Medard Expo, the concept of “Active Listening” was presented in the context of a three-week installation.  4Dmix3 is an installation featuring an audiovisual scenescape which mirrors users in a real space.  4Dmix3 is an installation featuring an audiovisual scenescape which mirrors users in a real space.  

 


__________________________________________



Technical

 

Settel, in previous collaborations has developed a 3D immersive audiovisual environment (mentioned above) and have published the following technical papers, based on that work.

 

A Spatial Interface for Audio and  Music Production, the  9th International Conference on Digital Audio Effects (DAFx’06), Montreal, Canada, September, 2006.

 

A Paradigm for Physical Interaction with Sound in 3-D Audio Space , ICMC 2006: The 2006 International Computer Music Conference, Tulane University, New Orleans, Louisiana, USA.

 

A framework for immersive spatial audio performance , NIME 06: The 6th International Conference on New Interfaces for Musical Expression, IRCAM, Paris, France. June 2006.


User-Specific Audio Rendering and Steerable Sound for Distributed Virtual Environments, ICAD 2007: International Conference on Auditory Display, Montreal, June 2007



__________________________________________


References

  1. Piché J., De la musique et des images, Circuit, vol. 13, no. 3, Press de l’University de Montreal
  2. Piché J., Cecilia: a musician’s interface to Csound, Computer Music Journal, Vol. 13, no.2
  3. T. Kanade, P. Rander, and P.J. Narayanan. Virtualized Reality: Constructing Virtual Worlds from Real Scenes.  IEEE Multimedia, Immersive Telepresence, Vol. 4, No. 1, January 1997, pp. 34-47.
  4. Tanaka, Seeking Interaction, Changing Space. In Rasa Smite, editor, Acoustic.Space: Media Architecture Reader, 200
  5. Y. Boussemart, F. Rioux, F. Rudzicz, M. Wozniewski, and J.R. Cooperstock. A Framework for Collaborative 3D Visualization and Manipulation in an Immersive Space using an Untethered Bimanual Gestural Interface.  Virtual Reality Systems and Techniques, Hong Kong, November 10-12, 2004.
  6. R. Szeliski, Image Mosaicing for Tele-Reality Applications.  Tech. Rep. CRL 94/2, Digital Equipment corporation: Cambridge Research Lab, May 1994.
  7. Wozniewski M., Settel Z., and Cooperstock J.,  A Spatial Interface for Audio and Muic Production, the  9th International Conference on Digital Audio Effects (DAFx’06), Montreal, Canada, September, 2006.
  8. Piché Jean, Cecilia and TCLCSOUND, the  9th International Conference on Digital Audio Effects (DAFx’06), Montreal, Canada, September, 2006.
  9. Wozniewski M., Settel Z., and Cooperstock J., A Paradigm for Physical Interaction with Sound in 3-D Audio Space , ICMC 2006: The 2006 International Computer Music Conference, Tulane University, New Orleans, Louisiana, USA
  10. Wozniewski M., Settel Z., and Cooperstock J., A framework for immersive spatial audio performance , NIME 06: The 6th International Conference on New Interfaces for Musical Expression, IRCAM, Paris, France. June 2006.
  11. Wozniewski M., Settel Z., and Cooperstock J., User-Specific Audio Rendering and Steerable Sound for Distributed Virtual Environments,  International Conference on Auditory Display, Montreal, June 2007