AVIE

Project Overview

  1. Jeffrey Shaw and Dennis Del Favero
  2. with Matthew McGinity, Ardrian Hardjono and Volker Kuchelmeister
  1. ARC Projects: DP0345547; DP0556659

AVIE is the world’s first 360-degree stereoscopic immersive interactive visualisation system that includes a motion tracking system and a multi-channel audio system. Driven by an experimental framework, it uses a suite of cutting edge hardware and software resources enabling the development of applications in Virtual Reality, Artificial Intelligence, Motion Capture and Motion Tracking.

AVIE_showing_eavesdrop_compiled
AVIE: exterior and interior views showing Eavesdrop

AVIE has been installed as core visualisation infrastructure at ZKM, Centre for Art and Media, Karlsruhe, Germany; City University of Hong Kong, Hong Kong; Rensselaer Polytechnic University, New York, USA; where it forms the centre piece of next generation research and teaching programs. Museum Victoria, Melbourne, has installed an AVIE for its current Dynamic Earth exhibition. It has been commercialised for the mine safety training industry by Mines Rescue Pty Ltd at its Newcastle, Wollongong, Lithgow and Singleton facilities and the Shenyang Research Institute of China Coal Technology & Engineering Group (CCTEG), one of China’s leading mine safety research centres, at its new training facility in Fushun. AVIE has been commissioned as a curated visualisation platform by numerous premier international venues for exhibitions and festivals, including:

  1. International Symposium of Electronic Art 2016 (ISEA16), Hong Kong, 2016
  2. Chronus Art Center, Shanghai, 2014-15
  3. Smithsonian Institution, Washington D.C., 2014
  4. Child, Nation and World Cinema Symposium, Sydney, 2014
  5. 20th International Conference on Virtual Systems and Multimedia, Hong Kong, 2014
  6. International Symposium of Electronic Art 2013 (ISEA13), Sydney, 2013
  7. 10th Shanghai Biennale, Power Station of Art, Shanghai, 2013
  8. SIGGRAPH Asia, Hong Kong, 2013
  9. Hong Kong Book Fair, Hong Kong, 2013
  10. Limited Knowledge, Hong Kong, 2013
  11. Festival d’Avignon, Avignon, 2013
  12. Kaladham Museum, Karnataka, (permanent installation) 2012-
  13. Business of Design Week, Hong Kong, 2012
  14. NODEM, Hong Kong, 2012
  15. Grand Opening of Run Run Shaw Creative Media Centre, Hong Kong, 2012
  16. le 360 in Matter-Light, Bethune, 2011
  17. Sydney Film Festival, Sydney, 2011
  18. La dispersion du Fils in Festival of Avignon, Avignon, 2011
  19. National Institute of Experimental Arts double conference, Sydney, 2011
  20. Digitalife, La Pelanda, Rome, 2010
  21. STRP Art and Technology Festival, The Klokgebouw, Eindhoven, 2010
  22. Dynamic Earth, Museum Victoria, Melbourne, 2010
  23. Cinema, Modernity and Modernism, FHAANZ conference, UNSW, 2010
  24. Voyage to the Planet’s TV series, ABC Television, 2010
  25. ALIVE Centre for Applied Computing and Interactive Media, Hong Kong, 2009
  26. eArts Festival, Shanghai Science & Technology Museum, Shanghai, 2009
  27. Le Volcan Scène Nationale du Havre, Un Volcan Numérique, Le Harve, 2009
  28. Seconde Nature, Espace Vasarély, Aix-en-Provence, 2009
  29. OPEN CITY, Architecture Biennale, Amsterdam, 2009
  30. Imagining Media @ ZKM, Karlsruhe, 2009
  31. Sydney Festival, Sydney, 2008
  32. Biennale of Seville, Carlos V Alambra Palace, Granada, 2008
  33. YOUser: Century of the Consumer, Panorama Festival, ZKM Media Museum, Karlsruhe, 2007
  34. From Spark to Pixel, Martin-Gropius-Bau, Berlin, 2007
  35. There is still time… Brother by the Wooster Group, EMPAC, Rensselaer University, New York, 2007
  36. i.Future Festival, Singapore Science Centre, 2007
  37. Inhabiting the Cultural Imaginary, VSMM conference, UNSW, 2007

Video AVIE

Forming part of the iCASTS suite of technologies, it is exclusively licensed to Immersive Realisation, and has been commercialised for the mine safety training for Mines Rescue Pty Ltd at its Newcastle, Wollongong, Lithgow and Singleton facilities and the Shenyang Research Institute of China Coal Technology & Engineering Group (CCTEG), one of China’s leading mine safety research centres at its new training facility in Fushun.

AVIE provides a platform in which 3D audio-visual experiences are created by a combination of multiple projectors and multiple sound sources, driven by a cluster of computers, running a highly versatile real-time 3D VR engine.

AVIE visualisation forms:

  • High-resolution panoramic stereo images with augmented 3D graphics overlays
  • High-resolution panoramic videos, including stereo videos
  • Immersive multimedia data visualisation
  • Real-time interactive 3D environments supported by artificial intelligence systems

AVIE interaction platforms

AVIE utilizes two types of interaction:

  1. a) remote device: a wireless tablet device allowing real-time selection and navigation within interactive applications
  1. b) motion tracking: system of infra-red cameras and real time software that detect, track and interpret human movement and gestures, allowing audience participation in the direct cinematic experience, interplay between users and digital characters and analysis of user behaviour

tvispg1
AVIE: interior view showing T_Visionarium II

mining_in_AVIE_compiled
AVIE: interior views showing Mining VR