Project Overview

  1. Jeffrey Shaw and Dennis Del Favero
  2. (Programmers: Matthew McGinity, Ardrian Hardjono and Volker Kuchelmeister)
  1. ARC Projects: DP0345547; DP0556659

AVIE is the world’s first 360-degree stereoscopic immersive interactive visualisation system that includes a motion tracking system and a multi-channel audio system. Driven by an experimental framework, it uses a suite of cutting edge hardware and software resources enabling the development of applications in Virtual Reality, Artificial Intelligence, Motion Capture and Motion Tracking.

AVIE: exterior and interior views showing Eavesdrop

AVIE has been installed as core visualisation infrastructure at ZKM, Centre for Art and Media, Karlsruhe, Germany; City University of Hong Kong, Hong Kong; Rensselaer Polytechnic University, New York, USA; where it forms the centre piece of next generation research and teaching programs. Museum Victoria, Melbourne, has installed an AVIE for its current Dynamic Earth exhibition. It has been commercialised for the mine safety training industry by Mines Rescue Pty Ltd at its Newcastle, Wollongong, Lithgow and Singleton facilities and the Shenyang Research Institute of China Coal Technology & Engineering Group (CCTEG), one of China’s leading mine safety research centres, at its new training facility in Fushun. AVIE has been commissioned as a curated visualisation platform by numerous premier international venues for exhibitions and festivals, including:

  1. Sydney Film Festival, Sydney, 2016
  2. International Symposium of Electronic Art 2016 (ISEA16), Hong Kong, 2016
  3. Chronus Art Center, Shanghai, 2014-15
  4. Smithsonian Institution, Washington D.C., 2014
  5. Child, Nation and World Cinema Symposium, Sydney, 2014
  6. 20th International Conference on Virtual Systems and Multimedia, Hong Kong, 2014
  7. International Symposium of Electronic Art 2013 (ISEA13), Sydney, 2013
  8. 10th Shanghai Biennale, Power Station of Art, Shanghai, 2013
  9. SIGGRAPH Asia, Hong Kong, 2013
  10. Hong Kong Book Fair, Hong Kong, 2013
  11. Limited Knowledge, Hong Kong, 2013
  12. Festival d’Avignon, Avignon, 2013
  13. Kaladham Museum, Karnataka, (permanent installation) 2012-
  14. Business of Design Week, Hong Kong, 2012
  15. NODEM, Hong Kong, 2012
  16. Grand Opening of Run Run Shaw Creative Media Centre, Hong Kong, 2012
  17. le 360 in Matter-Light, Bethune, 2011
  18. Sydney Film Festival, Sydney, 2011
  19. La dispersion du Fils in Festival of Avignon, Avignon, 2011
  20. National Institute of Experimental Arts double conference, Sydney, 2011
  21. Digitalife, La Pelanda, Rome, 2010
  22. STRP Art and Technology Festival, The Klokgebouw, Eindhoven, 2010
  23. Dynamic Earth, Museum Victoria, Melbourne, 2010
  24. Cinema, Modernity and Modernism, FHAANZ conference, UNSW, 2010
  25. Voyage to the Planet’s TV series, ABC Television, 2010
  26. ALIVE Centre for Applied Computing and Interactive Media, Hong Kong, 2009
  27. eArts Festival, Shanghai Science & Technology Museum, Shanghai, 2009
  28. Le Volcan Scène Nationale du Havre, Un Volcan Numérique, Le Harve, 2009
  29. Seconde Nature, Espace Vasarély, Aix-en-Provence, 2009
  30. OPEN CITY, Architecture Biennale, Amsterdam, 2009
  31. Imagining Media @ ZKM, Karlsruhe, 2009
  32. Sydney Festival, Sydney, 2008
  33. Biennale of Seville, Carlos V Alambra Palace, Granada, 2008
  34. YOUser: Century of the Consumer, Panorama Festival, ZKM Media Museum, Karlsruhe, 2007
  35. From Spark to Pixel, Martin-Gropius-Bau, Berlin, 2007
  36. There is still time… Brother by the Wooster Group, EMPAC, Rensselaer University, New York, 2007
  37. i.Future Festival, Singapore Science Centre, 2007
  38. Inhabiting the Cultural Imaginary, VSMM conference, UNSW, 2007

Video AVIE

Forming part of the iCASTS suite of technologies, it is exclusively licensed to Immersive Realisation, and has been commercialised for the mine safety training for Mines Rescue Pty Ltd at its Newcastle, Wollongong, Lithgow and Singleton facilities and the Shenyang Research Institute of China Coal Technology & Engineering Group (CCTEG), one of China’s leading mine safety research centres at its new training facility in Fushun.

AVIE provides a platform in which 3D audio-visual experiences are created by a combination of multiple projectors and multiple sound sources, driven by a cluster of computers, running a highly versatile real-time 3D VR engine.

AVIE visualisation forms:

  • High-resolution panoramic stereo images with augmented 3D graphics overlays
  • High-resolution panoramic videos, including stereo videos
  • Immersive multimedia data visualisation
  • Real-time interactive 3D environments supported by artificial intelligence systems

AVIE interaction platforms

AVIE utilises two types of interaction:

  1. a) remote device: a wireless tablet device allowing real-time selection and navigation within interactive applications
  1. b) motion tracking: system of infra-red cameras and real time software that detect, track and interpret human movement and gestures, allowing audience participation in the direct cinematic experience, interplay between users and digital characters and analysis of user behaviour

AVIE: interior view showing T_Visionarium II

AVIE: interior views showing Mining VR