SocialSTAGE-VR: With virtual friends in the virtual opera

0
16
1663222691 socialstage vr with virtual friends in the virtual opera.jpg
1663222691 socialstage vr with virtual friends in the virtual opera.jpg

In the future, a virtual twin of the Chemnitz Opera House will allow avatars access, who will enjoy the right perspective and spatial sound from every seat.

An evening at the opera promises more than musical enjoyment and stage design, it is also a social event. The social presence of other people is an essential part of this. A team under the project coordination of Frank Dittrich, Professor of Ergonomics and Innovation Management at Chemnitz University of Technology, has now created a virtual twin of the Chemnitz Opera House and in particular the hall.

The researchers used various techniques, such as photogrammetry. A semi-automated 3D model is created from numerous photos, some of which were also taken by drones. At the same time, 360-degree recordings were used, as well as stationary laser scanning and mobile LiDAR sensors, each of which scanned the surroundings with distance measurements.


The researchers place a 3D texture over the polygon mesh that depicts the spatial structure of the opera house., Chemnitz University of Technology

The researchers place a 3D texture over the polygon mesh that depicts the spatial structure of the opera house., Chemnitz University of Technology

The researchers place a 3D texture over the polygon mesh that depicts the spatial structure of the opera house.

(Image: TU Chemnitz)

In further steps of the SocialSTAGE-VR project, the partners involved want to expand the most realistic possible 3D model of the event space into an immersive event environment for online visitors with VR glasses and headphones. For example, technicians from the project partner, Die Etage GmbH from Osnabrück, recorded concerts with stereoscopic camera systems. This enables the virtual visitor to see the artists on stage from the right perspective from their seat.


In the future, a virtual auditorium will provide the right view for each seat and the sound from the expected direction from stereoscopic stage recordings., Chemnitz University of Technology

In the future, a virtual auditorium will provide the right view for each seat and the sound from the expected direction from stereoscopic stage recordings., Chemnitz University of Technology

In the future, a virtual auditorium will provide the right view for each seat and the sound from the expected direction from stereoscopic stage recordings.

(Image: TU Chemnitz)

The Fraunhofer Institute for Integrated Circuits in Erlangen contributes sound libraries for the sound. The aim is for the opera-goer’s listening experience to ring out from the expected direction. In addition, other partners are working on the integration of individualized avatars, which can even exchange information with each other. Studies with subjects at Chemnitz University of Technology will soon show how immersive the participants perceive their virtual opera visit.

c’t issue 20/2022




(Picture:

c’t 20/22

)

Gas and oil are getting more and more expensive. In c’t 20/2022 we therefore draw attention to cheap and ecological alternatives with and without replacing the heating system. We will also show you how to use the Raspi to protect yourself from trackers, test hacker tools, smartphones and graphics cards, and talk to Leica about cameras. You can read that and more in the current issue of c’t.

  • Energy sources for economical heating

  • Network filter: Protection against annoying people from the network

  • Microsoft update paralyzes Linux

  • Practice: Clean the printheads of ink tank printers

  • Test: Pinball Zero, hacking for everyone

  • Test: Samsung Galaxy XCover6 Pro outdoor smartphone

  • Interview: Leica cameras in smartphones

  • c’t script updates Windows programs

  • Caution customer: Bahn refuses reimbursement

  • FAQ: Latency

  • c’t 20/2022 in the Heise shop


(egr)