In the future, a virtual twin of the Chemnitz Opera House will allow avatars access, who will enjoy the right perspective and spatial sound from every seat.
An evening at the opera promises more than musical enjoyment and stage design, it is also a social event. The social presence of other people is an essential part of this. A team under the project coordination of Frank Dittrich, Professor of Ergonomics and Innovation Management at Chemnitz University of Technology, has now created a virtual twin of the Chemnitz Opera House and in particular the hall.
The researchers used various techniques, such as photogrammetry. A semi-automated 3D model is created from numerous photos, some of which were also taken by drones. At the same time, 360-degree recordings were used, as well as stationary laser scanning and mobile LiDAR sensors, each of which scanned the surroundings with distance measurements.
Cooperation of several research institutes
In further steps of the SocialSTAGE-VR project, the partners involved want to expand the most realistic possible 3D model of the event space into an immersive event environment for online visitors with VR glasses and headphones. For example, technicians from the project partner, Die Etage GmbH from Osnabrück, recorded concerts with stereoscopic camera systems. This enables the virtual visitor to see the artists on stage from the right perspective from their seat.
The Fraunhofer Institute for Integrated Circuits in Erlangen contributes sound libraries for the sound. The aim is for the opera-goer’s listening experience to ring out from the expected direction. In addition, other partners are working on the integration of individualized avatars, which can even exchange information with each other. Studies with subjects at Chemnitz University of Technology will soon show how immersive the participants perceive their virtual opera visit.
c’t issue 20/2022
Gas and oil are getting more and more expensive. In c’t 20/2022 we therefore draw attention to cheap and ecological alternatives with and without replacing the heating system. We will also show you how to use the Raspi to protect yourself from trackers, test hacker tools, smartphones and graphics cards, and talk to Leica about cameras. You can read that and more in the current issue of c’t.
Energy sources for economical heating
Network filter: Protection against annoying people from the network
Microsoft update paralyzes Linux
Practice: Clean the printheads of ink tank printers
Test: Pinball Zero, hacking for everyone
Test: Samsung Galaxy XCover6 Pro outdoor smartphone
Interview: Leica cameras in smartphones
c’t script updates Windows programs
Caution customer: Bahn refuses reimbursement
FAQ: Latency
c’t 20/2022 in the Heise shop
(egr)