For years, Cirque du Soleil co-founder Guy Laliberté received countless proposals for virtual reality technologies, but they couldn’t match the magic of his intensely visual and mesmerizing live performances. Now, with a new platform provided by Microsoft, he’s rethinking that.
On Tuesday, he appeared at Microsoft’s Ignite digital conference via holoportation, which uses 3D capture technology to beam a lifelike image of a person into a virtual scene. In the company’s first keynote experience designed entirely for mixed reality, people attending the conference from living rooms and home offices around the world could experience the show as avatars watching events unfold in a shared holographic world.
It was the company’s first opportunity to showcase some of the experiences made possible by Microsoft Mesh, a new mixed-reality platform powered by Azure that allows people in different physical locations to join collaborative and shared holographic experiences on many kinds of devices.
“This has been the dream for mixed reality, the idea from the very beginning,” said Microsoft Technical Fellow Alex Kipman. “You can actually feel like you’re in the same place with someone sharing content or you can teleport from different mixed reality devices and be present with people even when you’re not physically together.”
Video: Introducing Microsoft Mesh - YouTube
Microsoft Mesh will also enable geographically distributed teams to have more collaborative meetings, conduct virtual design sessions, assist others, learn together and host virtual social meetups. People will initially be able to express themselves as avatars in these shared virtual experiences and over time use holoportation to project themselves as their most lifelike, photorealistic selves, the company said.
The new platform is the result of years of Microsoft research and development in areas ranging from hand and eye tracking and HoloLens development to creating persistent holograms and artificial intelligence models that can create expressive avatars.
Built on Azure, Microsoft’s cloud computing platform, Microsoft Mesh also benefits from Azure’s enterprise-grade security and privacy features, as well as its vast computational resources, data, AI and mixed reality services.
“More and more we are building value in our intelligent cloud, which is Azure,” Kipman said. “In these collaborative experiences, the content is not inside my device or inside my application. The holographic content is in the cloud, and I just need the special lenses that allow me to see it.”
With Microsoft Mesh-enabled applications, designers or engineers who work with 3D physical models — anything from bicycles to high-end furniture to jet engines to new sports stadiums — could appear as themselves in a shared virtual space to collaborate and iterate on holographic models, regardless of their physical location.
Architects and engineers could physically walk through a holographic model of a factory floor under construction, seeing how all the pieces of equipment fit together in three dimensions, potentially avoiding costly mistakes.
Engineering or medical students learning about electric car engines or human anatomy could gather as avatars around a holographic model and remove parts of the engine or peel back muscles to see what’s underneath. Colleagues could simply get together and chat in a shared virtual space, or companies could use apps to offer virtual all-hands meetings or trainings to employees around the globe. With Microsoft Mesh, this will become a reality. A new mixed reality.
After all, the metaverse is a persistent, digital world that is connected to many aspects of the physical world, including people, places and things. The metaverse enables shared experiences across both the physical and digital worlds. As enterprises accelerate their digital transformation, the metaverse can help people meet up in a digital environment, make meetings more comfortable with the use of avatars and facilitate creative collaboration from all around the world.