A day before I was due at Microsoft’s new Mixed Reality Capture Studio in San Francisco, I got an e-mail about the dress code. I was going to be recorded as a “hologram”—Microsoft’s term for volumetric videos, which you can view through augmented-reality or virtual-reality headsets, or on a flat screen. Apparently, much as is the case on TV, not everything looks good when you’re being digitally preserved in multiple dimensions.
What can’t you wear? Hats, glasses, super-dark clothes, super-white clothes, or any “high-frequency patterns” (houndstooth was mentioned specifically as one to avoid). I showed up in a polka-dotted navy dress and left my glasses and hat in my bag.
I stood in the center of a large, white room and made some silly dance moves while 106 cameras and four microphones recorded me. It took about 10 seconds to get the cringe-worthy result you see on this page.
Chances are most of us aren’t going to be heading down to the studio to immortalize ourselves, or make holiday-themed volumetric videos, anytime soon. Microsoft wouldn’t say how much they cost to make (rates are shown under nondisclosure agreements and can be negotiated privately with partners), and there aren’t all that many virtual-reality or augmented-reality headsets out there right now with which you could watch them, anyway. (There are a handful of VR headsets and so-called Windows Mixed Reality headsets for viewing VR, but Microsoft’s HoloLens headset is still a $3,000 developer device.)
Still, after working on the technology for seven years and capturing thousands of performances in this manner at its headquarters in Redmond, Washington, Microsoft is trying to make the medium more popular by opening more such studios for volumetric videos διαβάστε το άρθρο.
The San Francisco capture studio, which is located within a Microsoft technical event space in the city’s tech-heavy SoMa neighborhood, welcomes outsiders to visit and make videos. Studio general manager Steve Sullivan says the idea is to have all kinds of people and companies come in and record things—ranging from celebrity or circus performances to virtual patients for doctors to train on. Then this content can be viewed in a number of ways: on headsets like HoloLens that mix the digital and real worlds, on totally immersive virtual-reality headsets, or on flat screens.
“It’s a kind of medium where it looks like video when you’re looking from any particular point of view, but you can change the point of view during the performance,” Sullivan says.
I watched a video of two break-dancers, who were making all kinds of moves on a sidewalk. They were captured in one of Microsoft’s studios, while the background was filmed elsewhere, but I couldn’t tell while watching it with a virtual-reality headset: the dancers and background fit together flawlessly, with proper shadows on the ground, and the images looked sharp as I moved around. This is volumetric video.
In its studio, Microsoft depends on an array of cameras—half regular color models, half infrared—to shoot many different views of the subject. The color cameras are used for image texture, while infrared emitters and cameras are used to help reconstruct 3-D shapes. The footage is used to make a texturized mesh that can then be used by, say, video-game designers to build a game.
The volumetric videos could one day take those awkward family photos to a whole new level.
Written by Rachel Metz October 25, 2017 (Edited)
MIT technology review
Recent Comments