Google is rolling out a real world application for its most ambitious virtual reality effort: letting shoppers see what they might buy without leaving home.
The Alphabet Inc. unit on Wednesday introduced two new retail partnerships, with BMW and Gap Inc., deploying its 3D-scanning project called Tango. The technology uses cameras and sensors in mobile devices to overlay digital images in physical space — akin to the hit mobile game Pokemon Go. The retail deals announced at the consumer technology show CES in Las Vegas hint at Google’s broader ambition to merge its mapping capabilities with its core business of facilitating commerce.
As virtual and augmented reality technology rapidly improves, analysts predict the retail industry may be one the biggest beneficiaries. IDC estimates the market for the technologies will explode from about US$5.2 billion in 2015 to US$162 billion in 2020.
Car dealerships will be “one of the longer-term, more profitable use cases,” said IDC analyst Chris Chute, as automakers look for way to reach customers who are increasingly less likely to enter traditional outlets.
With Google, BMW is testing a new app that displays an i3 city vehicle and i8 sports car on smartphone screens. Car shoppers can walk around the superimposed vehicles, placing it to look life-size inside their driveway or garage. Users can choose from six different colors, four types of trims and wheels, all appearing in a high-resolution image.
The Munich-based luxury automaker said the mobile app will be available at dealerships in 11 countries. “It’s possible we’ll develop a kind of library of models for this app,” said Stefan Biermann, head of innovations for sales for BMW.
Screen grab/GoogleGoogle’s Project Tango is a platform for Android phones and tablets designed to track the full 3-dimensional motion of the device as you hold it, while simultaneously creating a map of the environment around it.
At a recent presentation in Munich, the display image of an i3, even on a small phone screen, was convincing enough for users to duck and lift their legs to step inside the vehicle, where they could push a button to turn on the lights and the radio.
“We see a lot of use of this technology in retail, for measuring your garage or buying big-ticket items like kitchens for example,” Eric Johnsen, who heads business development for augmented reality at Google, said at the event.
Bloomberg News reported earlier that Google plans to use the indoor mapping capability of Tango to generate advertising revenue. Johnsen said Google isn’t getting revenue from sales with its newly announced partnerships, but declined to comment further on business plans.
On top of the BMW app, Google announced two more developments for Tango on Wednesday. A new app allows shoppers to test clothes from the Gap brand using Tango. And Google added a new hardware partner: The Zenphone from Asustek Computer Inc. is now compatible with Tango’s technology.
However, both announcements reveal the limitations of Google’s efforts. For one, there aren’t many consumers that can try it out. The Asus Zenfone is only the second model to enable Tango, following a device from Lenovo Group Ltd.
And it’s still incomplete for consumers that try the technology. With the mobile app for Gap, for instance, shoppers try on outfits using a 3D digital avatar, rather than superimpose the clothes on their bodies. The latter tactic might arrive eventually, but the tech needed is still in its infancy.
“Producing content for these mediums is extremely hard,” said Shanna Tellerman, founder of Modsy, a startup that uses three-dimensional technology for e-commerce. “It often looks a little bit janky.”
Google is aware of the problem. In addition to challenges with realistic rendering, mobile 3D mapping is constrained by difficulties imposed by lighting and geographic space, said Johnny Lee, director of engineering for Tango. The gap between expectations of the technology and its reality can do more harm than good.
“When people think about augmented reality, they think of science fiction quality effects,” he said.
That’s also the rationale behind Google’s cautious implementation of Tango on devices, Lee explained. While the company ultimately plans for the tech to function inside every mobile device, it now doesn’t reach a vast majority of Android smartphones.
Hardware changes demanded from Tango’s sensors also may give Google’s manufacturing partners pause.
However, that might change if the tech becomes ubiquitous. Other software companies — Microsoft Corp., Facebook Inc. and Snap Inc. — are investing heavily in augmented and virtual reality. Apple Inc. hasn’t revealed any plans for AR, but Chief Executive Officer Tim Cook has touted the technology publicly multiple times. It’s unlikely Apple would allow Google’s Tango to operate on its iPhones.
E-commerce giant Amazon.com Inc. is certainly thinking about virtual reality shopping too, said Chute, the IDC analyst.
All these companies, however, must grapple with the dual challenge of mastering the necessary tech and, more critically, finding an actual market.
“Hardware ain’t easy,” Chute said. “What works in a closed environment, in (Silicon) Valley, doesn’t necessarily work in the real world.”