Dec 17, 2020

Is VR the future of remote meetings?

Nigel Cannings
6 min
Vr meetings
We’ve all adapted to having meetings in 2D, says Nigel Cannings, but is there a brighter future in VR meetings...

If there is one thing that we have all learned from lockdown, it’s that Zoom-type meetings are exhausting. While the theory is the same as your standard team briefing, in practice it leaves you drained. So, while the future of work might be remote, the future of working is not the videoconference of today. But what’s the alternative?

Why is the current format of videoconferencing so tiring?

Much of the issue with video meetings is the lack of naturalistic cues, together with the feeling of being observed all the time. During in-person communication, our brains use the 7-38-55 rule to decipher the meaning behind what’s being said. Seven per cent verbal, 38 per cent tone of voice and 55 per cent body language. Video calls take away most body language cues, but because the person is still visible your brain still tries to compute that non-verbal language. It means that you’re working harder, trying to achieve the impossible. This impacts data retention and can lead to participants feeling unnecessarily tired. 

Attempts have been made during the pandemic to try to change the current 2D imagery of video meetings and make it more accessible. Teams “Together” mode is an example. But these endeavours don’t resolve the underlying problems of “presence”. 

At the least part of the answer could lie in the growing world of VR gaming. 

How can VR gaming help improve the future of videoconferencing?

In VR gaming, the action is driven by the user’s actions, usually through a gamepad or keyboard. The visual representation of the person is an avatar. This allows the human operator to have a degree of distance from their online presence. So, if they need to scratch their nose, the avatar is not mimicking them. On a video call, all actions are immediately transmitted and seen by other participants. And that puts extra pressure on everyone involved.

But of course, meetings (at least most meetings) are not about shooting and fighting. This means that the way we interact will be very different, and will need a different type of control. And this is where the voice becomes so important.

To avoid unnecessary user actions, we want to be able to turn off the camera completely. We need the actions of the avatars to be driven by what the user is saying. Modern speech recognition and speech analysis techniques allow us to understand what is being said, and how it is being said. If the tone is light and friendly, the avatar will relax and smile. If the tone is aggressive, it may lean forwards to make a point. We can seat everyone naturally round a boardroom table, or we can all sit on the deck of a yacht to sip cocktails. The setting is irrelevant. The point is that it simplifies the information that our brains need to compute, preventing ‘Zoom fatigue’.

Room for improvement

Of course, VR can’t answer every problem. The downside of this type of experience is artificiality. In the VR world modelled on video games, we have to wear bulky headsets that completely cut us off from what is around us. This can be disorienting and uncomfortable. And while the scenarios might look like real life, they risk being either too unreal to be credible, or almost too lifelike to be comfortable.

The current form of videoconferencing is not sustainable. It’s not only exhausting, but it’s lonely too. Forty-six per cent of workers in the UK reported feelings of loneliness during the lockdown, according to Total Jobs. In a virtual scenario, there is not that feeling of being alone. By building a virtual world, we can interact more with others, and feel more included. But while a complete virtual boardroom may not be a viable solution for everyone, the answer could be to take an augmented or mixed reality approach to the issue. Anchoring participants and their avatars in their real-world scenarios, while removing the mental strain of indecipherable visual cues. An AR or VR approach provides a shared experience, since each participant is meeting with the avatars of the other participants in their own environment, whether that be their home office or sitting around the kitchen table. Here the technology adapts to accommodate the real-life environment of each meeting participant, removing the distraction of VR environments.

When it comes to AR/MR devices there are numerous options. There are the expensive Magic Leap One and Microsoft HoloLens 2 devices which while quality immersive devices require personal computing power and cost thousands of dollars. Alternatively, there are also the inexpensive AR cardboard options like Aryzon and Holokit that make use of the AR image from your mobile phone in split screen mode and a mirror to optically mix the AR assets with your field of view. The drawback of these devices (aside from the rough and ready look) is that the reflected AR content lacks intensity, and suffers in even moderately well lit environments. A promising new inexpensive device is Zapbox, which mounts your phone in a glasses cradle like the AR cardboard options but much more ergonomically. ZapBox offers better clarity for viewing the content in any light condition, because the user is viewing the AR/VR content directly via a lens placed over the phone’s screen. However, this reduces the resolution of the image, because first the screen is split into two for each eye. Then a reduced portion of each split is rendered with an image that is visible through each lens.

Since the user views the image directly from the screen, it can shorten the viewing time length because looking at the light source directly could fatigue the user faster than with the reflective cardboard options. Zapbox is not released yet so is a bit of an unknown quantity but it is interesting.

Mobile hardware is making giant strides with regard to pushing the development or AR technology. Recognising the possibilities of the AR use case early on the two main competitors Android and iOS both have software development kits, ARCore and ARKit respectively, backed by hardware for development of AR applications on recent mobile devices. For many applications, viewing AR content on the phone screen in mono AR mode (without split screen), while less immersive, is a viable option for the technology.

The technology we are developing is using both the Android and iOS developer kits to build an immersive meeting experience. The product, based on Unity Technology, we are calling iVXR (short for Intelligent Voice Extended Reality), can support mono single screen mode for a hand-held AR/VR meeting, but also supports the inexpensive cardboard options with split screen AR or VR options. We are using the Unity game engine as the basis of the technology, a proven solution for massively multiplayer applications, and this together with the inexpensive AR technology we prefer is intended to provide a useful application for a wider community of potential users. We have integrated our state-of-the-art speech and natural language understanding technology within iVXR to ensure that what is said is visible to the meeting participants and recorded in the meeting transcript made available to the participants, and that a permanent record of the meeting is available afterwards.

It is very likely as more and more AR applications are developed and AR hardware is continuing to be developed that the price point for AR headsets, which has come down, will continue to reduce as it did for VR headsets, for example, compare Oculus prices now to when it was first released. 

AR technology continues to develop and is now moving quicker than ever, but it’s still an area that needs further exploration, but has much promise and I can see it being a big part of the near business future. 

Nigel Cannings is CTO at Intelligent Voice

Share article

Jun 11, 2021

Ireland is key launchpad for US expansion into Europe

4 min
Thinking of expanding into Europe? Hear why Pfizer, Metlife, Google and VMware favour Ireland as the gateway to the region. 

The first transatlantic cable was laid between Newfoundland and Valentia Island in County Kerry, Ireland, in 1858. It was a flawed effort; the connection was poor, causing enough issues with efforts to send telegrams along it that major repair efforts were set underway immediately - efforts which ended up further damaging the cable line, severing the connection just three weeks later. 

This first step towards transatlantic subsea communication, shaky as it was, laid the foundations of more than a century and a half of information exchange across the ocean, between the East Coast of North America and Western Ireland.

It’s been 163 years since the completion of the first transatlantic cable, an event which cemented Ireland’s position as the landing stage for subsea connections between Europe and the Americas. That position has, in no small way, been a driving force behind the country’s modern role as a landing stage for US and Canadian firms looking to do business in Europe. 

Today, some of the largest firms in the world, like Pfizer, Janssen, Zurich, Metlife, Google and VmWare use Ireland for their European Headquarters. The combination of an English-speaking workforce (a boon made all the more important as Brexit makes the UK and the north of Ireland an increasingly complex environment that provides diminishing opportunities to access the rest of Europe), a cultural and regulatory landscape that welcomes foreign investment, and world-class connectivity makes the country an unparalleled choice for firms looking to establish a foothold in the EU. 

As a result, Ireland has become one of the world’s leading data centre hubs. 

Based on leading data centre firm Interxion’s Data Gravity Index, Dublin will be among the top five European cities that will contribute to Europe’s growth in data in the coming years, following London, Paris, Frankfurt and Amsterdam. The amount of data generated in Dublin itself is expected to grow alongside its economic expansion, with the Data Gravity Index also predicting that Dublin will outpace cities and data centre hubs like Mexico City, São Paulo, and even Shanghai, to be among the top 20 cities to experience annual data growth by 2024.

Ireland ranks 6th in the 2020 EU Digital Economy and Society Index (DESI), meaning that it is among the leading ranks of EU Member States in terms of the uptake and use of digital technologies. Likewise, the trend to locate data centres in Ireland serving overseas clients will continue to generate increasing amounts of international traffic

Managing the Dublin Data Boom 

According to Interxion, subsea connectivity will continue to play a massive role in helping both international and domestic organisations digitally transform themselves to meet the challenges of changing markets post pandemic.  

As the pace of global digital transformation - and the subsequent need for more connectivity - accelerates like never before, this rapidly developing world is driving urther demand for these cables as individuals and organisations become increasingly reliant on subsea cable’s exceptional data speed and capacity. 

According to experts at Interxion, this connectivity will be pivotal to Ireland’s continued success in attracting international companies in the technology, pharmaceutical and financial sectors. 

The subsea cable industry is a key contributor to the Irish economy across many sectors. The draft National Marine Planning Framework reported that subsea international networks make Ireland an attractive region for investment for the technology and digital sectors. Telegeography states that there are twelve existing subsea cables connecting Ireland to the US and UK, and a further four systems are under development. The Iish government’s statement on the Role of Data Centres in Ireland’s Enterprise Strategy identified Ireland as a location of choice for many different sectors reliant on digital and telecommunications capabilities, all of which in turn rely on subsea cable interconnectivity. 

Courtesy of Interxion: A Digital Realty Company
Courtesy of Interxion: A Digital Realty Company

Subsea cables are of strategic importance to Ireland’s future as a catalyst for economic and societal prosperity. Ireland can be the ideal location for your company’s expansion plans. To find out how, you can hear from leading experts throughout the data centre and digital infrastructure industries on June 15, 2021, as speakers from the IDA, Aqua Comms, GTT Communications, euNetworks and Interxion discuss subsea cabling, digital transformation, Data Gravity and the fate of Ireland’s digital economy. 

Key topics will include: 

  • Key facts about existing subsea infrastructure, 
  • Future plans, 
  • Challenges (including Marine Maintenance) and opportunities, 
  • Terrestrial networks (demand vs supply); 
  • Ireland's role as a gateway to Europe

The virtual panel (which is taking place between 10:30 PM - 11:30 PM JST on June 15, 2021) will conclude with a 20 minute Q&A. Mike Hollands, Senior Director of Market Development at Interxion, will moderate the event.   

  • Experts from Aqua Comms, GTT, euNetworks, the IDA, and Interxion will be taking part in the live event on June 15, 2021
    Experts from Aqua Comms, GTT, euNetworks, the IDA, and Interxion will be taking part in the live event on June 15, 2021

Share article