Imagine a video call where the person on the other side of the screen feels real, almost as if they are really present in front of you.
A 3D real-life version of themselves and yourself in a video call, instead of the flat two-dimension look we are used to at the moment. Call it hyper-telepresence. Call it whatever you want. Project Starline brings a more personal feel to the conversations. It is almost like a holographic touch and you feel that the person you are conversing with is right here.
What is Project Starline?
Project Starline is an experimental video communication method currently in development by Google that allows the user to see a 3D model of the person they are communicating with. Google announced the product at its 2021 I/O developer conference, saying that it will allow users to "talk naturally, and make eye contact".
Google says it using "research in computer vision, machine learning, spatial audio, and real-time compression" to make these realistic 3D holograms possible. It says "we have developed a breakthrough light field display system that creates a sense of volume and depth that can be experienced without the need for additional glasses or headsets."
How does it work?
The cameras, which include a 3D recording system and depth sensors, will collect information from a person's face, body and movements. These will be processed and compressed by an intelligent system, which will send them to another computer via the internet in real time. The receiving device will decompress the data and convert it into a holographic projection, which will be displayed on the screen or frame.
One of the best things is that a soon as you sit down and start talking, the technology fades into the background.
Three breakthroughs:
Steve Seitz, Director of Engineering, Google explains "There are three breakthroughs coming together:"
- The ability to capture people as they are.
- Second, the ability to compress that information and send it over existing networks efficiently.
- Third, the ability to render that person viewable through a three-dimensional display"
As of now, Google have spent thousand hours of testing Project Starline and have also been conducting demos with selective enterprise partners in areas like healthcare and media in order to get early feedback on the technology and applications. The trial deployments for Project Starline is scheduled to begin later this year.
Comments
Post a Comment