Google and HP Team Up to Bring Magic Window Experience to the Workplace


In a world where remote work and distributed teams have become the norm, the need for effective and immersive communication tools has never been greater. Google's Project Starline aims to revolutionize the way we connect with others from a distance, bringing us one step closer to feeling like we're in the same room, even when we're miles apart.


What is Project Starline?

Project Starline is a groundbreaking technology that combines advancements in AI, 3D imaging, and real-time compression to create a "magic window" experience. Users can see, hear, and interact with another person as if they were sitting right across from them, without the need for additional glasses or headsets. The technology enables natural conversation, gestures, and eye contact, making it feel like you're truly together.


The Impact of Project Starline

After thousands of hours of testing across Google offices and with enterprise partners, the results are clear: meetings in Starline feel more like being in the same room than traditional video calls. Participants experience better attentiveness, memory recall, and an overall sense of presence. People act like they're in-person, even when they're thousands of miles apart.


Bringing Project Starline to the Workplace

Google is now bringing Project Starline out of the lab and focusing on connecting distributed teams and individuals in the workplace. They've partnered with HP to begin commercializing this unique experience in 2025, with plans to enable it directly from popular video conferencing services like Google Meet and Zoom.

HP’s expertise in computing, combined with their investment in Poly’s collaboration solutions, makes them uniquely positioned to deliver new and innovative experiences worldwide. As Alex Cho, President of Personal Systems at HP says:

With more than half of meaning and intent communicated through body language versus words alone, an immersive collaboration experience plays an important role in creating authentic human connections in hybrid environments. We are proud to partner with Google to bring this technology to market, harnessing the power of AI to shape the future of collaboration.


Project Starline 2021 paper

According to the 2021 paper, the system achieves this by maximizing audiovisual fidelity and the sense of co-presence through various design elements. These include physical layout, lighting, face tracking, multi-view capture, microphone array, multi-stream compression, loudspeaker output, and lenticular display.


The system provides key 3D audiovisual cues and enables a full range of communication cues, without the need for special glasses or body-worn microphones/headphones. It comprises a head-tracked autostereoscopic display, high-resolution 3D capture and rendering subsystems, and network transmission using compressed color and depth video streams.


Overview of the data flow in the system, illustrating how the main processing components are mapped to the GPU and CPU. All video processing in the system is performed at 60 Hz, except the face tracking at 120 Hz and the infrared stereo pattern capture at 180 Hz.

Project Starline 2021 paper: Project Starline: A high-fidelity telepresence system

The Future of Remote Communication

Project Starline marks a significant step towards a world where connection and collaboration are possible no matter where you are. By harnessing the power of AI and advanced technologies, Google and HP are shaping the future of communication.


As remote work continues to be a reality for many, tools like Project Starline will become increasingly valuable in maintaining strong relationships and fostering effective collaboration. With plans to make the technology more affordable and accessible over time, we can look forward to a future where distance is no longer a barrier to feeling truly connected with others.


Recent Posts