This technology enables high-quality real-time 360-degree video communication by adapting video content to each user’s viewport. By concentrating resolution where the user is actually looking, it reduces bandwidth waste and improves visual clarity under tight latency constraints. The result is an efficient, immersive communication experience optimized for real-time interaction while maintaining performance across varying network conditions.
Background: Real-time 360-degree video communication requires transmitting full spherical video frames even though users view only a small portion at any moment, wasting bandwidth and degrading viewport quality. Low-latency requirements prevent the use of buffering, complex prediction models, or heavy processing borrowed from on-demand streaming, and existing real-time communication frameworks are not designed to optimize 360-degree content. This leads to inefficient transmission, poor visual fidelity in the user’s field of view, and difficulty meeting real-time performance constraints.
Technology Overview: The invention uses content-adaptive oriented projection techniques to dynamically reshape 360-degree video frames so that pixel density is concentrated in a user’s current viewing direction. Real-time viewport feedback and network conditions determine projection parameters, which are applied using GPU-accelerated transformations for low-latency processing. Projection metadata is transmitted using RTP header extensions, allowing receivers to accurately reverse the transformation and display high-quality viewport content while minimizing transmission of unviewed pixels.
Advantages: • Improves viewport visual quality through dynamic projection • Reduces bandwidth consumption by minimizing unviewed pixel transmission • Achieves real-time performance using GPU-accelerated transformations • Integrates seamlessly with existing WebRTC workflows • Enhances user experience with adaptive content and bitrate control
Applications: • Immersive video conferencing • Industrial telepresence and remote inspection • Real-time medical telementoring • Interactive immersive content delivery
Intellectual Property Summary: • United States – 63/090,273 – Provisional – Filed 10/11/2020 – Issued 10/12/2020 – Status: Converted • United States – 17/449,893 – US20220116441A1 – Patent No. 11,785,069 – Utility – Filed 10/4/2021 – Issued 10/10/2023 – Status: Patented
Stage of Development: Prototype
Licensing Status: This technology is available for licensing.
Licensing Potential: Strong potential for adoption by video communication platforms, immersive media providers, and telepresence solution developers seeking bandwidth-efficient, low-latency, and high-quality 360-degree streaming technologies.
Additional Information: Additional technical details and implementation information available upon request.
Inventors: Yao Liu, Shuoqian Wang