Back

XR: Virtual Has Never Been So Real

Challenges

XR refers to technologies like VR, AR, and MR that encompass next-generation computing platforms and help bridge digital and physical worlds, resulting in enhanced computing performance and connectivity across the board. XR has revolutionized content display and human-machine interactions, and represents a flourishing market worth tens of billions of dollars.

Virtual reality (VR) has been widely adopted in the field of education. Students can leverage VR to experience the geographical features of far-off lands firsthand, and enjoy enriching, immersive learning experiences. Augmented reality (AR) has made great strides in a number of entertainment and B2B domains, including security, industry, tourism, and healthcare. AR smart glasses also boost work efficiency by streamlining operations and enabling remote assistance. Mixed reality (MR) is the combination of VR and AR. It introduces real scenario information into the virtual scenario, and establishes an information loop of interactions and feedback between the virtual and real worlds to create a heightened sense of reality. The emergence of MR has helped break through the inherent limitations of VR resulting from its entirely virtual nature, enabling an expanded range of human-machine interactions with equally broad commercial applications. However, current XR devices still face the following challenges:

  • Resolution

    Resolution

    The low resolutions on VR glasses have led to the so-called screen-door effect, resulting in visual fatigue and the failure to create a genuine sense of immersion.

  • Latency

    Latency

    Latency caused by insufficient CPU processing capabilities is one of the main causes of dizziness, as visual information fails to sync with the user's head movement.

Highlights

NPU-based scene identification is a basic AR function. Scene identification involves image capture, analysis, upload, and display. The faster that a scene is identified, the better the resulting experience. However, in order to identify and analyze hundreds of faces per minute, or license plates within milliseconds, chipsets must incorporate powerful NPU computing capabilities. Cloud-based AR/VR places rigorous requirements on transmission bandwidth and latency. According to the white paper of Huawei Wireless X Labs, bandwidth of up to several Gbit/s and millisecond-level latency are required to ensure a premium experience. As traditional 4G and WiFi are unable to meet these requirements, WiFi 6 and 5G have become the preferred technologies. HiSilicon offers a comprehensive XR (VR/AR/MR) solution, including components like application processing (AP), display, vision, and connectivity.

  • UHD display

    UHD display

    8K UHD decoding, supporting 8K 360-degree immersive XR panoramic video; 4K UHD low-latency encoding, supporting XR remote immersive video conferences and remote assistance; AI PQ enhancement; XR audio and audio effect processing.

  • High-performance computing

    High-performance computing

    Independent NPU with HiSilicon-exclusive architecture, providing up to 9 TOPS of AI compute power; octa-core Cortex-A73 processor, delivering high-speed computing with reduced latency.

  • High-speed and low-lag connectivity

    High-speed and low-lag connectivity

    Low-latency image transmission, supporting both cloud VR applications and short-range wireless image transmission applications; high-speed and low-latency connectivity solution (5G and WiFi 6) to ensure a seamless experience.

  • Low-power smart perception

    Low-power smart perception

    Low-power AI visual solution, automatic human/object detection and tracking, and AI-powered visual enhancements; intelligent voice solution; SLAM and 6DoF application for improved stability.

Related News

XR Technology: Keeping Things Real

XR Technology: Keeping Things Real

HiSilicon Forges Ahead with Ultra-HD

HiSilicon Forges Ahead with Ultra-HD

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Read our privacy policy