CEVA, a licensor of signal processing IP for smarter, connected devices, has announced that Inuitive, a developer of cutting edge depth sensing, computer vision and image processing SoCs, has licensed and deployed the CEVA-XM4 intelligent vision DSP in its next-generation AR/VR and computer vision SoC, the NU4000.
Inuitive will leverage the CEVA-XM4 to run complex, real-time depth sensing, feature tracking, object recognition, deep learning and other vision-related algorithms targeting a range of mobile devices, including augmented and virtual reality headsets, drones, consumer robots, 360 degree cameras and depth sensors. In addition, developers and OEMs will be able to leverage the open, programmable nature of the CEVA-XM4 in the Inuitive SoC to add their own differentiating features and algorithms via software, including their own neural networks which can be implemented via the CEVA Deep Neural Network (CDNN) framework.
“Inuitive is proud to collaborate with CEVA to develop cutting edge intelligent vision systems, that will form the foundation of mass-market visually aware mobile devices,” said Shlomo Gadot, co-founder & CEO at Inuitive. “The CEVA-XM4 delivers the best performance and power efficiencies in the market and provides the software infrastructures by which product builders can add their own algorithms and introduce revolutionary applications for vision-based systems.”
The new NU4000 SoC builds on the success of Inuitive’s NU3000 multi-core image processor which utilized the third-generation CEVA-MM3101 imaging and vision DSP for stereoscopic vision. NU3000 serves as part of the Google Project Tango ecosystem, where developers can utilize it to power applications requiring real-time depth generation, mapping, localization, navigation and other complex signal processing algorithms.
“We are delighted to extend our close relationship with Inuitive as they continue to innovate in the areas of 3D computer vision and image processing,” said Eran Briman, vice president of marketing at CEVA. “Our CEVA-XM4 intelligent vision DSP delivers the power-efficiency and the flexibility that allows Inuitive and its customers implement a range of advanced machine-vision technologies on any mobile device, from neural network-based systems to highly-accurate depth sensing.”
CEVA’s imaging and vision DSPs addresses the extreme processing requirements of the most sophisticated computational photography and computer vision applications such as video analytics, augmented reality and advanced driver assistance systems (ADAS). By offloading these performance-intensive tasks from the CPUs and GPUs, the highly-efficient DSP dramatically reduces the power consumption of the overall system, while providing complete flexibility. The platform includes a vector processor developed specifically to deal with the complexities of such applications and an extensive Application Development Kit (ADK) to enable easy development environment.
The CEVA ADK includes an Android Multimedia Framework (AMF) that streamlines software development and integration effort, a set of advanced software development tools and a range of software products and libraries optimized for the DSP. For embedded systems targeting deep learning, the CEVA Deep Neural Network (CDNN) real-time neural network software framework streamlines machine learning deployment at a fraction of the power consumption of the leading GPU-based systems.
Inuitive is a fabless IC company that developed and manufactured the NU3000 – a multi-core 3D Imaging & Computer Vision (CV) co-processor followed by NU4000 (will be available EOF 2016). Inuitive has developed 3D depth camera modules as reference design to address a variety of use cases: Mainly VR (Virtual Reality) HMD, Augmented Reality (AR) and smartphone (“Tango” like). It supports also Robotics, Drones, Autonomous Car, 3D Scanning and many more. All modules are based on Inuitive proprietary “Assisted Stereoscopy” 3D camera technology and its NU3000/NU4000 ASIC and SDK (Software Development Kit).