Qualcomm Robotics

Qualcomm has launched a module for edge robotics  applications delivering AI acceleration and 5G connectivity aimed at machine learning, heterogeneous computing, and computer vision

It is engaged with various partners on end product development.

Called RB5; the module has a Qualcomm QRB5165 processor tailored to robotics applications, with a heterogeneous computing architecture that’s paired with Qualcomm’s fifth-generation AI Engine.
“The key things for a robot — the key elements of a robot — are sensing, thinking, acting, and communicating. This platform puts all of them together,” says Dev Singh (pictured) who led the project.

An image signal processor (ISP) supports up to seven concurrent cameras to facilitate simultaneous localization and mapping (SLAM), object detection and classification, autonomous navigation, and path planning.

It has a dedicated engine for video analytics and Qualcomm’s Hexagon Tensor Accelerator, and native support for the EtherCAT standard, an ethernet-based industrial protocol with integrated safety mechanisms.

The QRB5165 processor contains an octa-core Qualcomm Kryo 858 paired with an Adreno 650 GPU and discrete digital signal processors for compute, audio, and sensors.

The ISP — the Spectra 380 — can process 2 gigapixels per second and features Dolby Vision video capture, 8K video recording at 30 frames per second, 200-megapixel photos, simultaneous capture of 4K HDR video at 120 frames per second, and 64MP photos with zero shutter lag.

Qualcomm’s Secure Processing Unit (SPU) — includes secure boot, cryptographic accelerators, malware protection, secure token for remote attestation and secure device provisioning, and biometric authentication (including fingerprint, iris, voice, and face).

According to Qualcomm, the QRB5165 — along with the fifth-gen AI Engine — delivers up to 15 TOPS of AI performance.