Close

Example Object Detection and Absolute XYZ Postion

A project log for Luxonis DepthAI

Spatial AI Meets Embedded Systems

brandonBrandon 02/01/2019 at 14:161 Comment

Here's an example of what you can do with the Myriad X carrier board.  In this case, it's object detection and real-time absolute-position (x, y, z from camera in meters) estimation of those objects (including dz speed for people).


This is actually run using the NCS1.  Why? The datapath issues of using the NCS2 with a Pi means it doesn't provide a significant advantage over the NCS1 - and results in higher overall latency because the bottlenecks really fill up with it.  So you have to drop framerate even lower, or deal with the really-high latency.

Which is actually part of what prompted the AiPi board.  The NCS1 over USB on the Pi actually isn't hurt that much.  It goes from say 10FPS on a desktop to say 6FPS on the Raspberry Pi.

The NCS2, however, goes from ~60FPS (and potentially faster) on a Desktop to ~12FPS on a Pi, because of the datapath issues (latency/redundantly having to process video streams, etc.).  (And AiPi will fix that!)

Because the Myriad X hardware-depth engine can't be used until the AiPi board is out (we're working feverishly), these examples are using the Intel D435, which has very-similar hardware depth built-in.  With the AiPi board, no need for this additional hardware.  :-)

Discussions

Capt. Flatus O'Flaherty ☠ wrote 02/01/2019 at 14:55 point

Nice!

  Are you sure? yes | no