Close

Tracker issues

A project log for Auto tracking camera

A camera that tracks a person & counts reps using *AI*.

lion-mclionheadlion mclionhead 01/08/2019 at 06:390 Comments

It began again with a webcam on the pan/tilt module.  A wide angle lens was required for any tracking at 4fps to have a chance.  6 years on, the lion kingdom was still determined to find a use for that pan/tilt mount.

Tracking seemed easy: define a bounding box around the lion & point the camera at the bounding box.  What really happened was body parts always came in & out of view  because of lighting, glitches, movement out of frame, & movement too close to the camera.  The system could not keep the head in view, even with a higher framerate, & would just center on a paw or a leg.  This quickly showed tracking based only on the photographed field of view to be an unsolvable problem.

The Facebook Portal uses a spherical cam to track a subject & zooms in based on a bounding box of the entire body.  It uses face detection to optionally track individual humans while using YOLO to detect the entire body.  It probably doesn't have enough clockcycles for full pose detection.

Amazingly, for a corporation which once promoted live streaming & vlogging, it has no support for content creation or recording video locally.  It just makes phone calls.  It's either a new height of corporate dysfunction or only private phone calls are worth monetizing.

Any tracking camera needs a spherical cam as the tracker & to just live with the parallax error.  Live video from a spherical cam is a premium feature.  The Gear 360 requires you to use a Samsung phone to get live video.  Newer cameras charge $300 for live output.  There is exactly 1 hemisphere webcam which streams over USB, the ESCAM Q8 on a 1 month boat ride from China.





Discussions