never seen so many people join the room right before a chat session
Like bidding on ebay
Hey everyone, welcome to the Hack Chat. Today we have John Welsh from NVIDIA here to talk about all the exciting stuff that's going on with AI at the Edge.
Welcome John! Can you tell us a little about yourself and how you came to be working in AI?
Hey everyone! Of course. As for my job with NVIDIA - I'm an engineer on the Jetson product team focusing on how to apply deep learning with NVIDIA Jetson
I got into AI during my Masters back in maryland when working on my thesis. I tried a few computer vision techniques, but wanted to give it a shot given all of the material coming out :)
Ultimately I was trying to make a robot follow me around campus
like a body guard?
More like a pet I think
I'm hoping to hear more about all the project ideas everyone has
I think it's an exciting time with modern AI coming to such a small form factor
How close did you get to succeeding?
The robot followed me around the lab on campus. It was a pretty fun demo, but nothing we deployed anywhere yet
how many selfies did you have to take ...
to get it to discriminate against your collegues?
Hah, well. Not too many actually.
I'll chip in with my idea: driveway security camera that can differentiate between wildlife and humans/vehicles. Reduced false alarms would be the goal.
We used an existing dataset for person re-identification to learn important features for distinguishing people. So the neural network actually learned how to recognize people reasonably from a single camera shot
@Dan Maloney This sounds very cool. Is the goal ultimately to send pictures or alerts when one of these is detected?
When the robot follows you, it only sees your back. I imagine it would be very difficult to differentiate people that way, given that even normal people struggle with that?
I'm looking to build a handheld wireless monitor for use in Broadcast, and wanted to use the Nano for encoding/decoding and streaming the video. Do you know the latency off hand?
I'm thinking more of a tiered response. Keep track of wildlife intrusions (like a game camera) but send alerts for people. Send a high alert if you see a vehicle that's not known to the system, maybe via character recognition of license plates?
@Max-Felix Müller Absolutely. Face recognition wouldn't work in that context. Person re-identification is actually using the entire body (all orientations), so it learns features from your general apperance (clothes are helpful). We planned to combine this with face recognition for short term / long term recognition
As far as CNN's developed and trained with (TensorFlow, MATLAB, R, etc.), how is the portability of the Network supported by the Nvidia hardware?
@Dan Maloney I used openalpr for license plate recognition of the Nano. It works.
@alangixxer - Sweet, good to know. Thanks!
@Dan Maloney This may help for general object detection with good performance on Nano. https://github.com/tensorflow/models/blob/master/research/object_detection/g3doc/detection_model_zoo.md . You can fine tune existing object detectors if you put together your own dataset
@FrazzledBadger , that can be a cool project.
The latency for the encoder/decoder depends on the resolution and other settings, but i guess...
Read more »