Close

Hack Chat Transcript, Part 2

A event log for AI at the Edge Hack Chat with NVIDIA

Machine learning unleashed

lutetiumLutetium 05/01/2019 at 20:060 Comments

John12:51 PM
@deshipu Absolutely! AI is a very broad term, it can mean lots of things and the implementation doesn't have to be "deep learning". Deep learning is particularly interesting because it's simplicity and performance :)

John12:52 PM
@Inderpreet Singh Do you mean by digging into a lower level. as in "what's inside the neural network"?

Inderpreet Singh12:52 PM
People ask about Arduinos and not microcontrollers hence the term AI or deep learning are more broad.

deshipu12:52 PM
neurons, mostly...

Inderpreet Singh12:53 PM
Could focus on say vision based stuff. It is difficult for people to wade through ALL the information out there

Josh Lloyd12:53 PM
some connections, a bunch of weights heh...

In other news I arrive 1 hour late to the hackchat again. Really looking forward to daylight savings.

Tegwyn☠Twmffat12:54 PM
I assusmed this hackachat was for vision based

John12:54 PM
@Dan Maloney That's probably the best way to learn. A lot of the concepts you can learn with very simple networks (the simplest is basically just a matrix multiplication!). When it comes to making projects, the neural networks designed to be good at image processing are particularily useful, which is we provide higher level tutorials (We think it can kickstart making projects)

@Josh Lloyd Are you on the reminder email list? You get a reminder 30 minutes before the chat.

Inderpreet Singh12:54 PM
Types of networks and then types of tools like TF vs pyTorch. It can be very overwhelming. I have taught ANN to engineering but the current stuff on the net is just too much UNLESS you focus on a particular problem to be solved

John12:55 PM
@Inderpreet Singh Right, it can be a lot to take in. There are many components. I think its important to try to learn the fundamentals (like a single layer ANN) as well as how to really apply to practical problems using existing architectures

Josh Lloyd12:56 PM
@Dan Maloney The issue is that I'm asleep. Timezones :)

John12:56 PM
In the JetBot project we actually focus on a component of deep learning that can sometimes go under the radar, which is actually collecting a dataset

Tegwyn☠Twmffat12:56 PM
I spent a lot of time meandering all over th net until I found this: https://github.com/dusty-nv/jetson-inference

Tegwyn☠Twmffat12:57 PM
Following the link tutorial. Best intro ever.

Inderpreet Singh12:57 PM
@Tegwyn☠Twmffat agreed.

Inderpreet Singh12:57 PM
Its a good place to start IF you have a jetson board.

Josh Lloyd12:57 PM
@John I really enjoy the idea of running models on low power hardware, because once the model is trained it really is magnitudes less expensive to run inference. Is there a suggested means of training at this point? Is NVIDIA offering cloud based training? Should it just be done on one's own means, on their own computer perhaps, for now?

Josh Lloyd12:58 PM
@John Is it likely that something such as Training as a Service might be offerred in the future? At reasonable cost, that would be competative vs. me just running it on my own GTX ?

Tegwyn☠Twmffat12:59 PM
@Josh Lloyd use Nvidia container on AWS

John12:59 PM
@Josh Lloyd I think it depends what stage you are at. As a gamer, I train on my desktop with GPU to allow me to easily iterate, experiment, etc. Once you've got a lot of data and a complex pipeline you might consider a cloud pipeline or something else.

John1:00 PM
@Josh Lloyd You can even train some smaller datasets on the Jetson Nano itself when you're just getting started :)

Inderpreet Singh1:00 PM
@John I was hoping youd' say that

John1:00 PM
As @Tegwyn☠Twmffat we provide containers that you can launch on a cloud provider that come with deep learning software (like TensorFlow) pre-installed

We're getting to the top of the hour, which is the official end of the chat, but if @John wants to stick around and answer questions, that fine. Of course he may need to get back to work, so we'll leave it up to him.

Either way, I want to say a huge thanks to John for taking time out of his busy day for us. This was really helpful, both to AI noobs like me and the more seasoned vets.

Tegwyn☠Twmffat1:01 PM
I did training on Jetson TX2, which was 'OK'.

Maksim Surguy1:01 PM
@John I've built a smart doll house that recognizes IMU gesture patterns to activate items in the doll house and hoping to port it over to Jetson Nano / Tensorflow, it uses really simple architecture: https://maxoffsky.com/research-progress/project-myhouse-a-smart-dollhouse-with-gesture-recognition/

Sairam Yamanoor1:02 PM
Thanks @John

Josh Lloyd1:02 PM
@John I would assume that anyone with a gaming PC has a far more capable piece of hardware in their desktop than the Jetson Nano. I have a very outdated (at this point) GTX 760, and that has about 3 times as many CUDA cores.

Josh Lloyd1:02 PM
@John Should it be expected that newer CUDA cores on newer hardware are more performant? In whatever the GFX equivilent for DMIPS is?

Sadly, I don't have a Hack Chat lined up for next week yet - we had a host lined up but they had to reschedule. So watch for announcements in case I get a host. Thanks everyone!

John1:03 PM
@Dan Maloney I'd love to keep talking with everyone. I do need to grab lunch soon :) Please feel free to send me direct messages, but I'll also come back and check this log. This has been awesome!

Josh Lloyd1:03 PM
Thanks @Dan Maloney and @John

Prof. Fartsparkle1:03 PM
thanks all

I'll be pulling a transcript of the session and posting it on the event page. I'll throw a link in here later.

Discussions