Close

Hack Chat Transcript, Part 4

A event log for Machine Learning with Microcontrollers Hack Chat

Arduinos and Pis and AI, oh my

lutetiumLutetium 09/11/2019 at 20:200 Comments



Daniel Situnayake12:52 PM
@13r1ckz I recommended a couple of books earlier in the chat:

https://www.manning.com/books/deep-learning-with-python

https://www.amazon.com/Hands-Machine-Learning-Scikit-Learn-TensorFlow/dp/1491962291

as.instrumedglobal12:53 PM
@Daniel Situnayake yeah actually, working on an algorithm to detect various open surgical tools identified so that it can help us out categorizing them after being jumbled in a surgery. any resources I can jump start from, typically a dataset, or do you advise me to build my own and work my way up?

Don Gabriel12:53 PM
Is there an example(s) with YOLO + ML combo implementation with a MCU?

Max-Felix Müller12:53 PM
Thanks @Daniel Situnayake and @Pete Warden

cet12:53 PM
Thank you for that link, and I second 'Deep learning with python' for a beginner.

13r1ckz12:55 PM
@Daniel Situnayake wow great ill get those books asap

Daniel Situnayake12:56 PM
@as.instrumedglobal that's very interesting! I think you'd likely need to find or build a dataset first, then you could use transfer learning to re-train an existing model to recognize the surgical tools

Daniel Situnayake12:57 PM
@Don Gabriel not that I know of!

Daniel Situnayake12:58 PM
@as.instrumedglobal this blog post I just found shows how you can do transfer learning with an object detection model (which can identify multiple instances of multiple classes of object in an image): https://medium.com/practical-deep-learning/a-complete-transfer-learning-toolchain-for-semantic-segmentation-3892d722b604

Don Gabriel12:59 PM
Also, RISC-V seems to more becoming popular. Any ML / DL ports for RISC-V in the future?

Daniel Situnayake12:59 PM
OK, I better head out and finish off writing this book :D Ping me on Twitter if you have any more questions!! https://twitter.com/dansitu

Daniel Situnayake12:59 PM
Thank you everyone!!

Max-Felix Müller12:59 PM
We talked a lot about Corrtex CPUs here. Are they strictly neccessary? What about ATmegas for example? I guess it depends on the size of the model and what the plan is with the processed dat

Don Gabriel1:00 PM
I am comfortable with PICs since I have used them for many years

de∫hipu1:01 PM
if only they had an open source toolchain...

de∫hipu1:02 PM
@Max-Felix Müller atmegas are on the smaller side of the microcontroller families, might be enough to do a simple perceptron, but 2kB of ram doesn't work well with bigger nets

Don Gabriel1:02 PM
open source toolchain for PICs? RISC-V does

de∫hipu1:03 PM
with an open source programmer as well?

Don Gabriel1:03 PM
I just started experimenting with RISC-V and seems promising

Max-Felix Müller1:03 PM
@de∫hipu Yeah, I think you will need a bit more than the atmega has to offer

as.instrumedglobal1:03 PM
@Daniel Situnayake hmmm yeah I figured I'd have to do that since I couldn't find any. well, I think it can be an interesting project to work on, and I have access to plenty surgical sets from work so I know I can get decent info at least for the common tools. Thanks for the help and to all the Tensorflow Dev team, keep up the great work! To the peeps from Adafruit, your hardware makes me drool and everytime I check you Insta feed there's one more board that goes on the bucket list :D

de∫hipu1:04 PM
@Max-Felix Müller you can always add external memory, but it would be sloooooow

gh787311:04 PM
Microchip now has a bunch of ARM processor cores, including the M7 Core, that they program using the same toolchain, and have hung the same old peripherals on them, so not a big transition.

Don Gabriel1:04 PM
cool thx gh78731

Max-Felix Müller1:05 PM
@de∫hipu I think I will have to run some tests... What a great project idea for my holidays :D

de∫hipu1:08 PM
@Max-Felix Müller you know, someone actually ran a Linux kernel on an UNO with additional ram, running an ARM emulator...

de∫hipu1:08 PM
@Max-Felix Müller it only took about one week to boot

Don Gabriel1:08 PM
can we do facial recognition effectively at the edge? Just curious

de∫hipu1:09 PM
@Don Gabriel sure, there is that esp32 camera board that does it

de∫hipu1:09 PM
for $10 or something

Meghna Natraj1:11 PM
Summarizing resources to get started (tip: try out the codelabs aka tutorials first)

For mobile and micro-controllers (in general):

Codelab: https://codelabs.developers.google.com/codelabs/recognize-flowers-with-tensorflow-on-android/#0

Tensorflow Lite: https://www.tensorflow.org/lite

For micro-controllers only:

Codelab: https://codelabs.developers.google.com/codelabs/sparkfun-tensorflow/#0

Tensorflow Lite for MicroControllers:

https://www.tensorflow.org/lite/microcontrollers/overview

(github) https://github.com/tensorflow/tensorflow/tree/master/tensorflow/lite/experimental/micro

For machine learning:

Andrew NG’s Machine Learning Course and Deep Learning Specialization

(Available on youtube and coursera for free)


UPCOMING: Watch out for the TinyML book release in January 2020: http://shop.oreilly.com/product/0636920254508.do (@Pete Warden and @Daniel Situnayake have done an excellent job to consolidate all resources into one book -- for anyone who wants to get started in this field)


Discussions