Missions: the Sole of Mission St.

Description

SmartShoe Insoles that provide 3 key Features:

1) A Novel Method of User Input.

From Accessibility to VR/AR/XR and everything in-between, our posture can provide a variety of inputs for a wide range of applications.

2) A real-time Gait Analyzer

Users can be alerted of improper posture immediately, rather than be notified by their doctor decades later when it's too late.

3) A Passive and Continuous body-weight Scale

Our weight fluctuates throughout the day, including vertical spikes as we eat, drink, & use the restroom. However, our weight slowly decreases as we exhale carbon dioxide, which can be used to detect our metabolism fluctuation by noting the slope of the decline. We could also deduce hydration by comparing fluid intake and output, notifying users if they're dehydrated or retaining more water than usual.

Details

We plan to use a Web Technology-based Software Stack, including:

WebUSB and the Serial API to make installation as simple as possible
Web Bluetooth to connect to the device through the browser
WebHID for Accessibility (e.g. using your foot like a gas pedal to scroll the page)
Web Components and Web Extensions to make development as easy as possible
IPFS for data storage
TensorFlow.js for developing Machine Learning-based API's
Solidity and Web3 for developing Smart Contracts that interact with users' data

Thanks to Kevin McCurdy for providing an awesome demo!

Next Steps:

Design a PCB small enough to fit inside the enclosure that contains the following:
- ESP32 WROOM Microcontroller
- 18 pin FPC ribbon connector with male leads between PCB and Flexible PCB Insole female connector
- LiPo Charge Controller 3.7V/4.2V Power Supply
- Micro USB connector to both upload code to ESP32 chip and charge the LiPo battery
- MPU6050 IMU I2C device (Accelerometer/Gyroscope) connected to the SDA/SCL pins of the ESP32 chip
- DRV2605L Haptics controller I2C device connected to the SDA/SCL pins of the ESP32 chip
- 16 10K SMD resistors to decrease the Flexible PCB Insole's pressure sensor output (16 for each sensor on the Flexible PCB Insole)
- Glue (SMD capacitors and SMD resistors) to ensure each module works to their spec
- Gerber Files corresponding to a legible PCB design (preferably through KiCAD)
Field test the insoles to figure out the most optimal pressure sensor distribution
Setup decentralized storage solution to enable users to generate, share, and sell data
Experiment with machine learning models to extract posture, gait, and weight features
Redesign insole flexible PCB and enclosure with new pressure distribution and integration of PCB

Files

LiPo Charge Controller.png

The LiPo Charge Controller allows a microUSB cable to both power and charge the Lithium Polymer battery.

Portable Network Graphics (PNG) - 40.94 kB - 06/15/2019 at 23:00

Preview

Download

Missions Smart Insole Connector.png

Missions Smart Insole Male Connector array used to connect to the female header connector on the Flexible PCB Insole.

Portable Network Graphics (PNG) - 81.72 kB - 06/15/2019 at 22:59

Preview

Download

Power and Filtering Module.png

A power and filtering module for ensuring that the Missions Smart Insole PCB can be powered by either microUSB or by a 3.7/4.2V Lithium Polymer battery.

Portable Network Graphics (PNG) - 53.61 kB - 06/15/2019 at 22:59

Preview

Download

Missions PCB v1.png

The current design for the Missions PCB layout.

Portable Network Graphics (PNG) - 472.76 kB - 06/15/2019 at 22:59

Preview

Download

USB to Serial Converter Module.png

A USB to Serial Converter used to send data between a microUSB to the ESP32 VROOM microcontroller.

Portable Network Graphics (PNG) - 107.87 kB - 06/15/2019 at 22:59

Preview

Download

Components

2 × ESP32 VROOM Module An ESP32 microcontroller that has both bluetooth and wifi capabilities as well as several GPIO pins.

32 × 10K 0402 Resistor Pulldown resistors to decrease pressure sensor sensitivity (to approximate user's foot pressure and movement)

2 × 3.7/4.2V LiPo Battery A battery to power the ESP32 chip

2 × 1x18 Male Pin Header Connector A male pin connector array used to connect the Missions PCB to the Flexible PCB Insole.

2 × MPU6050 6-Axis Accelerometer/Gyroscope An accelerometer/gyroscope module to track the user's foot position and orientation.

Project Logs

Collapse

Discussions

Talib Khurshid wrote 06/24/2019 at 01:39

Wow!

I'm actually working on similar project in Japan.

I'm total noob in this field and facing so many difficulties, it will be great to learn from you guys here and apply in my project !!

Looking forward to see development in this project.

Are you sure? yes | no

Umar Qattan wrote 06/29/2019 at 03:23

Thanks!

Are you sure? yes | no

Kristen Swanner wrote 05/14/2019 at 22:04

This is great! As an elementary school teacher I sometimes lean over to speak with a student instead of squatting. I try to be conscious of my posture and correct for it, but sometimes the moment slips away from me. A device like this could be helpful to me.

Are you sure? yes | no

iarakis wrote 05/09/2019 at 06:23

Great project. I would be glad to join the team for hardware or firmware engineering.

Are you sure? yes | no

Umar Qattan wrote 05/09/2019 at 20:26

@iarakis that would be incredible! I'll be sure to add you.

Are you sure? yes | no

artgodwin wrote 05/08/2019 at 23:06

I'm looking at doing it. But I'm sure all help is gratefully received.

Are you sure? yes | no

phantomchips wrote 05/08/2019 at 22:17

This is a super interesting project. Looking forward to seeing the updates. Did you find someone to help with the pcb?

Are you sure? yes | no

Umar Qattan wrote 05/08/2019 at 23:15

@artgodwin has just followed us and has been super active in helping us out so far!

Are you sure? yes | no

Umar Qattan wrote 05/09/2019 at 02:29

Although we'd appreciate all the help we can get!

Are you sure? yes | no

artgodwin wrote 05/08/2019 at 21:20

I found a few with the same name on that site, but they don't seem to match either. Looks like it generates them on request. Could you include the one it gave you with the files, please ?

Are you sure? yes | no

Umar Qattan wrote 05/08/2019 at 21:36

Here's another link to the exact footprint library to add to your KiCAD editor https://www.snapeda.com/parts/ESP32-DEVKITC-32D/Espressif%20Systems/view-part/

Are you sure? yes | no

artgodwin wrote 05/08/2019 at 20:08

What library have you used for the ESP32-WROOM ? It's not in my standard kicad libraries and the additional one I found at https://hackaday.io/project/13483-esp32-kicad-library doesn't fit your schematic

edit : there is an ESP32 in the kicad libraries, it's in the RF_Module library. But it's very different from the hole in the schematic.

Are you sure? yes | no

Umar Qattan wrote 05/08/2019 at 21:01

I used https://componentsearchengine.com/

Are you sure? yes | no

marblypup wrote 05/08/2019 at 17:13

Interesting! I'm currently (very slowly) making a walking robot with load cells for toes!

Are you sure? yes | no

dvalenzuela3 wrote 05/08/2019 at 16:19

Do you have the video of the presentation of one of the pictures?

Are you sure? yes | no

Umar Qattan wrote 05/08/2019 at 17:45

videos can be found in the starred links - we've included "(VIDEO)" in the titles for clarity

Are you sure? yes | no

stefane.lemay wrote 05/08/2019 at 16:14

Which Pressure Sensors have you used? It is not listed in the Components...

Are you sure? yes | no

Umar Qattan wrote 05/08/2019 at 17:49

They're resistive pressure sensors - we've included them in the "Components" section (thanks for pointing that out!)

Are you sure? yes | no

Missions: the Sole of Mission St.

Description

Details

Files

LiPo Charge Controller.png

Missions Smart Insole Connector.png

Power and Filtering Module.png

Missions PCB v1.png

USB to Serial Converter Module.png

Components

Project Logs

Collapse

New case design (thinner holes and sticker)

Training our Smart Insoles to detect weight with ML5.js and Wii Balance Board

more Machine Learning with ML5.js

Visualizing Center of Mass

Connecting to a Wii Balanace Board via WebHID - useful for Machine Learning

Locomotion in VR

Treadmill test

Data viz

Gesture Recognition with Tensorflow Lite for ESP32

Our first customer

Discussions

Similar Projects

Cheap airspeed sensor for INAV

Modbus RTU implementation using STM32F103C8T6

Robogaia 2d Robotic Obstacle Detector

FacilTempo - weather station

Missions: the Sole of Mission St.

Become a Hackaday.io member

Just one more thing

Description

Details

Files

Components

Project Logs Collapse

Enjoy this project?

Discussions

Become a Hackaday.io Member

Similar Projects

Does this project spark your interest?

Report project as inappropriate

Send message

Remove Member

Project Logs

Collapse