Integration and testing05/24/2023 at 10:09 • 0 comments
Locator band prototype:
Testing movie clip:
Hardware design05/23/2023 at 10:35 • 0 comments
The hardware design is straightforward. The flappers will be installed on the motors and pressed on the user's arm gently and repeatedly to indicate the direction to move.
The device will be separated into the following modules:
- left flapper
- right flapper
- forward and backward flapper
- controller module
All the modules would be installed onto the elastic band eventually to make the device portable and easy to use.
As this is still the POC stage, the battery is not included and the wirings would be handled afterward.
For the left/ right flapper module:
For the forward/ backward flapper module:
For the Arduino and Bluetooth module:
Apps design05/22/2023 at 23:13 • 0 comments
- To identify the fork and arm (hand)
- To show existence of the fork and arm
- To indicate in which direction the arm should move in text
Yolo has been chosen for object detection. In comparison with CNN or typical machine learning method, Yolo would give better performance in terms of speed, accuracy and flexibility.
The following is the learning and testing results:
The next step would be the hardware side
Conceptual system design05/21/2023 at 14:56 • 0 comments
- able to locate the arm(hand), fork and plate on the table
- able to give a clear notification to the visually impaired
- the outcome would be a portable device
- (optional) Others would not know while using the device
- object identification <1s
- the actuator should be as small as possible
- the device is wearable
The process flow:
- The mobile camera would be used for object detection.
- After the objects were recognized, the corresponding actuators would be activated to indicate the arm movement.
- When the arm and target are very near, there would be another signal to indicate the user to pick the target.