Close
0%
0%

Omnidireccional Robot controlled by Amazon

Robot that moves from one square to another, after receiving commands by Infrared, Amazon Alexa assistance and Image Recognizer

Similar projects worth following

The purpose of this project is to create a robot car with ominidirectional step motor wheels, and replace one of humans by a Robot in this large game board developted in the FURB, Blumenau´s University, Brazil.
The control will be using infrared and the most importante, Voice and Image Rekognizer, both services of Amazon.


The first try was to try the  robot found in Aliexpress with omnidireccional dc motor wheels, but we got problems with torque at low speed, then we have to up speed, but had problem too with innercial and many of times no precision on infrared sensor reading, because cross to fast the black marker on game board, and main problem, the dc motor whistles

look :(

Now with Step Motors :)

Tests with Step Motor

We had to:

-replace the the step motors to move the robot from one rectangule to another, having precision with the help of 6 infrared sensors and step motors

-replace the Arduino Uno by a Arduino Mega ARM to get more GPIOS to control the 4 step motors and make the reading of 6 infrared sensors 

-build a 3D support to motor on chassis and axis converter to connect the step motors to the wheel

-build a prototype of a square using the insulating tape on the table to make tests with  step motor wheels, to test speed and torque. We used 5V step motor model 28byj.

After the assembly of step motors and sensors:

The commands to the robot can to be sent in various ways: 

- remote control (IRDA)

-voice commands from the Alexa assistance (Alexa "Echo" on ESP32 LyRat)

- ESP32CAM connected  Amazon Recognizer  (to detecting text on original instructions Cards) and also via socket from PC after get streaming image of gamed board and processing it.

"Alexa, my little Robot" 

Then

"Robot, move to west"

"Robot, move to east"

"Robot, move to north"

"Robot, move to south

and instructions cards

Cards movements that the robot detects (Amazon Rekognizer)

"move South"

'"move West"

"move east"

"move north"

Proximidy Card Detect, infrared transmitter and ESP32 CAM

Updates of prototype:

Hardware

-build a new chassis that use the aliexpress original and defines the news holes positions and support to Arduino Mega, ESP32 CAM,  sensors support and step motors and finally the Lyra T Amazon "ECHO"

-replace the Arduino Mega ARM by a Arduino Mega 2560

-add more 2 infrared sensors to get more precision in all movements, because sometimes the robot skids a bit and need to make adjust on stop position

Software

-ESP32CAM Software access to AMAZON AWS IoT Core,  AMAZON Rekognizer, Infrared and finally communications with Arduino Mega 2560

-Arduino Mega 2560 Software (to detect all sensors positions) to make the next movement and receive the command

-Amazon Lambda Sofftware to call Amazon Alexa  and Amazon Regoknizer API (JavasScript  and Python)

-LyRa T ESP32 Software (similar to Alexa Echo)

Wheels

Last update before Add the Lyra T and speakers on Robot and make finally the Chassis and Battery charger

This is what the robot see :)

See more

Amazon "OCR"

Alexa....

And wear the Robot :)

notes.txt

Gpios choosen to control the Robot. Amazon Invoke sequence and Robots commands (Alexa)

plain - 777.00 bytes - 04/13/2023 at 10:48

Download

medidas.png

First Draft chassis dimensions.

Portable Network Graphics (PNG) - 6.69 kB - 04/13/2023 at 10:46

Preview
Download

Robot_Webcam.ino

Version of ESP32 WEBCAM, acessing AMAZON, taking picture to rekognizer images and receive Alexa commands and finally sensding using infrared to Arduino mega.

ino - 20.13 kB - 04/13/2023 at 10:45

Download

robot_chassis.ino

Version of ARDUINO MEGA robot controller, now with 8 infrared sensors.

ino - 20.33 kB - 04/13/2023 at 10:35

Download

robot.ino

First and poor version of ARDUINO MEGA robot controller.

ino - 7.11 kB - 04/10/2023 at 15:43

Download

View all 12 files

  • 1 × Arduino ATMEGA2560 This component will have the main function of read the 6 sensors and make the moviment controlling the 3 step motors. It will receive the commans from the ESP32 CAM, using a infrared receiver.
  • 1 × ESP32 CAM This component will have the main function to connect to AWS and send the JPG image got from the game card. It will to subscribe to AWS IoT core. After the image been processed on Amazon or got a Alexa command invoke, will transmite by infrared the command do ATMEGA 2560.
  • 4 × 28BYJ-48 + DRIVER This component will drive the Step motor.
  • 1 × KY-022 (Remote Control and Infrared Receiver) This component (on ATMEGA) will receive the INFRARED command send by ESP32 CAM
  • 1 × Ky-005 This componente (on ESP32 CAM) will transmit an infrared command to ATMEGA

View all 7 components

  • to do

    Miguel Wisintainer04/10/2023 at 14:57 0 comments

    Make new  Chassis to replace the original

    Update the Arduino MEGA shield to accept 8 infrared sensors

    Rebuild the Wheel Support

    Review Arduino Code

    Add infrared extensor

    Add Lyrat support + Lyrat Speakers

    Add a Skin to the Robot with head movement :)

View project log

Enjoy this project?

Share

Discussions

Similar Projects

Does this project spark your interest?

Become a member to follow this project and never miss any updates