Step 10. GUILLENGAP Robot Arm 2nd Version - HW & SW

A project log for GUILLENGAP Robot Arm

Collaborative Robot Arm with Artificial Intelligence, and Used as Assistant in: 1) Voice Command System, and 2) Sorting Objects System

Guillermo Perez GuillenGuillermo Perez Guillen 07/29/2021 at 19:400 Comments

As part of the continuous improvements, in this prototype I experimented with different hardware and software and using free open source tools as shown below.


The schematic diagram below shows the electrical connections of the electronic components.

How does it work?

  1. We use voice commands to perform three functions: 1) controlling a bottle; 2) controlling a plate; and 3) controlling a box.
  2. The voice commands are activated through Alexa Echo Dot, and they reach the ESP32-WROOM-32 board via WiFi.
  3. Finally, these voice commands are transmitted to the Arduino Nano 33 BLE Sense board, which controls the robot arm.


The FauxmoESP

To control the ESP32 with Alexa Echo Dot, you need to install the FauxmoESP library. This library emulates a Belkin Wemo device, allowing you to control your ESP32 using this protocol. This way, the Echo Dot instantly recognizes the device, after uploading the code, without any extra skills or third party services. You can read more about FauxmoESP here.

Installing the ESP32 Board in Arduino IDE

In order to upload code to your ESP32 using Arduino IDE, you should install an add-on for the Arduino IDE that allows you to program the ESP32 using the Arduino IDE and its programming language. You can read more about Installing the ESP32 Board in Arduino IDE here.

Installing the AsyncTCP Library

You also need to install the AsyncTCP Library. You can read more about Installing the AsyncTCP Library here.


You can get the codes on my Github repository: guillengap-robot-arm